Jul 22 03:31:32.430985 ip-10-0-142-88 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 03:31:32.430996 ip-10-0-142-88 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 03:31:32.431004 ip-10-0-142-88 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 03:31:32.431349 ip-10-0-142-88 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 03:31:42.639211 ip-10-0-142-88 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 22 03:31:42.639231 ip-10-0-142-88 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 350d7aaaa4fe45b484740cf1ea8b744e --
Jul 22 03:33:42.712981 ip-10-0-142-88 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 03:33:43.118753 ip-10-0-142-88 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 03:33:43.118753 ip-10-0-142-88 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 03:33:43.118753 ip-10-0-142-88 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 03:33:43.118753 ip-10-0-142-88 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 03:33:43.118753 ip-10-0-142-88 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 03:33:43.119421 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.118735    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 03:33:43.125677 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125656    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:33:43.125677 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125677    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125681    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125685    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125688    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125691    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125693    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125697    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125700    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125703    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125706    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125709    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125712    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125714    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125717    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125719    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125722    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125724    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125727    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125729    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125734    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:33:43.125761 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125737    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125741    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125744    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125748    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125751    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125754    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125756    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125759    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125762    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125771    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125774    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125776    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125779    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125782    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125785    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125787    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125790    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125793    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125795    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125798    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:33:43.126218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125800    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125802    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125805    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125807    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125810    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125812    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125815    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125817    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125819    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125822    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125824    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125826    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125829    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125831    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125835    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125837    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125840    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125842    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125844    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125847    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:33:43.126710 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125849    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125852    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125854    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125857    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125859    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125861    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125864    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125867    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125869    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125872    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125875    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125877    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125880    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125883    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125887    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125889    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125892    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125894    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125896    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125901    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:33:43.127228 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125904    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125907    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125910    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125912    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125915    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125917    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125921    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125924    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125926    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125929    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125931    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125934    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125936    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125939    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125941    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125943    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125947    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.125951    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126703    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:33:43.127732 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126710    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126715    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126719    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126722    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126731    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126734    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126736    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126739    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126741    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126744    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126746    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126749    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126752    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126754    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126757    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126759    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126762    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126764    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126767    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126771    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:33:43.128178 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126774    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126776    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126780    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126782    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126785    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126787    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126790    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126792    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126795    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126797    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126800    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126802    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126805    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126807    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126809    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126812    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126814    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126824    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126826    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126830    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:33:43.128682 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126832    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126834    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126837    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126839    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126842    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126844    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126847    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126849    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126851    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126854    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126856    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126860    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126863    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126865    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126868    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126870    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126873    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126875    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126878    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:33:43.129247 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126882    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126885    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126888    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126891    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126894    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126897    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126899    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126903    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126905    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126908    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126910    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126918    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126921    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126923    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126926    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126929    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126931    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126934    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126936    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126939    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:33:43.129737 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126941    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126944    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126946    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126949    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126952    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126955    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126958    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126960    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126962    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126965    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126967    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126970    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126972    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126975    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126977    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126979    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126982    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126986    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.126989    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:33:43.130226 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127391    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127396    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127399    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127402    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127404    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127407    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127410    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127413    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127415    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127418    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127420    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127423    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127426    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127428    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127430    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127433    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127436    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127439    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127442    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127444    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:33:43.130712 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127447    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127449    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127452    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127455    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127457    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127460    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127462    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127465    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127467    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127469    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127472    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127474    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127476    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127479    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127481    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127483    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127486    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127489    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127491    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:33:43.131195 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127495    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127498    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127501    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127503    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127506    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127509    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127512    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127514    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127517    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127520    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127523    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127526    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127528    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127530    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127533    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127535    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127538    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127540    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127543    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127545    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:33:43.131638 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127547    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127550    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127552    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127554    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127557    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127560    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127562    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127565    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127567    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127569    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127571    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127574    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127577    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127579    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127582    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127584    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127587    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127589    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127591    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127594    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:33:43.132184 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127596    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127599    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127601    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127604    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127606    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127609    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127612    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127615    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127618    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127620    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127623    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127626    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127628    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127632    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127635    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127637    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127655    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127659    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127661    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:33:43.132674 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.127664    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127742    2569 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127756    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127762    2569 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127768    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127772    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127775    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127780    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127784    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127787    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127790    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127793    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127796    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127799    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127805    2569 flags.go:64] FLAG: --cgroup-root=""
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127808    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127810    2569 flags.go:64] FLAG: --client-ca-file=""
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127813    2569 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127816    2569 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127821    2569 flags.go:64] FLAG: --cluster-domain=""
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127824    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127827    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127830    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127834    2569 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 03:33:43.133141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127838    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127841    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127844    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127847    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127850    2569 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127853    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127856    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127859    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127862    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127865    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127868    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127871    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127874    2569 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127877    2569 flags.go:64] FLAG: --enable-server="true"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127881    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127885    2569 flags.go:64] FLAG: --event-burst="100"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127888    2569 flags.go:64] FLAG: --event-qps="50"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127890    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127893    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127896    2569 flags.go:64] FLAG: --eviction-hard=""
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127901    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127904    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127909    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127913    2569 flags.go:64] FLAG: --eviction-soft=""
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127915    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 03:33:43.133727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127918    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127921    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127924    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127927    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127930    2569 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127933    2569 flags.go:64] FLAG: --feature-gates=""
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127936    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127939    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127942    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127945    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127948    2569 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127951    2569 flags.go:64] FLAG: --help="false"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127954    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127957    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127960    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127962    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127965    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127969    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127971    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127974    2569 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127977    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127979    2569 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127983    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127986    2569 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 03:33:43.134334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127989    2569 flags.go:64] FLAG: --kube-reserved=""
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127991    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127994    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.127999    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128002    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128006    2569 flags.go:64] FLAG: --lock-file=""
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128009    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128011    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128014    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128020    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128023    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128026    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128029    2569 flags.go:64] FLAG: --logging-format="text"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128032    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128036    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128038    2569 flags.go:64] FLAG: --manifest-url=""
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128041    2569 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128045    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128048    2569 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128053    2569 flags.go:64] FLAG: --max-pods="110"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128055    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128058    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128061    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128064    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128066    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 03:33:43.134918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128069    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128072    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128080    2569 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128083    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128085    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128088    2569 flags.go:64] FLAG: --pod-cidr=""
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128092    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128097    2569 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128099    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128103    2569 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128107    2569 flags.go:64] FLAG: --port="10250"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128110    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128113    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0000428606ad83366"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128118    2569 flags.go:64] FLAG: --qos-reserved=""
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128121    2569 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128124    2569 flags.go:64] FLAG: --register-node="true"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128127    2569 flags.go:64] FLAG: --register-with-taints=""
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128130    2569 flags.go:64] FLAG: --registry-burst="10"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128133    2569 flags.go:64] FLAG: --registry-qps="5"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128136    2569 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128138    2569 flags.go:64] FLAG: --reserved-memory=""
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128142    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128144    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128147    2569 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128150    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 03:33:43.135546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128153    2569 flags.go:64] FLAG: --runonce="false"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128156    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128159    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128161    2569 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128164    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128167    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128170    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128173    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128176    2569 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128179    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128182    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128191    2569 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128194    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128197    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128201    2569 flags.go:64] FLAG: --system-cgroups=""
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128203    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128209    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128212    2569 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128215    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128220    2569 flags.go:64] FLAG: --tls-min-version=""
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128224    2569 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128227    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128229    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128232    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128235    2569 flags.go:64] FLAG: --v="2"
Jul 22 03:33:43.136167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128239    2569 flags.go:64] FLAG: --version="false"
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128243    2569 flags.go:64] FLAG: --vmodule=""
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128247    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.128250    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128379    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128382    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128386    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128388    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128391    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128394    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128396    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128399    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128401    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128404    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128414    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128418    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128420    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128423    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128425    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128428    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:33:43.136809 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128430    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128433    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128437    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128440    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128444    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128447    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128449    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128454    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128456    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128459    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128461    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128464    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128466    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128469    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128472    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128474    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128477    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128479    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128481    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128484    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:33:43.137282 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128487    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128489    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128491    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128494    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128497    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128499    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128502    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128504    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128507    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128509    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128513    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128517    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128519    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128522    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128525    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128528    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128534    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128537    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128540    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128544    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:33:43.137854 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128547    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128550    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128553    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128555    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128558    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128561    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128564    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128567    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128569    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128572    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128575    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128577    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128579    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128582    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128586    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128589    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128591    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128594    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128596    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128599    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:33:43.138343 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128601    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128604    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128606    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128608    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128611    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128613    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128616    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128618    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128622    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128625    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128627    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128631    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128633    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128636    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128656    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128660    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128664    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128666    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128669    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:33:43.138833 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128672    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128675    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128678    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.128681    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.129969    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.137151    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.137167    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.137188    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.137193    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137251    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137256    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137260    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137263    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137266    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137269    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:33:43.139292 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137272    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137274    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137277    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137280    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137282    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137285    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137289    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137292    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137294    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137297    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137300    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137302    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137305    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137307    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137311    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137315    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137318    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137321    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137324    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:33:43.139679 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137327    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137329    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137332    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137334    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137338    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137340    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137343    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137346    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137348    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137351    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137354    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137356    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137359    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137361    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137364    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137366    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137368    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137371    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137375    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:33:43.140126 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137378    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137382    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137384    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137387    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137391    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137393    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137396    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137398    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137401    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137403    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137406    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137408    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137410    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137413    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137416    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137419    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137421    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137424    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137427    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137429    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:33:43.140611 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137432    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137434    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137437    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137439    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137442    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137444    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137447    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137449    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137451    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137455    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137458    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137461    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137464    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137467    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137470    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137473    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137475    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137478    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137480    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:33:43.141129 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137483    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137485    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137489    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137491    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137494    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137496    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137499    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137502    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137505    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137507    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137510    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137512    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137515    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137517    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137520    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:33:43.141576 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137522    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.137527    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137662    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137667    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137670    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137674    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137678    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137681    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137684    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137686    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137689    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137691    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137694    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137697    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137700    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 03:33:43.142042 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137702    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137728    2569 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137732    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137735    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137738    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137741    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137744    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137747    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137750    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137752    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137755    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137757    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137760    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137763    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137765    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137768    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137770    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137773    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137775    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137778    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 03:33:43.142416 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137780    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137783    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137786    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137788    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137791    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137793    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137795    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137798    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137802    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137805    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137808    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137811    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137814    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137816    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137819    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137821    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137824    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137827    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137830    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 03:33:43.142915 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137832    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137834    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137837    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137840    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137842    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137845    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137848    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137850    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137853    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137855    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137858    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137860    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137863    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137866    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137868    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137872    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137875    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137878    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137881    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 03:33:43.143381 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137883    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137886    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137889    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137891    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137894    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137896    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137899    2569 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137901    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137904    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137906    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137909    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137911    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137913    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137916    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137918    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137921    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137923    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137926    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137929    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 03:33:43.143858 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137931    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137933    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137936    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137938    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137940    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137943    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137945    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137948    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:43.137950    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.137955    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.138072    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.140237    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.141805    2569 server.go:1019] "Starting client certificate rotation"
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.141908    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 03:33:43.144337 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.141947    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 03:33:43.144752 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.144738    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 03:33:43.152150 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.152125    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 03:33:43.164319 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.164296    2569 log.go:25] "Validated CRI v1 runtime API"
Jul 22 03:33:43.166626 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.166608    2569 log.go:25] "Validated CRI v1 image API"
Jul 22 03:33:43.167401 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.167382    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 03:33:43.170281 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.170245    2569 fs.go:135] Filesystem UUIDs: map[26fcfd61-ae16-4acc-95dc-89d9d80c7974:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ed0d7d6e-50f2-47b9-be6c-ad9c60442203:/dev/nvme0n1p4]
Jul 22 03:33:43.170366 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.170280    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 03:33:43.172816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.172796    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 03:33:43.175572 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.175461    2569 manager.go:216] Machine: {Timestamp:2026-07-22 03:33:43.174036096 +0000 UTC m=+0.341270752 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099764 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f72de5730bdd891c8d89ce52dd3bb SystemUUID:ec2f72de-5730-bdd8-91c8-d89ce52dd3bb BootID:350d7aaa-a4fe-45b4-8474-0cf1ea8b744e Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d4:13:29:a9:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d4:13:29:a9:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:a5:cd:93:b7:e4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 03:33:43.175572 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.175567    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 03:33:43.175704 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.175663    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 03:33:43.178932 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.178908    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 03:33:43.179075 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.178936    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-88.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 03:33:43.179762 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.179751    2569 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 03:33:43.179793 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.179765    2569 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 03:33:43.179793 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.179773    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 03:33:43.180469 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.180458    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 03:33:43.181754 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.181743    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 03:33:43.185028 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.185016    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 03:33:43.185146 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.185136    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 03:33:43.185183 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.185167    2569 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 03:33:43.185183 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.185178    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 03:33:43.185249 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.185193    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 03:33:43.185249 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.185204    2569 kubelet.go:398] "Adding apiserver pod source"
Jul 22 03:33:43.185249 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.185213    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 03:33:43.185593 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.185581    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 03:33:43.185710 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.185599    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 03:33:43.187946 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.187921    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 03:33:43.191766 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.191744    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 03:33:43.191855 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.191778    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 03:33:43.194065 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194049    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 03:33:43.194065 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194067    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 03:33:43.194257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194074    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 03:33:43.194257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194085    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 03:33:43.194257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194094    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 03:33:43.194257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194101    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 03:33:43.194257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194110    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 03:33:43.194257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194115    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 03:33:43.194257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194154    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 03:33:43.194257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194175    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 03:33:43.194257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194190    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 03:33:43.194257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194201    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 03:33:43.194257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194242    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 03:33:43.194257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.194252    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 03:33:43.194760 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.194724    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 03:33:43.194760 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.194730    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-88.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 03:33:43.195426 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.195406    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-755xp"
Jul 22 03:33:43.198329 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.198311    2569 server.go:1268] "Started kubelet"
Jul 22 03:33:43.198432 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.198380    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 03:33:43.198515 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.198437    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 03:33:43.198624 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.198535    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 03:33:43.199274 ip-10-0-142-88 systemd[1]: Started Kubernetes Kubelet.
Jul 22 03:33:43.200481 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.200469    2569 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 03:33:43.200588 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.200572    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 03:33:43.203210 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.203191    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 03:33:43.203496 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.203484    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-755xp"
Jul 22 03:33:43.207912 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.207893    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 03:33:43.207994 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.207912    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 03:33:43.208143 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.208122    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:43.208391 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.208297    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-88.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 03:33:43.208764 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.208748    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 03:33:43.208850 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.208768    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 03:33:43.208850 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.208753    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 03:33:43.208961 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.208944    2569 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 03:33:43.208961 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.208959    2569 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 03:33:43.209105 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.209088    2569 factory.go:55] Registering systemd factory
Jul 22 03:33:43.209160 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.209111    2569 factory.go:223] Registration of the systemd container factory successfully
Jul 22 03:33:43.209385 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.209372    2569 factory.go:153] Registering CRI-O factory
Jul 22 03:33:43.209385 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.209387    2569 factory.go:223] Registration of the crio container factory successfully
Jul 22 03:33:43.209458 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.209442    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 03:33:43.209496 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.209461    2569 factory.go:103] Registering Raw factory
Jul 22 03:33:43.209496 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.209473    2569 manager.go:1196] Started watching for new ooms in manager
Jul 22 03:33:43.209694 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.208213    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-88.ec2.internal.18c47f36387da5db  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-88.ec2.internal,UID:ip-10-0-142-88.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-88.ec2.internal,},FirstTimestamp:2026-07-22 03:33:43.198279131 +0000 UTC m=+0.365513786,LastTimestamp:2026-07-22 03:33:43.198279131 +0000 UTC m=+0.365513786,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-88.ec2.internal,}"
Jul 22 03:33:43.210110 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.210091    2569 manager.go:349] Starting recovery of all containers
Jul 22 03:33:43.214478 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.213804    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:33:43.221317 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.221283    2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-88.ec2.internal\" not found" node="ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.221592 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.221569    2569 manager.go:354] Recovery completed
Jul 22 03:33:43.228739 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.228594    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:33:43.230732 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.230704    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:33:43.230817 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.230742    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:33:43.230817 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.230754    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:33:43.231367 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.231348    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 03:33:43.231367 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.231365    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:33:43.231502 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.231364    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 03:33:43.231502 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.231442    2569 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 03:33:43.232212 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.232193    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:33:43.232275 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.232224    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:33:43.232275 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.232237    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:33:43.232679 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.232636    2569 policy_none.go:49] "None policy: Start"
Jul 22 03:33:43.232679 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.232664    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 03:33:43.232679 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.232675    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 03:33:43.233886 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.233875    2569 policy_none.go:47] "Start"
Jul 22 03:33:43.266243 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.266226    2569 manager.go:337] "Starting Device Plugin manager"
Jul 22 03:33:43.266382 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.266261    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 03:33:43.266382 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.266270    2569 server.go:87] "Starting device plugin registration server"
Jul 22 03:33:43.266606 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.266580    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 03:33:43.266663 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.266610    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 03:33:43.266740 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.266719    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 03:33:43.266855 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.266811    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 03:33:43.266855 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.266825    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 03:33:43.267907 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.267889    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 03:33:43.267973 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.267936    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:43.367156 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.367106    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:33:43.368336 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.368142    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:33:43.368336 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.368172    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:33:43.368336 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.368183    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:33:43.368336 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.368209    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.370224 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.370175    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 03:33:43.371566 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.371546    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 03:33:43.371614 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.371598    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 03:33:43.371674 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.371627    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 03:33:43.371728 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.371689    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 03:33:43.373897 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.373876    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:33:43.374488 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.374461    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.374576 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.374493    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-88.ec2.internal\": node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:43.422332 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.422295    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:43.472390 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.472354    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-88.ec2.internal"]
Jul 22 03:33:43.472485 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.472465    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:33:43.473406 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.473388    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:33:43.473478 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.473425    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:33:43.473478 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.473441    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:33:43.474764 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.474752    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:33:43.474890 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.474875    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.474940 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.474918    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:33:43.475584 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.475564    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:33:43.475698 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.475597    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:33:43.475698 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.475607    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:33:43.475698 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.475564    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:33:43.475698 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.475664    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:33:43.475698 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.475682    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:33:43.476929 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.476913    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.477023 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.476943    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 03:33:43.477655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.477618    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 03:33:43.477738 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.477665    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 03:33:43.477738 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.477693    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeHasSufficientPID"
Jul 22 03:33:43.501583 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.501556    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-88.ec2.internal\" not found" node="ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.506429 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.506410    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-88.ec2.internal\" not found" node="ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.510686 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.510663    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46c62c91158651b8c162424cb4d731b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal\" (UID: \"46c62c91158651b8c162424cb4d731b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.510780 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.510698    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46c62c91158651b8c162424cb4d731b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal\" (UID: \"46c62c91158651b8c162424cb4d731b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.510780 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.510722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e36264e631cd609e30a4368a2627c6d6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-88.ec2.internal\" (UID: \"e36264e631cd609e30a4368a2627c6d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.522907 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.522879    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:43.611161 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.611123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46c62c91158651b8c162424cb4d731b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal\" (UID: \"46c62c91158651b8c162424cb4d731b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.611161 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.611161    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46c62c91158651b8c162424cb4d731b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal\" (UID: \"46c62c91158651b8c162424cb4d731b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.611397 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.611181    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e36264e631cd609e30a4368a2627c6d6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-88.ec2.internal\" (UID: \"e36264e631cd609e30a4368a2627c6d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.611397 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.611239    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e36264e631cd609e30a4368a2627c6d6-config\") pod \"kube-apiserver-proxy-ip-10-0-142-88.ec2.internal\" (UID: \"e36264e631cd609e30a4368a2627c6d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.611397 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.611262    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46c62c91158651b8c162424cb4d731b1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal\" (UID: \"46c62c91158651b8c162424cb4d731b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.611397 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.611263    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46c62c91158651b8c162424cb4d731b1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal\" (UID: \"46c62c91158651b8c162424cb4d731b1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.623626 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.623550    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:43.724388 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.724360    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:43.805605 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.805563    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.810203 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:43.809827    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:43.825412 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.825380    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:43.926074 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:43.925981    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:44.026566 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:44.026524    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:44.127161 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:44.127126    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:44.141338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.141304    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 03:33:44.141511 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.141489    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 03:33:44.141549 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.141512    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 03:33:44.209263 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.209178    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 03:28:43 +0000 UTC" deadline="2028-04-11 05:14:54.817866588 +0000 UTC"
Jul 22 03:33:44.209263 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.209209    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15097h41m10.608659561s"
Jul 22 03:33:44.227613 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:44.227579    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:44.328112 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:44.328072    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:44.356006 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:44.355963    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46c62c91158651b8c162424cb4d731b1.slice/crio-2c888c9976c106cab05d988d98198b9f23d1c39261fc96182e55344e05644c0e WatchSource:0}: Error finding container 2c888c9976c106cab05d988d98198b9f23d1c39261fc96182e55344e05644c0e: Status 404 returned error can't find the container with id 2c888c9976c106cab05d988d98198b9f23d1c39261fc96182e55344e05644c0e
Jul 22 03:33:44.356243 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:44.356221    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36264e631cd609e30a4368a2627c6d6.slice/crio-90ee9a4800539d11364442a3dd2ffcc907e6539992da46305cc14d10a265bf2f WatchSource:0}: Error finding container 90ee9a4800539d11364442a3dd2ffcc907e6539992da46305cc14d10a265bf2f: Status 404 returned error can't find the container with id 90ee9a4800539d11364442a3dd2ffcc907e6539992da46305cc14d10a265bf2f
Jul 22 03:33:44.361462 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.361445    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:33:44.375488 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.375429    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal" event={"ID":"46c62c91158651b8c162424cb4d731b1","Type":"ContainerStarted","Data":"2c888c9976c106cab05d988d98198b9f23d1c39261fc96182e55344e05644c0e"}
Jul 22 03:33:44.376746 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.376716    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-88.ec2.internal" event={"ID":"e36264e631cd609e30a4368a2627c6d6","Type":"ContainerStarted","Data":"90ee9a4800539d11364442a3dd2ffcc907e6539992da46305cc14d10a265bf2f"}
Jul 22 03:33:44.429297 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:44.429239    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:44.530033 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:44.529939    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:44.630319 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:44.630273    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-88.ec2.internal\" not found"
Jul 22 03:33:44.670604 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.670574    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:33:44.709067 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.709036    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:44.709252 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.709097    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:33:44.720469 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.720440    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 03:33:44.721590 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.721571    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-88.ec2.internal"
Jul 22 03:33:44.730732 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:44.730707    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 03:33:45.181613 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.181583    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:33:45.185761 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.185736    2569 apiserver.go:52] "Watching apiserver"
Jul 22 03:33:45.202864 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.202829    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 03:33:45.203356 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.203333    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8tsf5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb","openshift-cluster-node-tuning-operator/tuned-4kb8q","openshift-image-registry/node-ca-8n7fw","openshift-network-operator/iptables-alerter-f77c8","openshift-ovn-kubernetes/ovnkube-node-lhcg8","kube-system/konnectivity-agent-p47hl","kube-system/kube-apiserver-proxy-ip-10-0-142-88.ec2.internal","openshift-dns/node-resolver-l4m47","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal","openshift-multus/multus-7dw9d","openshift-multus/multus-additional-cni-plugins-jd9tr","openshift-multus/network-metrics-daemon-xvhcc","openshift-network-diagnostics/network-check-target-lfnb9"]
Jul 22 03:33:45.205607 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.205578    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.207917 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.207891    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:45.208109 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.207979    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:33:45.208727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.208706    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 03:33:45.208831 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.208758    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 03:33:45.209006 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.208984    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 03:33:45.209114 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.209020    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4487q\""
Jul 22 03:33:45.209183 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.209168    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 03:33:45.210022 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.209998    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 03:33:45.210205 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.210184    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 03:33:45.211550 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.211527    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.212553 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.212529    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:45.212636 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.212601    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:33:45.213830 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.213808    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f77c8"
Jul 22 03:33:45.214014 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.213993    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-pnz6k\""
Jul 22 03:33:45.214190 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.214169    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:33:45.214265 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.213999    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 03:33:45.215418 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.215397    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.216426 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.216408    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 03:33:45.216556 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.216536    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 03:33:45.216932 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.216911    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rg47r\""
Jul 22 03:33:45.217035 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.216949    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:33:45.217121 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.217103    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p47hl"
Jul 22 03:33:45.217579 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.217559    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 03:33:45.218030 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.218008    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 03:33:45.218224 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.218195    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 03:33:45.218224 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.218213    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7wdj7\""
Jul 22 03:33:45.218499 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.218482    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 03:33:45.219160 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.219139    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 03:33:45.219313 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.219145    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 03:33:45.219862 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.219838    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l4m47"
Jul 22 03:33:45.220594 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.220570    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 03:33:45.220796 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.220583    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4b8zd\""
Jul 22 03:33:45.220933 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.220916    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 03:33:45.221630 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.221610    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.222589 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222553    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-tuned\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.222589 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222589    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73518916-302e-4207-b0b7-1b0f02a64824-os-release\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.222772 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222620    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73518916-302e-4207-b0b7-1b0f02a64824-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.222772 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222641    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-kubernetes\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.222772 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222675    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 03:33:45.222772 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222689    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-sysctl-conf\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.222772 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222707    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-run\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.222772 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222723    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-lib-modules\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.222772 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222739    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh9ws\" (UniqueName: \"kubernetes.io/projected/34e72f39-2477-4636-a7ad-1d4f6e652e27-kube-api-access-fh9ws\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.222772 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222767    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-sysconfig\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222787    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73518916-302e-4207-b0b7-1b0f02a64824-system-cni-dir\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222801    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73518916-302e-4207-b0b7-1b0f02a64824-cnibin\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222817    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73518916-302e-4207-b0b7-1b0f02a64824-cni-binary-copy\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222837    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73518916-302e-4207-b0b7-1b0f02a64824-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222856    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfzs9\" (UniqueName: \"kubernetes.io/projected/73518916-302e-4207-b0b7-1b0f02a64824-kube-api-access-bfzs9\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222880    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73518916-302e-4207-b0b7-1b0f02a64824-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222910    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p2pn\" (UniqueName: \"kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn\") pod \"network-check-target-lfnb9\" (UID: \"d31ce3ca-c9f6-4cb3-9742-8dacd3399892\") " pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222934    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-var-lib-kubelet\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222952    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-host\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222967    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34e72f39-2477-4636-a7ad-1d4f6e652e27-tmp\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.222989    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-modprobe-d\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.223006    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-sysctl-d\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.223012    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pfckn\""
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.223021    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-systemd\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.223035    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-sys\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.223306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.223204    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 03:33:45.224271 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.223472    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 03:33:45.224271 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.223673    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:45.224271 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.223761    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:33:45.224638 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.224616    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 03:33:45.225343 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.225021    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wsn7d\""
Jul 22 03:33:45.225343 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.225260    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8n7fw"
Jul 22 03:33:45.226432 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.226401    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.228022 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.227988    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 03:33:45.228403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.228379    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xbbs2\""
Jul 22 03:33:45.228599 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.228580    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 03:33:45.228695 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.228621    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 03:33:45.228695 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.228673    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 03:33:45.232147 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.229528    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 03:33:45.232147 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.229596    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-llztn\""
Jul 22 03:33:45.232147 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.229773    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 03:33:45.250413 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.250381    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v5tjb"
Jul 22 03:33:45.257551 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.257519    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v5tjb"
Jul 22 03:33:45.310356 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.310326    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 03:33:45.323605 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.323562    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-registration-dir\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.323825 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.323623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.323825 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.323663    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldfrc\" (UniqueName: \"kubernetes.io/projected/1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0-kube-api-access-ldfrc\") pod \"iptables-alerter-f77c8\" (UID: \"1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0\") " pod="openshift-network-operator/iptables-alerter-f77c8"
Jul 22 03:33:45.323825 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.323700    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p2pn\" (UniqueName: \"kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn\") pod \"network-check-target-lfnb9\" (UID: \"d31ce3ca-c9f6-4cb3-9742-8dacd3399892\") " pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:45.323825 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.323748    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-systemd-units\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.324084 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.323910    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/784a1926-484e-45c7-9559-6def8a0d6a49-konnectivity-ca\") pod \"konnectivity-agent-p47hl\" (UID: \"784a1926-484e-45c7-9559-6def8a0d6a49\") " pod="kube-system/konnectivity-agent-p47hl"
Jul 22 03:33:45.324084 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.323949    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-var-lib-cni-bin\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.324084 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.323980    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-etc-kubernetes\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.324084 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324010    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-device-dir\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.324084 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324054    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wshp\" (UniqueName: \"kubernetes.io/projected/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-kube-api-access-4wshp\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.324346 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324106    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-sys\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.324346 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324147    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-tuned\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.324346 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324175    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkmcq\" (UniqueName: \"kubernetes.io/projected/b085ef6e-6417-412e-9734-573ade70877b-kube-api-access-tkmcq\") pod \"node-ca-8n7fw\" (UID: \"b085ef6e-6417-412e-9734-573ade70877b\") " pod="openshift-image-registry/node-ca-8n7fw"
Jul 22 03:33:45.324346 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324220    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-ovn-node-metrics-cert\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.324346 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324250    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-sys\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.324346 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324285    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-multus-socket-dir-parent\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.324346 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324328    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-run-netns\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324357    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-socket-dir\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0-iptables-alerter-script\") pod \"iptables-alerter-f77c8\" (UID: \"1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0\") " pod="openshift-network-operator/iptables-alerter-f77c8"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324415    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-kubernetes\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324460    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-var-lib-openvswitch\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324486    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-kubernetes\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324487    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324498    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzr2n\" (UniqueName: \"kubernetes.io/projected/524d84af-a2bd-4e91-a863-26fef2bbb811-kube-api-access-hzr2n\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324523    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324547    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0-host-slash\") pod \"iptables-alerter-f77c8\" (UID: \"1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0\") " pod="openshift-network-operator/iptables-alerter-f77c8"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324568    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b085ef6e-6417-412e-9734-573ade70877b-serviceca\") pod \"node-ca-8n7fw\" (UID: \"b085ef6e-6417-412e-9734-573ade70877b\") " pod="openshift-image-registry/node-ca-8n7fw"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324594    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73518916-302e-4207-b0b7-1b0f02a64824-cnibin\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324617    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfzs9\" (UniqueName: \"kubernetes.io/projected/73518916-302e-4207-b0b7-1b0f02a64824-kube-api-access-bfzs9\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324642    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-slash\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.324687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324685    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10efa3fa-bde2-477d-bbe0-7e534e9c9adb-hosts-file\") pod \"node-resolver-l4m47\" (UID: \"10efa3fa-bde2-477d-bbe0-7e534e9c9adb\") " pod="openshift-dns/node-resolver-l4m47"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324713    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10efa3fa-bde2-477d-bbe0-7e534e9c9adb-tmp-dir\") pod \"node-resolver-l4m47\" (UID: \"10efa3fa-bde2-477d-bbe0-7e534e9c9adb\") " pod="openshift-dns/node-resolver-l4m47"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324738    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-system-cni-dir\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324766    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73518916-302e-4207-b0b7-1b0f02a64824-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324794    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjkhk\" (UniqueName: \"kubernetes.io/projected/8990e9a5-8145-4480-9127-d5c33c94f47b-kube-api-access-jjkhk\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324801    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73518916-302e-4207-b0b7-1b0f02a64824-cnibin\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324839    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-log-socket\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324873    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-cni-bin\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324912    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-cni-netd\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324935    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt9m8\" (UniqueName: \"kubernetes.io/projected/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-kube-api-access-bt9m8\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324957    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-os-release\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.324982    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-sysctl-d\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325007    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-ovnkube-script-lib\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325058    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-var-lib-kubelet\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325153    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-node-log\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325212    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/524d84af-a2bd-4e91-a863-26fef2bbb811-cni-binary-copy\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325223    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-sysctl-d\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.325403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325239    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-multus-conf-dir\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325269    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-sysconfig\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325307    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73518916-302e-4207-b0b7-1b0f02a64824-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325333    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-sysconfig\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325382    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73518916-302e-4207-b0b7-1b0f02a64824-system-cni-dir\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325408    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-run-openvswitch\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325435    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-multus-cni-dir\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325459    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-host\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325475    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73518916-302e-4207-b0b7-1b0f02a64824-system-cni-dir\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325482    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34e72f39-2477-4636-a7ad-1d4f6e652e27-tmp\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-etc-openvswitch\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325529    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-host\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325547    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-ovnkube-config\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325721    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb5c3237-38f9-4002-8191-c00c2918dc9a-kubelet-config\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325781    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-modprobe-d\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325813    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-systemd\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325836    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325859    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-var-lib-cni-multus\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325866    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-modprobe-d\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325879    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb5c3237-38f9-4002-8191-c00c2918dc9a-dbus\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325905    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73518916-302e-4207-b0b7-1b0f02a64824-os-release\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325939    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-systemd\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.325957    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-run\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326030    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73518916-302e-4207-b0b7-1b0f02a64824-os-release\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326073    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh9ws\" (UniqueName: \"kubernetes.io/projected/34e72f39-2477-4636-a7ad-1d4f6e652e27-kube-api-access-fh9ws\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326109    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-run\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326155    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326193    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326286    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/524d84af-a2bd-4e91-a863-26fef2bbb811-multus-daemon-config\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326322    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-var-lib-kubelet\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326380    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-hostroot\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326435    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-var-lib-kubelet\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326447    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-run-netns\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326487    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prbg2\" (UniqueName: \"kubernetes.io/projected/10efa3fa-bde2-477d-bbe0-7e534e9c9adb-kube-api-access-prbg2\") pod \"node-resolver-l4m47\" (UID: \"10efa3fa-bde2-477d-bbe0-7e534e9c9adb\") " pod="openshift-dns/node-resolver-l4m47"
Jul 22 03:33:45.327392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326521    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-cnibin\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326558    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-env-overrides\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-sys-fs\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326624    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326693    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73518916-302e-4207-b0b7-1b0f02a64824-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326724    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-sysctl-conf\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326749    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-lib-modules\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326773    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b085ef6e-6417-412e-9734-573ade70877b-host\") pod \"node-ca-8n7fw\" (UID: \"b085ef6e-6417-412e-9734-573ade70877b\") " pod="openshift-image-registry/node-ca-8n7fw"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326799    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-run-ovn\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326824    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/784a1926-484e-45c7-9559-6def8a0d6a49-agent-certs\") pod \"konnectivity-agent-p47hl\" (UID: \"784a1926-484e-45c7-9559-6def8a0d6a49\") " pod="kube-system/konnectivity-agent-p47hl"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326848    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-run-k8s-cni-cncf-io\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326873    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-run-multus-certs\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326901    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73518916-302e-4207-b0b7-1b0f02a64824-cni-binary-copy\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326941    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73518916-302e-4207-b0b7-1b0f02a64824-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326968    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-kubelet\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.326996    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-run-systemd\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.328326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.327192    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-sysctl-conf\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.328869 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.327202    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73518916-302e-4207-b0b7-1b0f02a64824-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.328869 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.327294    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34e72f39-2477-4636-a7ad-1d4f6e652e27-lib-modules\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.328869 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.327442    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73518916-302e-4207-b0b7-1b0f02a64824-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.328869 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.327694    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73518916-302e-4207-b0b7-1b0f02a64824-cni-binary-copy\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.328869 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.328480    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34e72f39-2477-4636-a7ad-1d4f6e652e27-etc-tuned\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.328869 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.328539    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34e72f39-2477-4636-a7ad-1d4f6e652e27-tmp\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.330261 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.330239    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:33:45.330261 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.330260    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:33:45.330418 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.330271    2569 projected.go:196] Error preparing data for projected volume kube-api-access-5p2pn for pod openshift-network-diagnostics/network-check-target-lfnb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:33:45.330418 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.330334    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn podName:d31ce3ca-c9f6-4cb3-9742-8dacd3399892 nodeName:}" failed. No retries permitted until 2026-07-22 03:33:45.830315729 +0000 UTC m=+2.997550372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5p2pn" (UniqueName: "kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn") pod "network-check-target-lfnb9" (UID: "d31ce3ca-c9f6-4cb3-9742-8dacd3399892") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:33:45.333264 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.333240    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfzs9\" (UniqueName: \"kubernetes.io/projected/73518916-302e-4207-b0b7-1b0f02a64824-kube-api-access-bfzs9\") pod \"multus-additional-cni-plugins-jd9tr\" (UID: \"73518916-302e-4207-b0b7-1b0f02a64824\") " pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.334624 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.334600    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh9ws\" (UniqueName: \"kubernetes.io/projected/34e72f39-2477-4636-a7ad-1d4f6e652e27-kube-api-access-fh9ws\") pod \"tuned-4kb8q\" (UID: \"34e72f39-2477-4636-a7ad-1d4f6e652e27\") " pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.345926 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.345896    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 03:33:45.427825 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.427777    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-etc-openvswitch\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.427825 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.427827    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-ovnkube-config\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.428093 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.427844    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb5c3237-38f9-4002-8191-c00c2918dc9a-kubelet-config\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:45.428093 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.427873    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.428093 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.427900    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-var-lib-cni-multus\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.428093 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.427909    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-etc-openvswitch\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.428093 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.427953    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/bb5c3237-38f9-4002-8191-c00c2918dc9a-kubelet-config\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:45.428093 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.427963    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.428093 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428023    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-var-lib-cni-multus\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.428093 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428059    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb5c3237-38f9-4002-8191-c00c2918dc9a-dbus\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:45.428093 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428090    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428118    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428164    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.428192    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/524d84af-a2bd-4e91-a863-26fef2bbb811-multus-daemon-config\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428249    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-hostroot\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428255    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/bb5c3237-38f9-4002-8191-c00c2918dc9a-dbus\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.428281    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs podName:8990e9a5-8145-4480-9127-d5c33c94f47b nodeName:}" failed. No retries permitted until 2026-07-22 03:33:45.928257858 +0000 UTC m=+3.095492888 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs") pod "network-metrics-daemon-xvhcc" (UID: "8990e9a5-8145-4480-9127-d5c33c94f47b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428295    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-hostroot\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428313    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-run-netns\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428379    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbg2\" (UniqueName: \"kubernetes.io/projected/10efa3fa-bde2-477d-bbe0-7e534e9c9adb-kube-api-access-prbg2\") pod \"node-resolver-l4m47\" (UID: \"10efa3fa-bde2-477d-bbe0-7e534e9c9adb\") " pod="openshift-dns/node-resolver-l4m47"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428402    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-run-netns\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428457    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-cnibin\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428407    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-cnibin\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428473    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-ovnkube-config\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.428482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-env-overrides\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428520    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-sys-fs\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428546    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428575    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b085ef6e-6417-412e-9734-573ade70877b-host\") pod \"node-ca-8n7fw\" (UID: \"b085ef6e-6417-412e-9734-573ade70877b\") " pod="openshift-image-registry/node-ca-8n7fw"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428620    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b085ef6e-6417-412e-9734-573ade70877b-host\") pod \"node-ca-8n7fw\" (UID: \"b085ef6e-6417-412e-9734-573ade70877b\") " pod="openshift-image-registry/node-ca-8n7fw"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428650    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-run-ovn\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428672    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-sys-fs\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428716    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-run-ovn\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428724    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/784a1926-484e-45c7-9559-6def8a0d6a49-agent-certs\") pod \"konnectivity-agent-p47hl\" (UID: \"784a1926-484e-45c7-9559-6def8a0d6a49\") " pod="kube-system/konnectivity-agent-p47hl"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-run-k8s-cni-cncf-io\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.428768    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428773    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-run-multus-certs\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428796    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-kubelet\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.428829    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret podName:bb5c3237-38f9-4002-8191-c00c2918dc9a nodeName:}" failed. No retries permitted until 2026-07-22 03:33:45.928811167 +0000 UTC m=+3.096045828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret") pod "global-pull-secret-syncer-8tsf5" (UID: "bb5c3237-38f9-4002-8191-c00c2918dc9a") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428840    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-run-k8s-cni-cncf-io\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428842    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-kubelet\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428850    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-run-systemd\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.429282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428874    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-run-multus-certs\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-registration-dir\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428908    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428912    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-run-systemd\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428935    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldfrc\" (UniqueName: \"kubernetes.io/projected/1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0-kube-api-access-ldfrc\") pod \"iptables-alerter-f77c8\" (UID: \"1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0\") " pod="openshift-network-operator/iptables-alerter-f77c8"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428969    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-registration-dir\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.428972    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-systemd-units\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429006    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/784a1926-484e-45c7-9559-6def8a0d6a49-konnectivity-ca\") pod \"konnectivity-agent-p47hl\" (UID: \"784a1926-484e-45c7-9559-6def8a0d6a49\") " pod="kube-system/konnectivity-agent-p47hl"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429031    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-var-lib-cni-bin\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429055    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-etc-kubernetes\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429060    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-env-overrides\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429077    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-etc-selinux\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429079    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-device-dir\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429063    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/524d84af-a2bd-4e91-a863-26fef2bbb811-multus-daemon-config\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429116    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-var-lib-cni-bin\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429119    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-etc-kubernetes\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429159    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-systemd-units\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.430148 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429181    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wshp\" (UniqueName: \"kubernetes.io/projected/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-kube-api-access-4wshp\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429205    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-device-dir\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429271    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmcq\" (UniqueName: \"kubernetes.io/projected/b085ef6e-6417-412e-9734-573ade70877b-kube-api-access-tkmcq\") pod \"node-ca-8n7fw\" (UID: \"b085ef6e-6417-412e-9734-573ade70877b\") " pod="openshift-image-registry/node-ca-8n7fw"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-ovn-node-metrics-cert\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429356    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-multus-socket-dir-parent\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429382    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-run-netns\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429410    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-socket-dir\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0-iptables-alerter-script\") pod \"iptables-alerter-f77c8\" (UID: \"1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0\") " pod="openshift-network-operator/iptables-alerter-f77c8"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-var-lib-openvswitch\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429471    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-run-netns\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429493    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzr2n\" (UniqueName: \"kubernetes.io/projected/524d84af-a2bd-4e91-a863-26fef2bbb811-kube-api-access-hzr2n\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429519    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429554    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0-host-slash\") pod \"iptables-alerter-f77c8\" (UID: \"1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0\") " pod="openshift-network-operator/iptables-alerter-f77c8"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429578    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b085ef6e-6417-412e-9734-573ade70877b-serviceca\") pod \"node-ca-8n7fw\" (UID: \"b085ef6e-6417-412e-9734-573ade70877b\") " pod="openshift-image-registry/node-ca-8n7fw"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429605    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-slash\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429630    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10efa3fa-bde2-477d-bbe0-7e534e9c9adb-hosts-file\") pod \"node-resolver-l4m47\" (UID: \"10efa3fa-bde2-477d-bbe0-7e534e9c9adb\") " pod="openshift-dns/node-resolver-l4m47"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429639    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-socket-dir\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.430999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429646    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/784a1926-484e-45c7-9559-6def8a0d6a49-konnectivity-ca\") pod \"konnectivity-agent-p47hl\" (UID: \"784a1926-484e-45c7-9559-6def8a0d6a49\") " pod="kube-system/konnectivity-agent-p47hl"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429655    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10efa3fa-bde2-477d-bbe0-7e534e9c9adb-tmp-dir\") pod \"node-resolver-l4m47\" (UID: \"10efa3fa-bde2-477d-bbe0-7e534e9c9adb\") " pod="openshift-dns/node-resolver-l4m47"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429698    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-var-lib-openvswitch\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429528    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-multus-socket-dir-parent\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429714    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-system-cni-dir\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429746    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429752    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjkhk\" (UniqueName: \"kubernetes.io/projected/8990e9a5-8145-4480-9127-d5c33c94f47b-kube-api-access-jjkhk\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429770    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-system-cni-dir\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429780    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-log-socket\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429800    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-slash\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429808    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-cni-bin\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429823    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/10efa3fa-bde2-477d-bbe0-7e534e9c9adb-hosts-file\") pod \"node-resolver-l4m47\" (UID: \"10efa3fa-bde2-477d-bbe0-7e534e9c9adb\") " pod="openshift-dns/node-resolver-l4m47"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429833    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-cni-netd\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429846    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0-host-slash\") pod \"iptables-alerter-f77c8\" (UID: \"1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0\") " pod="openshift-network-operator/iptables-alerter-f77c8"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429858    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt9m8\" (UniqueName: \"kubernetes.io/projected/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-kube-api-access-bt9m8\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429882    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-os-release\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-ovnkube-script-lib\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429933    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-var-lib-kubelet\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.431655 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429959    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-node-log\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.429982    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/524d84af-a2bd-4e91-a863-26fef2bbb811-cni-binary-copy\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430012    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-multus-conf-dir\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430044    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-run-openvswitch\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430071    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-multus-cni-dir\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430124    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/10efa3fa-bde2-477d-bbe0-7e534e9c9adb-tmp-dir\") pod \"node-resolver-l4m47\" (UID: \"10efa3fa-bde2-477d-bbe0-7e534e9c9adb\") " pod="openshift-dns/node-resolver-l4m47"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430169    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-multus-cni-dir\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430174    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-log-socket\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430228    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-cni-netd\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430244    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b085ef6e-6417-412e-9734-573ade70877b-serviceca\") pod \"node-ca-8n7fw\" (UID: \"b085ef6e-6417-412e-9734-573ade70877b\") " pod="openshift-image-registry/node-ca-8n7fw"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430235    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-os-release\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430285    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0-iptables-alerter-script\") pod \"iptables-alerter-f77c8\" (UID: \"1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0\") " pod="openshift-network-operator/iptables-alerter-f77c8"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430307    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-host-var-lib-kubelet\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430348    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-run-openvswitch\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430364    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/524d84af-a2bd-4e91-a863-26fef2bbb811-multus-conf-dir\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430374    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-host-cni-bin\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430412    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-node-log\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430821    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-ovnkube-script-lib\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.432338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.430826    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/524d84af-a2bd-4e91-a863-26fef2bbb811-cni-binary-copy\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.432964 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.431809    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/784a1926-484e-45c7-9559-6def8a0d6a49-agent-certs\") pod \"konnectivity-agent-p47hl\" (UID: \"784a1926-484e-45c7-9559-6def8a0d6a49\") " pod="kube-system/konnectivity-agent-p47hl"
Jul 22 03:33:45.433010 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.432970    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-ovn-node-metrics-cert\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.439412 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.439115    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prbg2\" (UniqueName: \"kubernetes.io/projected/10efa3fa-bde2-477d-bbe0-7e534e9c9adb-kube-api-access-prbg2\") pod \"node-resolver-l4m47\" (UID: \"10efa3fa-bde2-477d-bbe0-7e534e9c9adb\") " pod="openshift-dns/node-resolver-l4m47"
Jul 22 03:33:45.439621 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.439592    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldfrc\" (UniqueName: \"kubernetes.io/projected/1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0-kube-api-access-ldfrc\") pod \"iptables-alerter-f77c8\" (UID: \"1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0\") " pod="openshift-network-operator/iptables-alerter-f77c8"
Jul 22 03:33:45.439776 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.439627    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wshp\" (UniqueName: \"kubernetes.io/projected/6519f72d-2066-4c42-91a9-2f3b5da9cc6b-kube-api-access-4wshp\") pod \"aws-ebs-csi-driver-node-wvnvb\" (UID: \"6519f72d-2066-4c42-91a9-2f3b5da9cc6b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.440377 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.440351    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzr2n\" (UniqueName: \"kubernetes.io/projected/524d84af-a2bd-4e91-a863-26fef2bbb811-kube-api-access-hzr2n\") pod \"multus-7dw9d\" (UID: \"524d84af-a2bd-4e91-a863-26fef2bbb811\") " pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.442050 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.442028    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkmcq\" (UniqueName: \"kubernetes.io/projected/b085ef6e-6417-412e-9734-573ade70877b-kube-api-access-tkmcq\") pod \"node-ca-8n7fw\" (UID: \"b085ef6e-6417-412e-9734-573ade70877b\") " pod="openshift-image-registry/node-ca-8n7fw"
Jul 22 03:33:45.442662 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.442640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjkhk\" (UniqueName: \"kubernetes.io/projected/8990e9a5-8145-4480-9127-d5c33c94f47b-kube-api-access-jjkhk\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:45.444539 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.444516    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt9m8\" (UniqueName: \"kubernetes.io/projected/b6a871af-bb2c-4be3-80eb-b1730e9d37ba-kube-api-access-bt9m8\") pod \"ovnkube-node-lhcg8\" (UID: \"b6a871af-bb2c-4be3-80eb-b1730e9d37ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.519244 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.519206    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jd9tr"
Jul 22 03:33:45.538015 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.537978    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4kb8q"
Jul 22 03:33:45.553443 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.553409    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f77c8"
Jul 22 03:33:45.558881 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.558847    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:33:45.568916 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.568889    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p47hl"
Jul 22 03:33:45.577168 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.577144    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l4m47"
Jul 22 03:33:45.585365 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.585340    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7dw9d"
Jul 22 03:33:45.593425 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.593398    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8n7fw"
Jul 22 03:33:45.601561 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.601532    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb"
Jul 22 03:33:45.833820 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.833724    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p2pn\" (UniqueName: \"kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn\") pod \"network-check-target-lfnb9\" (UID: \"d31ce3ca-c9f6-4cb3-9742-8dacd3399892\") " pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:45.833976 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.833955    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:33:45.834044 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.833984    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:33:45.834044 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.833994    2569 projected.go:196] Error preparing data for projected volume kube-api-access-5p2pn for pod openshift-network-diagnostics/network-check-target-lfnb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:33:45.834118 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.834073    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn podName:d31ce3ca-c9f6-4cb3-9742-8dacd3399892 nodeName:}" failed. No retries permitted until 2026-07-22 03:33:46.834054809 +0000 UTC m=+4.001289474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p2pn" (UniqueName: "kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn") pod "network-check-target-lfnb9" (UID: "d31ce3ca-c9f6-4cb3-9742-8dacd3399892") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:33:45.934846 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.934799    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:45.935032 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:45.934882    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:45.935032 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.934998    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:33:45.935032 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.934998    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:33:45.935187 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.935071    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs podName:8990e9a5-8145-4480-9127-d5c33c94f47b nodeName:}" failed. No retries permitted until 2026-07-22 03:33:46.935053717 +0000 UTC m=+4.102288382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs") pod "network-metrics-daemon-xvhcc" (UID: "8990e9a5-8145-4480-9127-d5c33c94f47b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:33:45.935187 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:45.935092    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret podName:bb5c3237-38f9-4002-8191-c00c2918dc9a nodeName:}" failed. No retries permitted until 2026-07-22 03:33:46.935080751 +0000 UTC m=+4.102315394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret") pod "global-pull-secret-syncer-8tsf5" (UID: "bb5c3237-38f9-4002-8191-c00c2918dc9a") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:33:46.260088 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:46.259985    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 03:28:45 +0000 UTC" deadline="2028-05-01 01:31:25.769445242 +0000 UTC"
Jul 22 03:33:46.260088 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:46.260029    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15573h57m39.509420883s"
Jul 22 03:33:46.366959 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:46.366915    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod524d84af_a2bd_4e91_a863_26fef2bbb811.slice/crio-99834ad05140a0857ad57e25d276a9df789504267d94d5e76eb6f550b70c9046 WatchSource:0}: Error finding container 99834ad05140a0857ad57e25d276a9df789504267d94d5e76eb6f550b70c9046: Status 404 returned error can't find the container with id 99834ad05140a0857ad57e25d276a9df789504267d94d5e76eb6f550b70c9046
Jul 22 03:33:46.371743 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:46.371675    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73518916_302e_4207_b0b7_1b0f02a64824.slice/crio-b7239f5191f88a0980c326d7e2d0811173dd6dbca3f1c7d9f53456f9d6072e38 WatchSource:0}: Error finding container b7239f5191f88a0980c326d7e2d0811173dd6dbca3f1c7d9f53456f9d6072e38: Status 404 returned error can't find the container with id b7239f5191f88a0980c326d7e2d0811173dd6dbca3f1c7d9f53456f9d6072e38
Jul 22 03:33:46.371840 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:46.371793    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:46.371935 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:46.371919    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:33:46.374422 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:46.374396    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e72f39_2477_4636_a7ad_1d4f6e652e27.slice/crio-0a96315a28b06a70f0723446c434daa93661c13c9e776bf0421976d80250233d WatchSource:0}: Error finding container 0a96315a28b06a70f0723446c434daa93661c13c9e776bf0421976d80250233d: Status 404 returned error can't find the container with id 0a96315a28b06a70f0723446c434daa93661c13c9e776bf0421976d80250233d
Jul 22 03:33:46.375956 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:46.375928    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10efa3fa_bde2_477d_bbe0_7e534e9c9adb.slice/crio-3521b3cab206b05ae7d0229c283a695e6b35ae32cf0bb8c92096327f70fd1e3e WatchSource:0}: Error finding container 3521b3cab206b05ae7d0229c283a695e6b35ae32cf0bb8c92096327f70fd1e3e: Status 404 returned error can't find the container with id 3521b3cab206b05ae7d0229c283a695e6b35ae32cf0bb8c92096327f70fd1e3e
Jul 22 03:33:46.376156 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:46.376125    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e63ac7d_2fc2_4ec7_8a1d_8f49dd3e6ff0.slice/crio-728e77f766b8e9f326c7493131b3477f4fcf1334dadd54a91eb9ecac8e64ab25 WatchSource:0}: Error finding container 728e77f766b8e9f326c7493131b3477f4fcf1334dadd54a91eb9ecac8e64ab25: Status 404 returned error can't find the container with id 728e77f766b8e9f326c7493131b3477f4fcf1334dadd54a91eb9ecac8e64ab25
Jul 22 03:33:46.377990 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:46.377964    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb085ef6e_6417_412e_9734_573ade70877b.slice/crio-15455a78e9de904088826c5691017980d5dd2b889edefee712df08ec1f526928 WatchSource:0}: Error finding container 15455a78e9de904088826c5691017980d5dd2b889edefee712df08ec1f526928: Status 404 returned error can't find the container with id 15455a78e9de904088826c5691017980d5dd2b889edefee712df08ec1f526928
Jul 22 03:33:46.378834 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:46.378809    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6519f72d_2066_4c42_91a9_2f3b5da9cc6b.slice/crio-662d85c7872c448eaf9e40e0a5b586ec97e77da21f8800eff7585d09911b8d51 WatchSource:0}: Error finding container 662d85c7872c448eaf9e40e0a5b586ec97e77da21f8800eff7585d09911b8d51: Status 404 returned error can't find the container with id 662d85c7872c448eaf9e40e0a5b586ec97e77da21f8800eff7585d09911b8d51
Jul 22 03:33:46.380608 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:33:46.380582    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod784a1926_484e_45c7_9559_6def8a0d6a49.slice/crio-e61a31f1fd58b5731950a1c42150d8f958b2a91452c2930a9eab5dfc80cf087d WatchSource:0}: Error finding container e61a31f1fd58b5731950a1c42150d8f958b2a91452c2930a9eab5dfc80cf087d: Status 404 returned error can't find the container with id e61a31f1fd58b5731950a1c42150d8f958b2a91452c2930a9eab5dfc80cf087d
Jul 22 03:33:46.382077 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:46.382027    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7dw9d" event={"ID":"524d84af-a2bd-4e91-a863-26fef2bbb811","Type":"ContainerStarted","Data":"99834ad05140a0857ad57e25d276a9df789504267d94d5e76eb6f550b70c9046"}
Jul 22 03:33:46.383845 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:46.383811    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f77c8" event={"ID":"1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0","Type":"ContainerStarted","Data":"728e77f766b8e9f326c7493131b3477f4fcf1334dadd54a91eb9ecac8e64ab25"}
Jul 22 03:33:46.386092 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:46.386062    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l4m47" event={"ID":"10efa3fa-bde2-477d-bbe0-7e534e9c9adb","Type":"ContainerStarted","Data":"3521b3cab206b05ae7d0229c283a695e6b35ae32cf0bb8c92096327f70fd1e3e"}
Jul 22 03:33:46.387516 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:46.387486    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4kb8q" event={"ID":"34e72f39-2477-4636-a7ad-1d4f6e652e27","Type":"ContainerStarted","Data":"0a96315a28b06a70f0723446c434daa93661c13c9e776bf0421976d80250233d"}
Jul 22 03:33:46.389620 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:46.389590    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jd9tr" event={"ID":"73518916-302e-4207-b0b7-1b0f02a64824","Type":"ContainerStarted","Data":"b7239f5191f88a0980c326d7e2d0811173dd6dbca3f1c7d9f53456f9d6072e38"}
Jul 22 03:33:46.391373 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:46.391329    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8" event={"ID":"b6a871af-bb2c-4be3-80eb-b1730e9d37ba","Type":"ContainerStarted","Data":"7ef662a2786672b4043607698af5577adbe8d4b15535d350c6dac43fd0d314f7"}
Jul 22 03:33:46.847202 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:46.846849    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p2pn\" (UniqueName: \"kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn\") pod \"network-check-target-lfnb9\" (UID: \"d31ce3ca-c9f6-4cb3-9742-8dacd3399892\") " pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:46.847399 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:46.847375    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:33:46.847474 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:46.847406    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:33:46.847474 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:46.847420    2569 projected.go:196] Error preparing data for projected volume kube-api-access-5p2pn for pod openshift-network-diagnostics/network-check-target-lfnb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:33:46.847579 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:46.847489    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn podName:d31ce3ca-c9f6-4cb3-9742-8dacd3399892 nodeName:}" failed. No retries permitted until 2026-07-22 03:33:48.847467301 +0000 UTC m=+6.014701951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p2pn" (UniqueName: "kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn") pod "network-check-target-lfnb9" (UID: "d31ce3ca-c9f6-4cb3-9742-8dacd3399892") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:33:46.948042 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:46.947994    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:46.948242 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:46.948066    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:46.948306 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:46.948266    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:33:46.948367 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:46.948339    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret podName:bb5c3237-38f9-4002-8191-c00c2918dc9a nodeName:}" failed. No retries permitted until 2026-07-22 03:33:48.948316803 +0000 UTC m=+6.115551473 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret") pod "global-pull-secret-syncer-8tsf5" (UID: "bb5c3237-38f9-4002-8191-c00c2918dc9a") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:33:46.948444 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:46.948410    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:33:46.948497 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:46.948450    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs podName:8990e9a5-8145-4480-9127-d5c33c94f47b nodeName:}" failed. No retries permitted until 2026-07-22 03:33:48.948436976 +0000 UTC m=+6.115671622 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs") pod "network-metrics-daemon-xvhcc" (UID: "8990e9a5-8145-4480-9127-d5c33c94f47b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:33:47.260599 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:47.260469    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 03:28:45 +0000 UTC" deadline="2028-03-22 13:17:27.696652758 +0000 UTC"
Jul 22 03:33:47.260599 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:47.260543    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14625h43m40.436115099s"
Jul 22 03:33:47.374877 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:47.373972    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:47.374877 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:47.374186    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:33:47.374877 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:47.374694    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:47.374877 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:47.374825    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:33:47.400527 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:47.400481    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p47hl" event={"ID":"784a1926-484e-45c7-9559-6def8a0d6a49","Type":"ContainerStarted","Data":"e61a31f1fd58b5731950a1c42150d8f958b2a91452c2930a9eab5dfc80cf087d"}
Jul 22 03:33:47.408568 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:47.408219    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8n7fw" event={"ID":"b085ef6e-6417-412e-9734-573ade70877b","Type":"ContainerStarted","Data":"15455a78e9de904088826c5691017980d5dd2b889edefee712df08ec1f526928"}
Jul 22 03:33:47.413942 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:47.413840    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb" event={"ID":"6519f72d-2066-4c42-91a9-2f3b5da9cc6b","Type":"ContainerStarted","Data":"662d85c7872c448eaf9e40e0a5b586ec97e77da21f8800eff7585d09911b8d51"}
Jul 22 03:33:47.427341 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:47.427087    2569 generic.go:356] "Generic (PLEG): container finished" podID="46c62c91158651b8c162424cb4d731b1" containerID="bd8122d61218323803718086c029b8a7c0d3f8b311390eee4785b0e76b385d41" exitCode=0
Jul 22 03:33:47.427341 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:47.427197    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal" event={"ID":"46c62c91158651b8c162424cb4d731b1","Type":"ContainerDied","Data":"bd8122d61218323803718086c029b8a7c0d3f8b311390eee4785b0e76b385d41"}
Jul 22 03:33:47.442796 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:47.442621    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-88.ec2.internal" event={"ID":"e36264e631cd609e30a4368a2627c6d6","Type":"ContainerStarted","Data":"49f485fd64efdcd34e61832ed66ecf802d510287d690b0157da3a2febdae3977"}
Jul 22 03:33:48.372209 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:48.372166    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:48.372906 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:48.372312    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:33:48.454822 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:48.454783    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal" event={"ID":"46c62c91158651b8c162424cb4d731b1","Type":"ContainerStarted","Data":"e2a03b71ceb480c666ee74b2a9e9f96b71d117de8f61ba84bb66ad1432219713"}
Jul 22 03:33:48.473522 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:48.473449    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-88.ec2.internal" podStartSLOduration=3.473425011 podStartE2EDuration="3.473425011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:33:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:33:47.460019502 +0000 UTC m=+4.627254172" watchObservedRunningTime="2026-07-22 03:33:48.473425011 +0000 UTC m=+5.640659681"
Jul 22 03:33:48.473818 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:48.473634    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-88.ec2.internal" podStartSLOduration=3.473622991 podStartE2EDuration="3.473622991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:33:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:33:48.473309594 +0000 UTC m=+5.640544262" watchObservedRunningTime="2026-07-22 03:33:48.473622991 +0000 UTC m=+5.640857660"
Jul 22 03:33:48.865989 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:48.865052    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p2pn\" (UniqueName: \"kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn\") pod \"network-check-target-lfnb9\" (UID: \"d31ce3ca-c9f6-4cb3-9742-8dacd3399892\") " pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:48.865989 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:48.865316    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:33:48.865989 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:48.865338    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:33:48.865989 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:48.865352    2569 projected.go:196] Error preparing data for projected volume kube-api-access-5p2pn for pod openshift-network-diagnostics/network-check-target-lfnb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:33:48.865989 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:48.865416    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn podName:d31ce3ca-c9f6-4cb3-9742-8dacd3399892 nodeName:}" failed. No retries permitted until 2026-07-22 03:33:52.865396298 +0000 UTC m=+10.032630942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p2pn" (UniqueName: "kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn") pod "network-check-target-lfnb9" (UID: "d31ce3ca-c9f6-4cb3-9742-8dacd3399892") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:33:48.967269 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:48.966487    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:48.967269 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:48.966555    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:48.967269 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:48.966698    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:33:48.967269 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:48.966783    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret podName:bb5c3237-38f9-4002-8191-c00c2918dc9a nodeName:}" failed. No retries permitted until 2026-07-22 03:33:52.966762794 +0000 UTC m=+10.133997441 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret") pod "global-pull-secret-syncer-8tsf5" (UID: "bb5c3237-38f9-4002-8191-c00c2918dc9a") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:33:48.967269 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:48.966855    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:33:48.967269 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:48.966890    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs podName:8990e9a5-8145-4480-9127-d5c33c94f47b nodeName:}" failed. No retries permitted until 2026-07-22 03:33:52.966877389 +0000 UTC m=+10.134112050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs") pod "network-metrics-daemon-xvhcc" (UID: "8990e9a5-8145-4480-9127-d5c33c94f47b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:33:49.373373 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:49.372767    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:49.373373 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:49.372923    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:33:49.375656 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:49.374058    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:49.375656 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:49.374187    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:33:50.372163 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:50.372113    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:50.372376 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:50.372262    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:33:51.374338 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:51.373820    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:51.374338 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:51.373968    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:33:51.374881 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:51.374601    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:51.374881 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:51.374733    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:33:52.372455 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:52.372419    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:52.372844 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:52.372782    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:33:52.900206 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:52.900165    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p2pn\" (UniqueName: \"kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn\") pod \"network-check-target-lfnb9\" (UID: \"d31ce3ca-c9f6-4cb3-9742-8dacd3399892\") " pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:52.900730 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:52.900377    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:33:52.900730 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:52.900396    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:33:52.900730 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:52.900410    2569 projected.go:196] Error preparing data for projected volume kube-api-access-5p2pn for pod openshift-network-diagnostics/network-check-target-lfnb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:33:52.900730 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:52.900472    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn podName:d31ce3ca-c9f6-4cb3-9742-8dacd3399892 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:00.90045204 +0000 UTC m=+18.067686699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p2pn" (UniqueName: "kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn") pod "network-check-target-lfnb9" (UID: "d31ce3ca-c9f6-4cb3-9742-8dacd3399892") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:33:53.002226 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:53.001443    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:53.002226 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:53.001545    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:53.002226 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:53.001676    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:33:53.002226 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:53.001743    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs podName:8990e9a5-8145-4480-9127-d5c33c94f47b nodeName:}" failed. No retries permitted until 2026-07-22 03:34:01.001722407 +0000 UTC m=+18.168957067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs") pod "network-metrics-daemon-xvhcc" (UID: "8990e9a5-8145-4480-9127-d5c33c94f47b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:33:53.002226 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:53.002137    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:33:53.002226 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:53.002187    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret podName:bb5c3237-38f9-4002-8191-c00c2918dc9a nodeName:}" failed. No retries permitted until 2026-07-22 03:34:01.002171092 +0000 UTC m=+18.169405772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret") pod "global-pull-secret-syncer-8tsf5" (UID: "bb5c3237-38f9-4002-8191-c00c2918dc9a") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:33:53.373913 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:53.373831    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:53.374081 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:53.373834    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:53.374081 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:53.373980    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:33:53.374155 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:53.374080    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:33:54.372839 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:54.372804    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:54.373246 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:54.372933    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:33:55.372834 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:55.372755    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:55.372985 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:55.372869    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:33:55.373317 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:55.373276    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:55.373401 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:55.373365    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:33:56.372745 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:56.372712    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:56.372911 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:56.372840    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:33:57.372173 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:57.372140    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:57.372635 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:57.372140    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:57.372635 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:57.372299    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:33:57.372635 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:57.372324    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:33:58.372631 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:58.372535    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:33:58.373110 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:58.372673    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:33:59.372791 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:59.372756    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:33:59.373181 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:59.372878    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:33:59.373181 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:33:59.372944    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:33:59.373181 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:33:59.373041    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:34:00.372087 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:00.372054    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:00.372342 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:00.372176    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:34:00.963548 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:00.963506    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p2pn\" (UniqueName: \"kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn\") pod \"network-check-target-lfnb9\" (UID: \"d31ce3ca-c9f6-4cb3-9742-8dacd3399892\") " pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:00.964078 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:00.963687    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:34:00.964078 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:00.963712    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:34:00.964078 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:00.963726    2569 projected.go:196] Error preparing data for projected volume kube-api-access-5p2pn for pod openshift-network-diagnostics/network-check-target-lfnb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:34:00.964078 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:00.963797    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn podName:d31ce3ca-c9f6-4cb3-9742-8dacd3399892 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:16.96377821 +0000 UTC m=+34.131012871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p2pn" (UniqueName: "kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn") pod "network-check-target-lfnb9" (UID: "d31ce3ca-c9f6-4cb3-9742-8dacd3399892") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:34:01.064099 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:01.064064    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:01.064278 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:01.064145    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:01.064278 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:01.064228    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:34:01.064405 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:01.064302    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret podName:bb5c3237-38f9-4002-8191-c00c2918dc9a nodeName:}" failed. No retries permitted until 2026-07-22 03:34:17.064283059 +0000 UTC m=+34.231517713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret") pod "global-pull-secret-syncer-8tsf5" (UID: "bb5c3237-38f9-4002-8191-c00c2918dc9a") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:34:01.064405 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:01.064232    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:34:01.064405 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:01.064383    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs podName:8990e9a5-8145-4480-9127-d5c33c94f47b nodeName:}" failed. No retries permitted until 2026-07-22 03:34:17.064366823 +0000 UTC m=+34.231601466 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs") pod "network-metrics-daemon-xvhcc" (UID: "8990e9a5-8145-4480-9127-d5c33c94f47b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:34:01.372145 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:01.372065    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:01.372299 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:01.372255    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:34:01.372375 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:01.372299    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:01.372436 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:01.372395    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:34:02.372079 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:02.372037    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:02.372523 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:02.372454    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:34:03.373547 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:03.373071    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:03.373547 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:03.373183    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:34:03.373547 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:03.373225    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:03.373547 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:03.373341    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:34:04.372847 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:04.372809    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:04.373024 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:04.372925    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:34:05.372633 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:05.372595    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:05.373198 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:05.372595    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:05.373198 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:05.372772    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:34:05.373336 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:05.373267    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:34:06.372553 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.372258    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:06.372672 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:06.372632    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:34:06.493624 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.493599    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8" event={"ID":"b6a871af-bb2c-4be3-80eb-b1730e9d37ba","Type":"ContainerStarted","Data":"6b69ad511fc562f2eece5cf7bf83912ebc477d71a930ebb232e7a667fa3454d0"}
Jul 22 03:34:06.493768 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.493725    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8" event={"ID":"b6a871af-bb2c-4be3-80eb-b1730e9d37ba","Type":"ContainerStarted","Data":"a76500d14f7222f807de1f747f44f983dc46da0e3eef030dae2f911eb1949596"}
Jul 22 03:34:06.493825 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.493775    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8" event={"ID":"b6a871af-bb2c-4be3-80eb-b1730e9d37ba","Type":"ContainerStarted","Data":"010106d7adc3aa53b62f3c8c17517a213a456c4a6c6a45738236fc2b3f293274"}
Jul 22 03:34:06.493825 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.493821    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8" event={"ID":"b6a871af-bb2c-4be3-80eb-b1730e9d37ba","Type":"ContainerStarted","Data":"6bccb6896aa83676bf24169678879e70added149a8dcba5be6f46aa74e5d76da"}
Jul 22 03:34:06.495087 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.495061    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7dw9d" event={"ID":"524d84af-a2bd-4e91-a863-26fef2bbb811","Type":"ContainerStarted","Data":"117b0059d490317dc83b584bcc734f06db850bcb77adae1e2a4a84c8bad234c4"}
Jul 22 03:34:06.496481 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.496458    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p47hl" event={"ID":"784a1926-484e-45c7-9559-6def8a0d6a49","Type":"ContainerStarted","Data":"06ccd49810416b26c5540c4200f0c56c21dee540059e38a99dc7882373fdf121"}
Jul 22 03:34:06.497907 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.497880    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8n7fw" event={"ID":"b085ef6e-6417-412e-9734-573ade70877b","Type":"ContainerStarted","Data":"b53f90795902cf05f392a04efc7bfd32e9d103e1e9d150c9b8be4c320a59cfd0"}
Jul 22 03:34:06.499557 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.499258    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l4m47" event={"ID":"10efa3fa-bde2-477d-bbe0-7e534e9c9adb","Type":"ContainerStarted","Data":"74fbe32b4f2e223af217e33e70f86ce91ce0594ecc78bc688975d9ff00a732a0"}
Jul 22 03:34:06.500509 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.500488    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4kb8q" event={"ID":"34e72f39-2477-4636-a7ad-1d4f6e652e27","Type":"ContainerStarted","Data":"16eed6e03a336e8c17ae43212b05b13411dc25f99c10257aa272a312153c6687"}
Jul 22 03:34:06.501999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.501977    2569 generic.go:356] "Generic (PLEG): container finished" podID="73518916-302e-4207-b0b7-1b0f02a64824" containerID="3d8deb0cf02a1ba088dbfc334f88660f9ec410d11dce22c04e91fd8f1a8d0dce" exitCode=0
Jul 22 03:34:06.502079 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.502057    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jd9tr" event={"ID":"73518916-302e-4207-b0b7-1b0f02a64824","Type":"ContainerDied","Data":"3d8deb0cf02a1ba088dbfc334f88660f9ec410d11dce22c04e91fd8f1a8d0dce"}
Jul 22 03:34:06.503838 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.503814    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb" event={"ID":"6519f72d-2066-4c42-91a9-2f3b5da9cc6b","Type":"ContainerStarted","Data":"6308b4328777394707252bcdc5166225226edf9825e7254a686df15bfe90effc"}
Jul 22 03:34:06.528305 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.528265    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7dw9d" podStartSLOduration=2.880978336 podStartE2EDuration="22.528245243s" totalImagesPullingTime="19.647266907s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:06.513891072 +0000 UTC m=+23.681125735" watchObservedRunningTime="2026-07-22 03:34:06.528245243 +0000 UTC m=+23.695479906"
Jul 22 03:34:06.528689 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.528661    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8n7fw" podStartSLOduration=2.949355862 podStartE2EDuration="22.528632586s" totalImagesPullingTime="19.579276724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:06.528005789 +0000 UTC m=+23.695240474" watchObservedRunningTime="2026-07-22 03:34:06.528632586 +0000 UTC m=+23.695867248"
Jul 22 03:34:06.572739 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.572698    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4kb8q" podStartSLOduration=3.987976769 podStartE2EDuration="23.572682872s" totalImagesPullingTime="19.584706103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:06.572463914 +0000 UTC m=+23.739698578" watchObservedRunningTime="2026-07-22 03:34:06.572682872 +0000 UTC m=+23.739917537"
Jul 22 03:34:06.610268 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.610215    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p47hl" podStartSLOduration=6.765163225 podStartE2EDuration="22.610199428s" totalImagesPullingTime="15.845036203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:06.588854635 +0000 UTC m=+23.756089300" watchObservedRunningTime="2026-07-22 03:34:06.610199428 +0000 UTC m=+23.777434092"
Jul 22 03:34:06.610434 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:06.610334    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l4m47" podStartSLOduration=3.0208192719999998 podStartE2EDuration="22.610326508s" totalImagesPullingTime="19.589507236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:06.609706371 +0000 UTC m=+23.776941049" watchObservedRunningTime="2026-07-22 03:34:06.610326508 +0000 UTC m=+23.777561173"
Jul 22 03:34:07.372864 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:07.372834    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:07.373287 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:07.373000    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:34:07.373287 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:07.373021    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:07.373287 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:07.373107    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:34:07.394220 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:07.394193    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 03:34:07.507681 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:07.507619    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f77c8" event={"ID":"1e63ac7d-2fc2-4ec7-8a1d-8f49dd3e6ff0","Type":"ContainerStarted","Data":"e0953cdd160f477354a2234e66c208f150355c0cf12987f5d32b1062035ef115"}
Jul 22 03:34:07.511344 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:07.511264    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8" event={"ID":"b6a871af-bb2c-4be3-80eb-b1730e9d37ba","Type":"ContainerStarted","Data":"4efede2afc461b5850af16f8ec14b47ae9102c10429029765b3385476b27f60a"}
Jul 22 03:34:07.511482 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:07.511355    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8" event={"ID":"b6a871af-bb2c-4be3-80eb-b1730e9d37ba","Type":"ContainerStarted","Data":"5078595f088a48ca4aa311d2efe7835ff1237106590df90d32a2ba1f2c69283d"}
Jul 22 03:34:07.513145 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:07.513115    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb" event={"ID":"6519f72d-2066-4c42-91a9-2f3b5da9cc6b","Type":"ContainerStarted","Data":"5c18ae9e0f6e97182bd60bdf608e075d5984bf6192356f388c7efa1c2b8e59ac"}
Jul 22 03:34:07.522369 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:07.522317    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f77c8" podStartSLOduration=4.941291559 podStartE2EDuration="24.522303308s" totalImagesPullingTime="19.581011749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:07.521988121 +0000 UTC m=+24.689222786" watchObservedRunningTime="2026-07-22 03:34:07.522303308 +0000 UTC m=+24.689537972"
Jul 22 03:34:07.675217 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:07.675129    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:07.760978 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:07.760937    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:08.281661 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:08.281545    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T03:34:07.39421058Z","UUID":"a80c0841-f560-47ff-b384-fa08580e2a7d","Handler":null,"Name":"","Endpoint":""}
Jul 22 03:34:08.283349 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:08.283328    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 03:34:08.283475 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:08.283373    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 03:34:08.372073 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:08.372042    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:08.372325 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:08.372179    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:34:09.372550 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:09.372514    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:09.373088 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:09.372514    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:09.373088 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:09.372630    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:34:09.373088 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:09.372707    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:34:09.521091 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:09.521050    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8" event={"ID":"b6a871af-bb2c-4be3-80eb-b1730e9d37ba","Type":"ContainerStarted","Data":"e874b327c1120e44a3ab5749c7f0d903ef2a2ac6c656a3dfb8ac4295689a08d5"}
Jul 22 03:34:09.523384 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:09.523345    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb" event={"ID":"6519f72d-2066-4c42-91a9-2f3b5da9cc6b","Type":"ContainerStarted","Data":"520b044784cb3ea953989dea46ab5110bb49cfea7a87ca409982bc1627833b27"}
Jul 22 03:34:09.543357 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:09.543297    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-wvnvb" podStartSLOduration=3.717166484 podStartE2EDuration="25.54328102s" totalImagesPullingTime="21.826114536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:33:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:09.542798215 +0000 UTC m=+26.710032907" watchObservedRunningTime="2026-07-22 03:34:09.54328102 +0000 UTC m=+26.710515684"
Jul 22 03:34:09.637321 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:09.637243    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p47hl"
Jul 22 03:34:09.638274 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:09.638137    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p47hl"
Jul 22 03:34:10.373019 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:10.372808    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:10.373419 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:10.373095    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:34:10.525606 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:10.525573    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p47hl"
Jul 22 03:34:10.526149 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:10.526132    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p47hl"
Jul 22 03:34:10.590659 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:10.590598    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:11.372367 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:11.372103    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:11.372529 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:11.372181    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:11.372529 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:11.372392    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:34:11.372529 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:11.372482    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:34:11.531510 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:11.531475    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8" event={"ID":"b6a871af-bb2c-4be3-80eb-b1730e9d37ba","Type":"ContainerStarted","Data":"750c59f6e92522a6cdee239c28b9a3fa7f6d1f94d00dfd2682c2c3723c452f3a"}
Jul 22 03:34:11.532286 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:11.531752    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:34:11.533424 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:11.533396    2569 generic.go:356] "Generic (PLEG): container finished" podID="73518916-302e-4207-b0b7-1b0f02a64824" containerID="3d23674a480cd1d9b250af8802f0c698b12771257c69d58345168db5dbfa4ad6" exitCode=0
Jul 22 03:34:11.533538 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:11.533470    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jd9tr" event={"ID":"73518916-302e-4207-b0b7-1b0f02a64824","Type":"ContainerDied","Data":"3d23674a480cd1d9b250af8802f0c698b12771257c69d58345168db5dbfa4ad6"}
Jul 22 03:34:11.549110 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:11.549083    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:34:11.561168 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:11.561120    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8" podStartSLOduration=8.90024759 podStartE2EDuration="28.561106001s" totalImagesPullingTime="19.660858411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:11.560571953 +0000 UTC m=+28.727806618" watchObservedRunningTime="2026-07-22 03:34:11.561106001 +0000 UTC m=+28.728340702"
Jul 22 03:34:12.077513 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:12.077478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:12.140146 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:12.140105    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:12.372124 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:12.372055    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:12.372275 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:12.372173    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:34:12.536113 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:12.536085    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:34:12.536557 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:12.536506    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:34:12.551825 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:12.551802    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:34:12.983630 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:12.983600    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lfnb9"]
Jul 22 03:34:12.983831 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:12.983724    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:12.983831 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:12.983805    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:34:12.986767 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:12.986741    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8tsf5"]
Jul 22 03:34:12.986911 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:12.986879    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:12.987032 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:12.987012    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:34:12.987360 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:12.987341    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xvhcc"]
Jul 22 03:34:12.987456 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:12.987443    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:12.987586 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:12.987548    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:34:13.480186 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:13.480144    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:13.539946 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:13.539916    2569 generic.go:356] "Generic (PLEG): container finished" podID="73518916-302e-4207-b0b7-1b0f02a64824" containerID="5f87ba92ba593d7388d039451e45a30b386b199e20630510ff961b453e485e7a" exitCode=0
Jul 22 03:34:13.540402 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:13.539999    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jd9tr" event={"ID":"73518916-302e-4207-b0b7-1b0f02a64824","Type":"ContainerDied","Data":"5f87ba92ba593d7388d039451e45a30b386b199e20630510ff961b453e485e7a"}
Jul 22 03:34:13.569331 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:13.569296    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:13.701787 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:13.701751    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:14.071110 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:14.071070    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:14.164312 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:14.164282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:14.225987 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:14.225756    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:14.372270 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:14.372195    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:14.372270 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:14.372240    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:14.372559 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:14.372314    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:34:14.372559 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:14.372498    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:34:15.372272 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:15.372242    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:15.372678 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:15.372362    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:34:15.488336 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:15.488295    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:15.548322 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:15.548287    2569 generic.go:356] "Generic (PLEG): container finished" podID="73518916-302e-4207-b0b7-1b0f02a64824" containerID="c1a8af58f60d3e1b210865b9165b99cd52fdde863905b1b244f79e7ecd88ae89" exitCode=0
Jul 22 03:34:15.548720 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:15.548630    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jd9tr" event={"ID":"73518916-302e-4207-b0b7-1b0f02a64824","Type":"ContainerDied","Data":"c1a8af58f60d3e1b210865b9165b99cd52fdde863905b1b244f79e7ecd88ae89"}
Jul 22 03:34:15.579906 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:15.579868    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:15.675588 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:15.675497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:16.372569 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:16.372533    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:16.373203 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:16.372671    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:34:16.373203 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:16.372716    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:16.373203 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:16.372825    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:34:16.385182 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:16.385138    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:16.488507 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:16.488468    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:16.810697 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:16.810660    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:16.911762 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:16.911734    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:16.983037 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:16.982994    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p2pn\" (UniqueName: \"kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn\") pod \"network-check-target-lfnb9\" (UID: \"d31ce3ca-c9f6-4cb3-9742-8dacd3399892\") " pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:16.983187 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:16.983119    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 03:34:16.983187 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:16.983140    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 03:34:16.983187 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:16.983151    2569 projected.go:196] Error preparing data for projected volume kube-api-access-5p2pn for pod openshift-network-diagnostics/network-check-target-lfnb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:34:16.983320 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:16.983207    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn podName:d31ce3ca-c9f6-4cb3-9742-8dacd3399892 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:48.983190052 +0000 UTC m=+66.150424713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5p2pn" (UniqueName: "kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn") pod "network-check-target-lfnb9" (UID: "d31ce3ca-c9f6-4cb3-9742-8dacd3399892") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 03:34:17.083702 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:17.083605    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:17.083702 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:17.083668    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:17.083894 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:17.083796    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:34:17.083894 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:17.083876    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs podName:8990e9a5-8145-4480-9127-d5c33c94f47b nodeName:}" failed. No retries permitted until 2026-07-22 03:34:49.083852929 +0000 UTC m=+66.251087572 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs") pod "network-metrics-daemon-xvhcc" (UID: "8990e9a5-8145-4480-9127-d5c33c94f47b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 03:34:17.083894 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:17.083803    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 03:34:17.084051 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:17.083941    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret podName:bb5c3237-38f9-4002-8191-c00c2918dc9a nodeName:}" failed. No retries permitted until 2026-07-22 03:34:49.083928029 +0000 UTC m=+66.251162688 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret") pod "global-pull-secret-syncer-8tsf5" (UID: "bb5c3237-38f9-4002-8191-c00c2918dc9a") : object "kube-system"/"original-pull-secret" not registered
Jul 22 03:34:17.090723 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:17.090670    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:17.199062 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:17.199009    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:17.285906 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:17.285855    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:17.354544 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:17.354457    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:17.372389 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:17.372335    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:17.372586 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:17.372522    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xvhcc" podUID="8990e9a5-8145-4480-9127-d5c33c94f47b"
Jul 22 03:34:17.444879 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:17.444847    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:18.372763 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.372729    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:18.373185 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.372731    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:18.373185 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:18.372868    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8tsf5" podUID="bb5c3237-38f9-4002-8191-c00c2918dc9a"
Jul 22 03:34:18.373185 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:18.372921    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lfnb9" podUID="d31ce3ca-c9f6-4cb3-9742-8dacd3399892"
Jul 22 03:34:18.667007 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.666930    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-88.ec2.internal" event="NodeReady"
Jul 22 03:34:18.667159 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.667079    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 03:34:18.725455 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.725425    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gplz9"]
Jul 22 03:34:18.728976 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.728934    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.729214 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.729183    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vgdmh"]
Jul 22 03:34:18.731315 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.731295    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:18.732157 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.731758    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 03:34:18.732157 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.731859    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 03:34:18.732157 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.731937    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 03:34:18.732157 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.731962    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 03:34:18.732594 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.732560    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cwd77\""
Jul 22 03:34:18.733702 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.733674    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:18.733942 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.733707    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 03:34:18.733942 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.733727    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jn6xf\""
Jul 22 03:34:18.733942 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.733927    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 03:34:18.749043 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.746882    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gplz9"]
Jul 22 03:34:18.749043 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.747606    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vgdmh"]
Jul 22 03:34:18.758520 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.758497    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rd4n9"]
Jul 22 03:34:18.760735 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.760715    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rd4n9"
Jul 22 03:34:18.763686 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.763623    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 03:34:18.763789 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.763709    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 03:34:18.763864 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.763783    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 03:34:18.763864 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.763798    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8dq25\""
Jul 22 03:34:18.771333 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.771309    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rd4n9"]
Jul 22 03:34:18.807587 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.807551    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:18.895691 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.895635    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:18.895876 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.895703    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53ee225b-818c-48db-aa81-291fdda1b6f7-tmp-dir\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:18.895876 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.895735    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.895876 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.895765    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8bqh\" (UniqueName: \"kubernetes.io/projected/cebe7eab-75cb-4fad-9544-81af9507ace2-kube-api-access-t8bqh\") pod \"ingress-canary-rd4n9\" (UID: \"cebe7eab-75cb-4fad-9544-81af9507ace2\") " pod="openshift-ingress-canary/ingress-canary-rd4n9"
Jul 22 03:34:18.895876 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.895821    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnwmz\" (UniqueName: \"kubernetes.io/projected/b78266f5-b7d0-4637-8900-cef781106c52-kube-api-access-bnwmz\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.895876 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.895850    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53ee225b-818c-48db-aa81-291fdda1b6f7-config-volume\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:18.896086 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.895878    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.896086 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.895906    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwlqd\" (UniqueName: \"kubernetes.io/projected/53ee225b-818c-48db-aa81-291fdda1b6f7-kube-api-access-rwlqd\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:18.896086 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.895931    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b78266f5-b7d0-4637-8900-cef781106c52-crio-socket\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.896086 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.895954    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cebe7eab-75cb-4fad-9544-81af9507ace2-cert\") pod \"ingress-canary-rd4n9\" (UID: \"cebe7eab-75cb-4fad-9544-81af9507ace2\") " pod="openshift-ingress-canary/ingress-canary-rd4n9"
Jul 22 03:34:18.896086 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.895991    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b78266f5-b7d0-4637-8900-cef781106c52-data-volume\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.996957 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.996915    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8bqh\" (UniqueName: \"kubernetes.io/projected/cebe7eab-75cb-4fad-9544-81af9507ace2-kube-api-access-t8bqh\") pod \"ingress-canary-rd4n9\" (UID: \"cebe7eab-75cb-4fad-9544-81af9507ace2\") " pod="openshift-ingress-canary/ingress-canary-rd4n9"
Jul 22 03:34:18.997138 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.996990    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnwmz\" (UniqueName: \"kubernetes.io/projected/b78266f5-b7d0-4637-8900-cef781106c52-kube-api-access-bnwmz\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.997138 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997036    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53ee225b-818c-48db-aa81-291fdda1b6f7-config-volume\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:18.997244 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997161    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.997244 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997191    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwlqd\" (UniqueName: \"kubernetes.io/projected/53ee225b-818c-48db-aa81-291fdda1b6f7-kube-api-access-rwlqd\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:18.997333 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:18.997292    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:34:18.997333 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997314    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b78266f5-b7d0-4637-8900-cef781106c52-crio-socket\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.997431 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:18.997366    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls podName:b78266f5-b7d0-4637-8900-cef781106c52 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:19.497342216 +0000 UTC m=+36.664576868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gplz9" (UID: "b78266f5-b7d0-4637-8900-cef781106c52") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:34:18.997431 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997405    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cebe7eab-75cb-4fad-9544-81af9507ace2-cert\") pod \"ingress-canary-rd4n9\" (UID: \"cebe7eab-75cb-4fad-9544-81af9507ace2\") " pod="openshift-ingress-canary/ingress-canary-rd4n9"
Jul 22 03:34:18.997536 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997448    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b78266f5-b7d0-4637-8900-cef781106c52-data-volume\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.997536 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997496    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:18.997536 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997522    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53ee225b-818c-48db-aa81-291fdda1b6f7-tmp-dir\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:18.997772 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.997772 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997561    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b78266f5-b7d0-4637-8900-cef781106c52-crio-socket\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.997772 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:18.997632    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:34:18.997772 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997707    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/53ee225b-818c-48db-aa81-291fdda1b6f7-config-volume\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:18.997772 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:18.997715    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls podName:53ee225b-818c-48db-aa81-291fdda1b6f7 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:19.497697053 +0000 UTC m=+36.664931700 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls") pod "dns-default-vgdmh" (UID: "53ee225b-818c-48db-aa81-291fdda1b6f7") : secret "dns-default-metrics-tls" not found
Jul 22 03:34:18.997772 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:18.997718    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:34:18.998057 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:18.997779    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm podName:b78266f5-b7d0-4637-8900-cef781106c52 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:19.497767413 +0000 UTC m=+36.665002071 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gplz9" (UID: "b78266f5-b7d0-4637-8900-cef781106c52") : configmap "kube-rbac-proxy" not found
Jul 22 03:34:18.998057 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997945    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b78266f5-b7d0-4637-8900-cef781106c52-data-volume\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:18.998057 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:18.997946    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/53ee225b-818c-48db-aa81-291fdda1b6f7-tmp-dir\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:19.002768 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.002747    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cebe7eab-75cb-4fad-9544-81af9507ace2-cert\") pod \"ingress-canary-rd4n9\" (UID: \"cebe7eab-75cb-4fad-9544-81af9507ace2\") " pod="openshift-ingress-canary/ingress-canary-rd4n9"
Jul 22 03:34:19.007050 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.006746    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8bqh\" (UniqueName: \"kubernetes.io/projected/cebe7eab-75cb-4fad-9544-81af9507ace2-kube-api-access-t8bqh\") pod \"ingress-canary-rd4n9\" (UID: \"cebe7eab-75cb-4fad-9544-81af9507ace2\") " pod="openshift-ingress-canary/ingress-canary-rd4n9"
Jul 22 03:34:19.007050 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.006990    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnwmz\" (UniqueName: \"kubernetes.io/projected/b78266f5-b7d0-4637-8900-cef781106c52-kube-api-access-bnwmz\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:19.007050 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.007007    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwlqd\" (UniqueName: \"kubernetes.io/projected/53ee225b-818c-48db-aa81-291fdda1b6f7-kube-api-access-rwlqd\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:19.071254 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.071223    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rd4n9"
Jul 22 03:34:19.372264 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.372184    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:19.374876 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.374854    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 03:34:19.375524 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.374991    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dzrs8\""
Jul 22 03:34:19.501669 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.501612    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:19.501845 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.501723    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:19.501845 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.501744    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:19.501845 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:19.501772    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:34:19.501845 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:19.501839    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:34:19.502077 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:19.501867    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls podName:b78266f5-b7d0-4637-8900-cef781106c52 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:20.501844714 +0000 UTC m=+37.669079404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gplz9" (UID: "b78266f5-b7d0-4637-8900-cef781106c52") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:34:19.502077 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:19.501872    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:34:19.502077 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:19.501905    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm podName:b78266f5-b7d0-4637-8900-cef781106c52 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:20.501887793 +0000 UTC m=+37.669122474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gplz9" (UID: "b78266f5-b7d0-4637-8900-cef781106c52") : configmap "kube-rbac-proxy" not found
Jul 22 03:34:19.502077 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:19.501928    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls podName:53ee225b-818c-48db-aa81-291fdda1b6f7 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:20.501912756 +0000 UTC m=+37.669147435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls") pod "dns-default-vgdmh" (UID: "53ee225b-818c-48db-aa81-291fdda1b6f7") : secret "dns-default-metrics-tls" not found
Jul 22 03:34:19.582266 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.581472    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:19.711292 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.711161    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rd4n9"]
Jul 22 03:34:19.713818 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:34:19.713796    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcebe7eab_75cb_4fad_9544_81af9507ace2.slice/crio-5e7b644d6f1157c6cebf53f0decbfd3f1f9708c76d7e8ea543e9d9a79908be12 WatchSource:0}: Error finding container 5e7b644d6f1157c6cebf53f0decbfd3f1f9708c76d7e8ea543e9d9a79908be12: Status 404 returned error can't find the container with id 5e7b644d6f1157c6cebf53f0decbfd3f1f9708c76d7e8ea543e9d9a79908be12
Jul 22 03:34:19.876575 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:19.876494    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l4m47_10efa3fa-bde2-477d-bbe0-7e534e9c9adb/dns-node-resolver/0.log"
Jul 22 03:34:20.372163 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.372132    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:20.372352 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.372331    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:20.377918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.377890    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 03:34:20.378287 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.377934    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 03:34:20.378749 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.378719    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 03:34:20.378749 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.378739    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h4vks\""
Jul 22 03:34:20.510732 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.510700    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:20.510903 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.510796    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:20.510903 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:20.510854    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:34:20.510903 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.510864    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:20.511069 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:20.510926    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm podName:b78266f5-b7d0-4637-8900-cef781106c52 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:22.510905066 +0000 UTC m=+39.678139720 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gplz9" (UID: "b78266f5-b7d0-4637-8900-cef781106c52") : configmap "kube-rbac-proxy" not found
Jul 22 03:34:20.511069 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:20.510954    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:34:20.511069 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:20.510967    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:34:20.511069 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:20.511006    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls podName:b78266f5-b7d0-4637-8900-cef781106c52 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:22.510989113 +0000 UTC m=+39.678223759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gplz9" (UID: "b78266f5-b7d0-4637-8900-cef781106c52") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:34:20.511069 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:20.511023    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls podName:53ee225b-818c-48db-aa81-291fdda1b6f7 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:22.511016182 +0000 UTC m=+39.678250823 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls") pod "dns-default-vgdmh" (UID: "53ee225b-818c-48db-aa81-291fdda1b6f7") : secret "dns-default-metrics-tls" not found
Jul 22 03:34:20.564348 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.564317    2569 generic.go:356] "Generic (PLEG): container finished" podID="73518916-302e-4207-b0b7-1b0f02a64824" containerID="930e3c6665061615fffafdacfa555d2b97e751f103a23c5e3db5d43ebd925d68" exitCode=0
Jul 22 03:34:20.564494 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.564402    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jd9tr" event={"ID":"73518916-302e-4207-b0b7-1b0f02a64824","Type":"ContainerDied","Data":"930e3c6665061615fffafdacfa555d2b97e751f103a23c5e3db5d43ebd925d68"}
Jul 22 03:34:20.565627 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.565591    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rd4n9" event={"ID":"cebe7eab-75cb-4fad-9544-81af9507ace2","Type":"ContainerStarted","Data":"5e7b644d6f1157c6cebf53f0decbfd3f1f9708c76d7e8ea543e9d9a79908be12"}
Jul 22 03:34:20.876443 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:20.876413    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8n7fw_b085ef6e-6417-412e-9734-573ade70877b/node-ca/0.log"
Jul 22 03:34:21.572134 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:21.572100    2569 generic.go:356] "Generic (PLEG): container finished" podID="73518916-302e-4207-b0b7-1b0f02a64824" containerID="214ad2d2abb5ed848132d50e7912d37dff2b6c934f9413045eb758264cc5c26f" exitCode=0
Jul 22 03:34:21.572551 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:21.572153    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jd9tr" event={"ID":"73518916-302e-4207-b0b7-1b0f02a64824","Type":"ContainerDied","Data":"214ad2d2abb5ed848132d50e7912d37dff2b6c934f9413045eb758264cc5c26f"}
Jul 22 03:34:22.527273 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:22.527230    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:22.527445 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:22.527296    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:22.527445 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:22.527323    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:22.527445 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:22.527380    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:34:22.527445 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:22.527403    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 03:34:22.527574 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:22.527448    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:34:22.527574 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:22.527454    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls podName:b78266f5-b7d0-4637-8900-cef781106c52 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:26.527436844 +0000 UTC m=+43.694671497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gplz9" (UID: "b78266f5-b7d0-4637-8900-cef781106c52") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:34:22.527574 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:22.527489    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm podName:b78266f5-b7d0-4637-8900-cef781106c52 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:26.527478254 +0000 UTC m=+43.694712896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gplz9" (UID: "b78266f5-b7d0-4637-8900-cef781106c52") : configmap "kube-rbac-proxy" not found
Jul 22 03:34:22.527574 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:22.527502    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls podName:53ee225b-818c-48db-aa81-291fdda1b6f7 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:26.527494915 +0000 UTC m=+43.694729557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls") pod "dns-default-vgdmh" (UID: "53ee225b-818c-48db-aa81-291fdda1b6f7") : secret "dns-default-metrics-tls" not found
Jul 22 03:34:22.577558 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:22.577520    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jd9tr" event={"ID":"73518916-302e-4207-b0b7-1b0f02a64824","Type":"ContainerStarted","Data":"21796540e9168ad19430043d3170f3906e35f563fb8d6a2278edda5a673d7961"}
Jul 22 03:34:22.578896 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:22.578872    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rd4n9" event={"ID":"cebe7eab-75cb-4fad-9544-81af9507ace2","Type":"ContainerStarted","Data":"8701f1f0575f402599deb8cf0aff169261ca9a7b4098367e0951fce4296f3dd8"}
Jul 22 03:34:22.602723 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:22.602664    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jd9tr" podStartSLOduration=9.134855828 podStartE2EDuration="39.602619671s" totalImagesPullingTime="30.467763843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:33:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:22.600991036 +0000 UTC m=+39.768225702" watchObservedRunningTime="2026-07-22 03:34:22.602619671 +0000 UTC m=+39.769854336"
Jul 22 03:34:22.617847 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:22.617791    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rd4n9" podStartSLOduration=2.387394453 podStartE2EDuration="4.617776176s" totalImagesPullingTime="2.230381723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:22.617354147 +0000 UTC m=+39.784588811" watchObservedRunningTime="2026-07-22 03:34:22.617776176 +0000 UTC m=+39.785010839"
Jul 22 03:34:22.990071 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:22.990034    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:23.728068 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:23.728034    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:24.471283 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:24.471244    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:24.557224 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:24.557186    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:24.620881 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:24.620846    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:24.690557 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:24.690529    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:24.792017 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:24.791917    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:24.892147 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:24.892112    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:24.993250 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:24.993224    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:25.281950 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:25.281915    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:26.474944 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:26.474907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:26.560325 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:26.560287    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:26.560325 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:26.560324    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:26.560597 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:26.560373    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:26.560597 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:26.560440    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 03:34:26.560597 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:26.560459    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 03:34:26.560597 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:26.560510    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls podName:53ee225b-818c-48db-aa81-291fdda1b6f7 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:34.560488218 +0000 UTC m=+51.727722878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls") pod "dns-default-vgdmh" (UID: "53ee225b-818c-48db-aa81-291fdda1b6f7") : secret "dns-default-metrics-tls" not found
Jul 22 03:34:26.560597 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:26.560525    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls podName:b78266f5-b7d0-4637-8900-cef781106c52 nodeName:}" failed. No retries permitted until 2026-07-22 03:34:34.560518448 +0000 UTC m=+51.727753090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gplz9" (UID: "b78266f5-b7d0-4637-8900-cef781106c52") : secret "insights-runtime-extractor-tls" not found
Jul 22 03:34:26.560938 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:26.560920    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b78266f5-b7d0-4637-8900-cef781106c52-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:26.670717 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:26.670676    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:26.859408 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:26.859313    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:27.062203 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:27.062167    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:27.258389 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:27.258355    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:28.261405 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:28.261360    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:28.329360 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:28.329326    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:28.486989 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:28.486949    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:28.551861 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:28.551787    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:28.678790 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:28.678754    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:28.883446 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:28.883361    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:29.062609 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:29.062571    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:29.460604 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:29.460576    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:30.058788 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:30.058751    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:30.159799 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:30.159755    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:30.262530 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:30.262503    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:30.457162 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:30.457125    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:30.859712 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:30.859617    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:30.916837 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:30.916806    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:31.061747 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:31.061708    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:31.428863 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:31.428831    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:31.672796 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:31.672763    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:32.193407 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:32.193371    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:32.466387 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:32.466348    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:32.876962 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:32.876870    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:33.271743 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:33.271711    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:33.669775 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:33.669691    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:33.861483 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:33.861451    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:34.279556 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:34.279528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:34.612793 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:34.612717    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:34.612793 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:34.612765    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:34.616742 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:34.616717    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b78266f5-b7d0-4637-8900-cef781106c52-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gplz9\" (UID: \"b78266f5-b7d0-4637-8900-cef781106c52\") " pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:34.616874 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:34.616717    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/53ee225b-818c-48db-aa81-291fdda1b6f7-metrics-tls\") pod \"dns-default-vgdmh\" (UID: \"53ee225b-818c-48db-aa81-291fdda1b6f7\") " pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:34.644709 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:34.644680    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gplz9"
Jul 22 03:34:34.653897 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:34.653876    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:34.657989 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:34.657965    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:34.807900 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:34.807830    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gplz9"]
Jul 22 03:34:34.844075 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:34.844051    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vgdmh"]
Jul 22 03:34:34.846385 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:34:34.846359    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ee225b_818c_48db_aa81_291fdda1b6f7.slice/crio-17876b0c5e654512101e36809ccc075c0897e452d41ff4c64f777fd5a5419e58 WatchSource:0}: Error finding container 17876b0c5e654512101e36809ccc075c0897e452d41ff4c64f777fd5a5419e58: Status 404 returned error can't find the container with id 17876b0c5e654512101e36809ccc075c0897e452d41ff4c64f777fd5a5419e58
Jul 22 03:34:34.882129 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:34.882040    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:35.263988 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:35.263950    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:35.612900 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:35.612814    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgdmh" event={"ID":"53ee225b-818c-48db-aa81-291fdda1b6f7","Type":"ContainerStarted","Data":"17876b0c5e654512101e36809ccc075c0897e452d41ff4c64f777fd5a5419e58"}
Jul 22 03:34:35.614182 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:35.614150    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gplz9" event={"ID":"b78266f5-b7d0-4637-8900-cef781106c52","Type":"ContainerStarted","Data":"506edd2ff8bdcba5c621cf71b927207ba9526230e1c5ee9bd81076bdf4e3f65d"}
Jul 22 03:34:37.621830 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:37.621734    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgdmh" event={"ID":"53ee225b-818c-48db-aa81-291fdda1b6f7","Type":"ContainerStarted","Data":"831e5af8868da8fd91157651a2ae10e007354696bdb2ceabb45098770594ad33"}
Jul 22 03:34:39.800822 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:39.800779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:39.906458 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:39.906418    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:40.005947 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.005919    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:40.104934 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.104899    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:40.423964 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.423873    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68bbfb6c99-5cvrl"]
Jul 22 03:34:40.425946 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.425924    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"]
Jul 22 03:34:40.426077 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.426046    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.428035 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.428013    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.437071 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.437048    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 22 03:34:40.444251 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.444229    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 03:34:40.444251 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.444240    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 03:34:40.445838 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.445817    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 22 03:34:40.445939 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.445862    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 22 03:34:40.450942 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.450892    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68bbfb6c99-5cvrl"]
Jul 22 03:34:40.459178 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-registry-certificates\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.459278 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459216    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-installation-pull-secrets\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.459278 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459241    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.459278 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459256    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.459278 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459272    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-bound-sa-token\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.459452 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459323    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-hub\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.459452 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459351    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.459452 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459376    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b7qk\" (UniqueName: \"kubernetes.io/projected/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-kube-api-access-5b7qk\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.459452 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459426    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-registry-tls\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.459634 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459453    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-ca-trust-extracted\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.459634 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459481    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-image-registry-private-configuration\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.459634 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459486    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 03:34:40.459634 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459506    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-trusted-ca\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.459634 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459554    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 03:34:40.459634 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459561    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dfp92\""
Jul 22 03:34:40.459634 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459554    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqvxw\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-kube-api-access-tqvxw\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.459984 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-ca\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.459984 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.459904    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 03:34:40.462988 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.462968    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 03:34:40.463098 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.463038    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 03:34:40.463409 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.463394    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 22 03:34:40.479594 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.479565    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"]
Jul 22 03:34:40.560945 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.560913    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-installation-pull-secrets\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.560945 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.560944    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.561201 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.560964    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.561201 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.560980    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-bound-sa-token\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.561201 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.560995    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-hub\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.561201 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.561019    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.561201 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.561042    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b7qk\" (UniqueName: \"kubernetes.io/projected/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-kube-api-access-5b7qk\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.561201 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.561075    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-registry-tls\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.561499 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.561470    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-ca-trust-extracted\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.561565 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.561519    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-image-registry-private-configuration\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.561565 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.561547    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-trusted-ca\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.561807 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.561596    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqvxw\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-kube-api-access-tqvxw\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.561807 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.561636    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-ca\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.561807 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.561743    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-registry-certificates\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.561807 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.561840    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-ca-trust-extracted\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.561807 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.561856    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-additional-service-ca\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.562720 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.562697    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-registry-certificates\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.563535 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.563436    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-trusted-ca\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.564330 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.564308    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.564503 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.564483    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-installation-pull-secrets\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.564560 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.564523    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.564895 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.564879    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-registry-tls\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.565000 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.564979    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-image-registry-private-configuration\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.565144 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.565128    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-hub\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.565523 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.565505    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-ca\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.574312 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.574286    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68bbfb6c99-5cvrl"]
Jul 22 03:34:40.574556 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:34:40.574535    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token kube-api-access-tqvxw], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl" podUID="9b3fea11-4e4d-4564-98de-0f31fef1bcb5"
Jul 22 03:34:40.580999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.580976    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-bound-sa-token\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.581929 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.581906    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqvxw\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-kube-api-access-tqvxw\") pod \"image-registry-68bbfb6c99-5cvrl\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") " pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.582052 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.581950    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b7qk\" (UniqueName: \"kubernetes.io/projected/ddf8027d-81a6-4fd0-9b1d-73d64ce393ae-kube-api-access-5b7qk\") pod \"cluster-proxy-proxy-agent-59bfb8f6f6-x89hc\" (UID: \"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.582318 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.582293    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:40.630596 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.630560    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vgdmh" event={"ID":"53ee225b-818c-48db-aa81-291fdda1b6f7","Type":"ContainerStarted","Data":"0110212ad311f6d554a23f203373d1baf41663a2426cda3907ea38fd3d5e63ab"}
Jul 22 03:34:40.630808 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.630663    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:40.632029 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.632013    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.632112 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.632047    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gplz9" event={"ID":"b78266f5-b7d0-4637-8900-cef781106c52","Type":"ContainerStarted","Data":"ac5943a3af939ec4677a613624fd3e1a0afa7b173fa3054ec6892a7cc809d6d7"}
Jul 22 03:34:40.638343 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.638322    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:40.653664 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.653621    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74fd7fb9df-55cq7"]
Jul 22 03:34:40.655442 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.655423    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.663031 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663008    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-trusted-ca\") pod \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") "
Jul 22 03:34:40.663154 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663066    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-installation-pull-secrets\") pod \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") "
Jul 22 03:34:40.663154 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663103    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-registry-certificates\") pod \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") "
Jul 22 03:34:40.663154 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663129    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-ca-trust-extracted\") pod \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") "
Jul 22 03:34:40.663307 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663154    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-bound-sa-token\") pod \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") "
Jul 22 03:34:40.663307 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663183    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-image-registry-private-configuration\") pod \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") "
Jul 22 03:34:40.663307 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663231    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-registry-tls\") pod \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") "
Jul 22 03:34:40.663307 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663257    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqvxw\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-kube-api-access-tqvxw\") pod \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\" (UID: \"9b3fea11-4e4d-4564-98de-0f31fef1bcb5\") "
Jul 22 03:34:40.663490 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663436    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9b3fea11-4e4d-4564-98de-0f31fef1bcb5" (UID: "9b3fea11-4e4d-4564-98de-0f31fef1bcb5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:34:40.663490 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663464    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9b3fea11-4e4d-4564-98de-0f31fef1bcb5" (UID: "9b3fea11-4e4d-4564-98de-0f31fef1bcb5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:34:40.663577 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663557    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9b3fea11-4e4d-4564-98de-0f31fef1bcb5" (UID: "9b3fea11-4e4d-4564-98de-0f31fef1bcb5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:34:40.663690 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663668    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-trusted-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:34:40.663690 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663690    2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-registry-certificates\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:34:40.663864 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.663702    2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-ca-trust-extracted\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:34:40.665653 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.665600    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9b3fea11-4e4d-4564-98de-0f31fef1bcb5" (UID: "9b3fea11-4e4d-4564-98de-0f31fef1bcb5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:34:40.665653 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.665610    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-kube-api-access-tqvxw" (OuterVolumeSpecName: "kube-api-access-tqvxw") pod "9b3fea11-4e4d-4564-98de-0f31fef1bcb5" (UID: "9b3fea11-4e4d-4564-98de-0f31fef1bcb5"). InnerVolumeSpecName "kube-api-access-tqvxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:34:40.665984 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.665967    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9b3fea11-4e4d-4564-98de-0f31fef1bcb5" (UID: "9b3fea11-4e4d-4564-98de-0f31fef1bcb5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:34:40.666105 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.666083    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9b3fea11-4e4d-4564-98de-0f31fef1bcb5" (UID: "9b3fea11-4e4d-4564-98de-0f31fef1bcb5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:34:40.666164 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.666100    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9b3fea11-4e4d-4564-98de-0f31fef1bcb5" (UID: "9b3fea11-4e4d-4564-98de-0f31fef1bcb5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:34:40.676085 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.676002    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vgdmh" podStartSLOduration=20.236184791 podStartE2EDuration="22.675988013s" totalImagesPullingTime="2.439803222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:40.675223908 +0000 UTC m=+57.842458573" watchObservedRunningTime="2026-07-22 03:34:40.675988013 +0000 UTC m=+57.843222677"
Jul 22 03:34:40.695872 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.695837    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74fd7fb9df-55cq7"]
Jul 22 03:34:40.745776 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.745721    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:40.752243 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.752213    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"
Jul 22 03:34:40.764833 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.764803    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c32537a-cdbe-4ec0-810e-3441383c55ec-trusted-ca\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.764971 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.764860    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c32537a-cdbe-4ec0-810e-3441383c55ec-bound-sa-token\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.765066 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.764977    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttrqv\" (UniqueName: \"kubernetes.io/projected/9c32537a-cdbe-4ec0-810e-3441383c55ec-kube-api-access-ttrqv\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.765066 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.765017    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c32537a-cdbe-4ec0-810e-3441383c55ec-installation-pull-secrets\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.765066 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.765060    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c32537a-cdbe-4ec0-810e-3441383c55ec-ca-trust-extracted\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.765230 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.765088    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c32537a-cdbe-4ec0-810e-3441383c55ec-image-registry-private-configuration\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.765230 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.765132    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c32537a-cdbe-4ec0-810e-3441383c55ec-registry-certificates\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.765230 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.765158    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c32537a-cdbe-4ec0-810e-3441383c55ec-registry-tls\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.765230 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.765200    2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-image-registry-private-configuration\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:34:40.765230 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.765216    2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-bound-sa-token\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:34:40.765442 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.765229    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqvxw\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-kube-api-access-tqvxw\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:34:40.765442 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.765245    2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-installation-pull-secrets\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:34:40.765442 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.765260    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9b3fea11-4e4d-4564-98de-0f31fef1bcb5-registry-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:34:40.835791 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.835738    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:40.866510 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.866479    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttrqv\" (UniqueName: \"kubernetes.io/projected/9c32537a-cdbe-4ec0-810e-3441383c55ec-kube-api-access-ttrqv\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.866694 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.866525    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c32537a-cdbe-4ec0-810e-3441383c55ec-installation-pull-secrets\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.866694 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.866562    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c32537a-cdbe-4ec0-810e-3441383c55ec-ca-trust-extracted\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.866694 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.866590    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c32537a-cdbe-4ec0-810e-3441383c55ec-image-registry-private-configuration\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.866694 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.866629    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c32537a-cdbe-4ec0-810e-3441383c55ec-registry-certificates\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.866694 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.866669    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c32537a-cdbe-4ec0-810e-3441383c55ec-registry-tls\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.866939 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.866713    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c32537a-cdbe-4ec0-810e-3441383c55ec-trusted-ca\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.866939 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.866761    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c32537a-cdbe-4ec0-810e-3441383c55ec-bound-sa-token\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.869289 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.867954    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9c32537a-cdbe-4ec0-810e-3441383c55ec-registry-certificates\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.869289 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.868203    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9c32537a-cdbe-4ec0-810e-3441383c55ec-ca-trust-extracted\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.869289 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.869222    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9c32537a-cdbe-4ec0-810e-3441383c55ec-trusted-ca\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.871243 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.871214    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9c32537a-cdbe-4ec0-810e-3441383c55ec-registry-tls\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.872545 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.872501    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9c32537a-cdbe-4ec0-810e-3441383c55ec-installation-pull-secrets\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.873678 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.873602    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9c32537a-cdbe-4ec0-810e-3441383c55ec-image-registry-private-configuration\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.877019 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.876970    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c32537a-cdbe-4ec0-810e-3441383c55ec-bound-sa-token\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.877714 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.877629    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttrqv\" (UniqueName: \"kubernetes.io/projected/9c32537a-cdbe-4ec0-810e-3441383c55ec-kube-api-access-ttrqv\") pod \"image-registry-74fd7fb9df-55cq7\" (UID: \"9c32537a-cdbe-4ec0-810e-3441383c55ec\") " pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:40.930360 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.930276    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc"]
Jul 22 03:34:40.934261 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:34:40.934234    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddf8027d_81a6_4fd0_9b1d_73d64ce393ae.slice/crio-690420a52bcd80da34c6b31650e22ad66fd97ef7023fed3b5d8bf4f0a89fbf3e WatchSource:0}: Error finding container 690420a52bcd80da34c6b31650e22ad66fd97ef7023fed3b5d8bf4f0a89fbf3e: Status 404 returned error can't find the container with id 690420a52bcd80da34c6b31650e22ad66fd97ef7023fed3b5d8bf4f0a89fbf3e
Jul 22 03:34:40.935006 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.934976    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:40.964129 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:40.964095    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:41.027872 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.027683    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:41.127879 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.127848    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74fd7fb9df-55cq7"]
Jul 22 03:34:41.142003 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.141969    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:41.207751 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.207598    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:41.310203 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.310167    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:41.494428 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.494398    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:41.639322 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.638854    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7" event={"ID":"9c32537a-cdbe-4ec0-810e-3441383c55ec","Type":"ContainerStarted","Data":"6d91c493a2cdb881b8b6cb3cd3f2314008a85370b3ba5986c0e03d6c307f1777"}
Jul 22 03:34:41.639322 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.638911    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7" event={"ID":"9c32537a-cdbe-4ec0-810e-3441383c55ec","Type":"ContainerStarted","Data":"30b7a4fb63c1b6dafdd95f89cf40315135b65ba6b778fa4b057ce88dd999600c"}
Jul 22 03:34:41.639322 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.638968    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:34:41.640868 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.640842    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68bbfb6c99-5cvrl"
Jul 22 03:34:41.641960 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.641306    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc" event={"ID":"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae","Type":"ContainerStarted","Data":"690420a52bcd80da34c6b31650e22ad66fd97ef7023fed3b5d8bf4f0a89fbf3e"}
Jul 22 03:34:41.661601 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.661544    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7" podStartSLOduration=1.661527966 podStartE2EDuration="1.661527966s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:41.661220313 +0000 UTC m=+58.828454978" watchObservedRunningTime="2026-07-22 03:34:41.661527966 +0000 UTC m=+58.828762626"
Jul 22 03:34:41.664945 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.664869    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:41.687669 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.687623    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68bbfb6c99-5cvrl"]
Jul 22 03:34:41.691785 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.691754    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68bbfb6c99-5cvrl"]
Jul 22 03:34:41.871754 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.871656    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:41.968164 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:41.968103    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:43.088318 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:43.088279    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:43.153701 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:43.153654    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:43.376243 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:43.376137    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b3fea11-4e4d-4564-98de-0f31fef1bcb5" path="/var/lib/kubelet/pods/9b3fea11-4e4d-4564-98de-0f31fef1bcb5/volumes"
Jul 22 03:34:43.478334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:43.478292    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:43.533116 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:43.533075    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:44.556789 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:44.556762    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhcg8"
Jul 22 03:34:44.683197 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:44.683159    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:44.782238 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:44.782191    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:44.883761 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:44.883667    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:46.659375 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:46.659335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gplz9" event={"ID":"b78266f5-b7d0-4637-8900-cef781106c52","Type":"ContainerStarted","Data":"a0d500e336105126c181e78520843da2521797c6737f6048a19a8c5e486a2d54"}
Jul 22 03:34:46.661570 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:46.661538    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc" event={"ID":"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae","Type":"ContainerStarted","Data":"cd002a53910da8f1f1504cf90323013955d17a3f8e86d85a3c9a610762b4062e"}
Jul 22 03:34:46.661748 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:46.661583    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc" event={"ID":"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae","Type":"ContainerStarted","Data":"c16c56c697d825057041e381d587824c40c4551b51d08aee9ebd277e3a0cb174"}
Jul 22 03:34:46.661748 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:46.661604    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc" event={"ID":"ddf8027d-81a6-4fd0-9b1d-73d64ce393ae","Type":"ContainerStarted","Data":"47d27b7f16e8e04469f2186daf05cc62d705ba7030202ba92e777012f5dfb972"}
Jul 22 03:34:46.683251 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:46.683187    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-59bfb8f6f6-x89hc" podStartSLOduration=1.4652461159999999 podStartE2EDuration="6.683170941s" totalImagesPullingTime="5.217924825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:34:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:46.681956625 +0000 UTC m=+63.849191290" watchObservedRunningTime="2026-07-22 03:34:46.683170941 +0000 UTC m=+63.850405582"
Jul 22 03:34:47.442403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:47.442368    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:47.497210 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:47.497176    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:47.644743 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:47.644708    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vgdmh"
Jul 22 03:34:49.039123 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.039084    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p2pn\" (UniqueName: \"kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn\") pod \"network-check-target-lfnb9\" (UID: \"d31ce3ca-c9f6-4cb3-9742-8dacd3399892\") " pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:49.041917 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.041889    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 03:34:49.051784 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.051756    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 03:34:49.062357 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.062321    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p2pn\" (UniqueName: \"kubernetes.io/projected/d31ce3ca-c9f6-4cb3-9742-8dacd3399892-kube-api-access-5p2pn\") pod \"network-check-target-lfnb9\" (UID: \"d31ce3ca-c9f6-4cb3-9742-8dacd3399892\") " pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:49.139739 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.139699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:49.139937 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.139797    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:49.142841 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.142813    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 03:34:49.143323 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.143303    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 03:34:49.153216 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.153183    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8990e9a5-8145-4480-9127-d5c33c94f47b-metrics-certs\") pod \"network-metrics-daemon-xvhcc\" (UID: \"8990e9a5-8145-4480-9127-d5c33c94f47b\") " pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:49.153362 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.153305    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/bb5c3237-38f9-4002-8191-c00c2918dc9a-original-pull-secret\") pod \"global-pull-secret-syncer-8tsf5\" (UID: \"bb5c3237-38f9-4002-8191-c00c2918dc9a\") " pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:49.183859 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.183822    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8tsf5"
Jul 22 03:34:49.192837 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.192801    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h4vks\""
Jul 22 03:34:49.201120 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.201092    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:49.386695 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.386598    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dzrs8\""
Jul 22 03:34:49.394779 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.394744    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xvhcc"
Jul 22 03:34:49.706271 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.706230    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8tsf5"]
Jul 22 03:34:49.715656 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:34:49.715615    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb5c3237_38f9_4002_8191_c00c2918dc9a.slice/crio-328274e865c97111158e1fbe31394a46cf59fbdda3c44e651893818f40c106e3 WatchSource:0}: Error finding container 328274e865c97111158e1fbe31394a46cf59fbdda3c44e651893818f40c106e3: Status 404 returned error can't find the container with id 328274e865c97111158e1fbe31394a46cf59fbdda3c44e651893818f40c106e3
Jul 22 03:34:49.932991 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.932915    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lfnb9"]
Jul 22 03:34:49.937103 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:34:49.937076    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31ce3ca_c9f6_4cb3_9742_8dacd3399892.slice/crio-04f957fd95dcd5772e297217d5d1f31b594d1cf725f5d85877f2f69488252064 WatchSource:0}: Error finding container 04f957fd95dcd5772e297217d5d1f31b594d1cf725f5d85877f2f69488252064: Status 404 returned error can't find the container with id 04f957fd95dcd5772e297217d5d1f31b594d1cf725f5d85877f2f69488252064
Jul 22 03:34:49.937279 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:49.937256    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xvhcc"]
Jul 22 03:34:49.940885 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:34:49.940864    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8990e9a5_8145_4480_9127_d5c33c94f47b.slice/crio-7f9f0a7e3424c8793671cf047e0b3858df459da3db171678502d82f064cc98c6 WatchSource:0}: Error finding container 7f9f0a7e3424c8793671cf047e0b3858df459da3db171678502d82f064cc98c6: Status 404 returned error can't find the container with id 7f9f0a7e3424c8793671cf047e0b3858df459da3db171678502d82f064cc98c6
Jul 22 03:34:50.675006 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:50.674965    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:50.681146 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:50.681109    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xvhcc" event={"ID":"8990e9a5-8145-4480-9127-d5c33c94f47b","Type":"ContainerStarted","Data":"7f9f0a7e3424c8793671cf047e0b3858df459da3db171678502d82f064cc98c6"}
Jul 22 03:34:50.682974 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:50.682943    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8tsf5" event={"ID":"bb5c3237-38f9-4002-8191-c00c2918dc9a","Type":"ContainerStarted","Data":"328274e865c97111158e1fbe31394a46cf59fbdda3c44e651893818f40c106e3"}
Jul 22 03:34:50.685101 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:50.685029    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lfnb9" event={"ID":"d31ce3ca-c9f6-4cb3-9742-8dacd3399892","Type":"ContainerStarted","Data":"04f957fd95dcd5772e297217d5d1f31b594d1cf725f5d85877f2f69488252064"}
Jul 22 03:34:50.687612 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:50.687518    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gplz9" event={"ID":"b78266f5-b7d0-4637-8900-cef781106c52","Type":"ContainerStarted","Data":"ec3b2a1be84c4dd9b1ee1771e1b8607cceaf0f532019faad251bc6408b93273e"}
Jul 22 03:34:50.707057 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:50.706994    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gplz9" podStartSLOduration=17.94563821 podStartE2EDuration="32.706974312s" totalImagesPullingTime="14.761336102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:34:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:50.705407857 +0000 UTC m=+67.872642524" watchObservedRunningTime="2026-07-22 03:34:50.706974312 +0000 UTC m=+67.874208975"
Jul 22 03:34:50.778829 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:50.778741    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:50.859972 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:50.859933    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:50.937052 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:50.936948    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:51.264363 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:51.264327    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:51.349180 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:51.349128    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:51.450773 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:51.450740    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:51.695431 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:51.695192    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xvhcc" event={"ID":"8990e9a5-8145-4480-9127-d5c33c94f47b","Type":"ContainerStarted","Data":"48b7e48f650d1d46cd3551a55cc9b4df75eb4170532b8720bb44068c0efe6408"}
Jul 22 03:34:52.201665 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:52.201604    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:52.266236 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:52.266187    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:52.492219 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:52.492127    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:52.592022 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:52.591986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:52.703125 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:52.703087    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xvhcc" event={"ID":"8990e9a5-8145-4480-9127-d5c33c94f47b","Type":"ContainerStarted","Data":"d10d012a4486631eafdc6d382db9b6cc508aacbae1b4a1781b08c9f6dcc0a2b3"}
Jul 22 03:34:52.720741 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:52.720696    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xvhcc" podStartSLOduration=68.277541211 podStartE2EDuration="1m9.720678913s" totalImagesPullingTime="1.443137702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:52.719707788 +0000 UTC m=+69.886942452" watchObservedRunningTime="2026-07-22 03:34:52.720678913 +0000 UTC m=+69.887913577"
Jul 22 03:34:52.811848 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:52.811759    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:53.197704 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:53.197558    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:53.297850 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:53.297815    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:53.740737 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:53.740699    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:53.794221 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:53.794160    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:53.860360 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:53.860316    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:53.941160 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:53.941126    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:54.240955 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:54.240906    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:54.706752 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:54.706719    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:55.718126 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:55.718087    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lfnb9" event={"ID":"d31ce3ca-c9f6-4cb3-9742-8dacd3399892","Type":"ContainerStarted","Data":"895ca9c7d28b143155a671b388af2673b47d29cc109d8a832357de9bfff83783"}
Jul 22 03:34:55.718712 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:55.718271    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:34:55.719556 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:55.719534    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8tsf5" event={"ID":"bb5c3237-38f9-4002-8191-c00c2918dc9a","Type":"ContainerStarted","Data":"72c5277d66a533c3309054be10a0c16e5862ddfbdeab58fc78dae07d31985400"}
Jul 22 03:34:55.735658 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:55.735594    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lfnb9" podStartSLOduration=67.999951785 podStartE2EDuration="1m12.73557881s" totalImagesPullingTime="4.735627025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:55.734335251 +0000 UTC m=+72.901569918" watchObservedRunningTime="2026-07-22 03:34:55.73557881 +0000 UTC m=+72.902813520"
Jul 22 03:34:55.749351 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:55.749297    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8tsf5" podStartSLOduration=66.791401257 podStartE2EDuration="1m11.749281591s" totalImagesPullingTime="4.957880334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 03:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:34:55.749019065 +0000 UTC m=+72.916253732" watchObservedRunningTime="2026-07-22 03:34:55.749281591 +0000 UTC m=+72.916516254"
Jul 22 03:34:56.767883 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:56.767850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:56.869023 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:56.868990    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:58.477895 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:58.477856    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:58.577954 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:58.577922    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:59.130449 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:59.130416    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:34:59.223699 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:34:59.223666    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:01.553664 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:01.553624    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:01.617312 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:01.617282    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:02.649329 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:02.649302    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74fd7fb9df-55cq7"
Jul 22 03:35:02.839822 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:02.839782    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:02.915751 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:02.915638    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:03.516022 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:03.515896    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:03.619003 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:03.618966    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:06.028885 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:06.028844    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:07.997125 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:07.997084    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:08.232286 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.232246    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:08.275956 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.275876    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-drd6x"]
Jul 22 03:35:08.278806 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.278789    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.281990 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.281967    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 03:35:08.282500 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.282486    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-nfnm8\""
Jul 22 03:35:08.283006 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.282992    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 03:35:08.283146 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.283130    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 22 03:35:08.283297 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.283281    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 03:35:08.283459 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.283446    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 22 03:35:08.284171 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.284156    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 22 03:35:08.295901 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.295877    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-b6fbf"]
Jul 22 03:35:08.298342 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.298321    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-drd6x"]
Jul 22 03:35:08.298456 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.298424    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.301012 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.300990    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 03:35:08.301134 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.301101    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hd5r7\""
Jul 22 03:35:08.301480 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.301465    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 03:35:08.301604 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.301469    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 03:35:08.325334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.325303    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:08.373264 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373230    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/462adc24-058d-4874-80a9-ce19d3273cb8-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.373264 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373268    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-tls\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.373493 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373289    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.373493 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373314    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvw5b\" (UniqueName: \"kubernetes.io/projected/462adc24-058d-4874-80a9-ce19d3273cb8-kube-api-access-cvw5b\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.373493 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373332    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/462adc24-058d-4874-80a9-ce19d3273cb8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.373493 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373359    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/462adc24-058d-4874-80a9-ce19d3273cb8-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.373493 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373374    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-sys\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.373493 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373390    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-wtmp\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.373493 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373456    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-textfile\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.373776 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373517    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/462adc24-058d-4874-80a9-ce19d3273cb8-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.373776 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373552    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtwg9\" (UniqueName: \"kubernetes.io/projected/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-kube-api-access-gtwg9\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.373776 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373583    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.373776 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373601    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-root\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.373776 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373620    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-metrics-client-ca\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.373776 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.373661    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/462adc24-058d-4874-80a9-ce19d3273cb8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.393160 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.393126    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:08.474159 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtwg9\" (UniqueName: \"kubernetes.io/projected/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-kube-api-access-gtwg9\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.474159 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474159    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.474426 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474182    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-root\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.474426 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-metrics-client-ca\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.474426 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474231    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/462adc24-058d-4874-80a9-ce19d3273cb8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.474426 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474260    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/462adc24-058d-4874-80a9-ce19d3273cb8-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.474426 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474289    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-tls\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.474426 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474296    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-root\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.474426 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474313    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.474813 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:35:08.474433    2569 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 22 03:35:08.474813 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:35:08.474499    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-tls podName:db3a67a4-6a4e-4f60-82f4-5394cf4143fd nodeName:}" failed. No retries permitted until 2026-07-22 03:35:08.974476306 +0000 UTC m=+86.141710949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-tls") pod "node-exporter-b6fbf" (UID: "db3a67a4-6a4e-4f60-82f4-5394cf4143fd") : secret "node-exporter-tls" not found
Jul 22 03:35:08.474813 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474706    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/462adc24-058d-4874-80a9-ce19d3273cb8-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.474813 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474770    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvw5b\" (UniqueName: \"kubernetes.io/projected/462adc24-058d-4874-80a9-ce19d3273cb8-kube-api-access-cvw5b\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.474813 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474800    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/462adc24-058d-4874-80a9-ce19d3273cb8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.475082 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474829    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/462adc24-058d-4874-80a9-ce19d3273cb8-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.475082 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474854    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-sys\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.475082 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-wtmp\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.475082 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474912    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-textfile\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.475082 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474926    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.475082 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474931    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-metrics-client-ca\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.475082 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474962    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/462adc24-058d-4874-80a9-ce19d3273cb8-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.475082 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.474974    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-sys\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.475431 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.475073    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/462adc24-058d-4874-80a9-ce19d3273cb8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.475431 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.475191    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-wtmp\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.475431 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.475307    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-textfile\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.475558 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.475512    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/462adc24-058d-4874-80a9-ce19d3273cb8-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.477400 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.477352    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.477590 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.477572    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/462adc24-058d-4874-80a9-ce19d3273cb8-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.477851 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.477828    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/462adc24-058d-4874-80a9-ce19d3273cb8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.484789 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.484764    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtwg9\" (UniqueName: \"kubernetes.io/projected/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-kube-api-access-gtwg9\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.485214 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.485189    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvw5b\" (UniqueName: \"kubernetes.io/projected/462adc24-058d-4874-80a9-ce19d3273cb8-kube-api-access-cvw5b\") pod \"kube-state-metrics-56c5594674-drd6x\" (UID: \"462adc24-058d-4874-80a9-ce19d3273cb8\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.500320 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.500292    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:08.588242 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.588158    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x"
Jul 22 03:35:08.679754 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.679720    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:08.737429 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.737394    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-drd6x"]
Jul 22 03:35:08.740218 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:35:08.740188    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462adc24_058d_4874_80a9_ce19d3273cb8.slice/crio-dc7c6f248cd1c878e023cb7fe762dc32937a8669141b134a903ae0ff6e505e32 WatchSource:0}: Error finding container dc7c6f248cd1c878e023cb7fe762dc32937a8669141b134a903ae0ff6e505e32: Status 404 returned error can't find the container with id dc7c6f248cd1c878e023cb7fe762dc32937a8669141b134a903ae0ff6e505e32
Jul 22 03:35:08.762253 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.762220    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x" event={"ID":"462adc24-058d-4874-80a9-ce19d3273cb8","Type":"ContainerStarted","Data":"dc7c6f248cd1c878e023cb7fe762dc32937a8669141b134a903ae0ff6e505e32"}
Jul 22 03:35:08.783283 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.783244    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:08.881635 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.881548    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:08.979095 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.979056    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-tls\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:08.981489 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:08.981471    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db3a67a4-6a4e-4f60-82f4-5394cf4143fd-node-exporter-tls\") pod \"node-exporter-b6fbf\" (UID: \"db3a67a4-6a4e-4f60-82f4-5394cf4143fd\") " pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:09.207382 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:09.207352    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-b6fbf"
Jul 22 03:35:09.278163 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:35:09.278132    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3a67a4_6a4e_4f60_82f4_5394cf4143fd.slice/crio-9a1bff43f8ef97c21818b39f1324a96dca93fac752086b942e47e1a972cbd236 WatchSource:0}: Error finding container 9a1bff43f8ef97c21818b39f1324a96dca93fac752086b942e47e1a972cbd236: Status 404 returned error can't find the container with id 9a1bff43f8ef97c21818b39f1324a96dca93fac752086b942e47e1a972cbd236
Jul 22 03:35:09.315502 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:09.315462    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:09.420303 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:09.420249    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:09.734258 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:09.734209    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:09.766568 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:09.766534    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6fbf" event={"ID":"db3a67a4-6a4e-4f60-82f4-5394cf4143fd","Type":"ContainerStarted","Data":"9a1bff43f8ef97c21818b39f1324a96dca93fac752086b942e47e1a972cbd236"}
Jul 22 03:35:10.590073 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:10.590038    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:11.203048 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.202833    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:11.289230 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.289026    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:11.309586 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.309558    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6557d747f9-xxjcg"]
Jul 22 03:35:11.328855 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.328638    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6557d747f9-xxjcg"]
Jul 22 03:35:11.328855 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.328785    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.331965 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.331937    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 22 03:35:11.332226 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.332198    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 22 03:35:11.332362 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.332315    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 22 03:35:11.332546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.332526    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b7n7ja7atkjff\""
Jul 22 03:35:11.332803 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.332780    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 22 03:35:11.332891 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.332821    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 22 03:35:11.333711 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.333683    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vcs55\""
Jul 22 03:35:11.389560 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.389525    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:11.401499 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.401470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-tls\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.401660 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.401508    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-grpc-tls\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.401660 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.401539    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.401660 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.401613    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.401816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.401658    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-metrics-client-ca\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.401816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.401684    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbwrx\" (UniqueName: \"kubernetes.io/projected/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-kube-api-access-sbwrx\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.401816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.401703    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.401816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.401720    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.490814 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.490782    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:11.502853 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.502819    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-tls\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.502970 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.502863    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-grpc-tls\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.502970 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.502885    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.503104 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.503079    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.503151 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.503124    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-metrics-client-ca\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.503200 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.503154    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbwrx\" (UniqueName: \"kubernetes.io/projected/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-kube-api-access-sbwrx\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.503564 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.503188    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.503739 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.503600    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.504135 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.504079    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-metrics-client-ca\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.505841 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.505820    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.506254 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.506231    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.506357 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.506241    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-tls\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.506357 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.506304    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.506528 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.506506    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.507409 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.507394    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-secret-grpc-tls\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.512743 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.512723    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbwrx\" (UniqueName: \"kubernetes.io/projected/0ea4abeb-e2a3-4092-bbb7-b90550c38d34-kube-api-access-sbwrx\") pod \"thanos-querier-6557d747f9-xxjcg\" (UID: \"0ea4abeb-e2a3-4092-bbb7-b90550c38d34\") " pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.642259 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.642206    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:11.775027 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.774981    2569 generic.go:356] "Generic (PLEG): container finished" podID="db3a67a4-6a4e-4f60-82f4-5394cf4143fd" containerID="2e0f55e321ca5c09350d00b5dbfe3bb9c1f378ee1813f56cbb55c3f620079be6" exitCode=0
Jul 22 03:35:11.775213 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.775067    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6fbf" event={"ID":"db3a67a4-6a4e-4f60-82f4-5394cf4143fd","Type":"ContainerDied","Data":"2e0f55e321ca5c09350d00b5dbfe3bb9c1f378ee1813f56cbb55c3f620079be6"}
Jul 22 03:35:11.777709 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.777678    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x" event={"ID":"462adc24-058d-4874-80a9-ce19d3273cb8","Type":"ContainerStarted","Data":"7b6f7acd59b2d54bbe702579d2ea50f108e0cb48d3fa1596ac7ccafb071285d8"}
Jul 22 03:35:11.777852 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.777740    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x" event={"ID":"462adc24-058d-4874-80a9-ce19d3273cb8","Type":"ContainerStarted","Data":"77aaeaee443f40274101f206902723ab4342fb51f0afb89e63cc6f2d09575355"}
Jul 22 03:35:11.777852 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.777796    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x" event={"ID":"462adc24-058d-4874-80a9-ce19d3273cb8","Type":"ContainerStarted","Data":"c97282daecf71d8795cd05fa00fc0fffa67172d15c3324676e074c8457007d20"}
Jul 22 03:35:11.801947 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.801913    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6557d747f9-xxjcg"]
Jul 22 03:35:11.809729 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:35:11.809704    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea4abeb_e2a3_4092_bbb7_b90550c38d34.slice/crio-d13f0289ce05fecfe1687c59049724c0f49f9973f22d3d84b3f15082c192c9db WatchSource:0}: Error finding container d13f0289ce05fecfe1687c59049724c0f49f9973f22d3d84b3f15082c192c9db: Status 404 returned error can't find the container with id d13f0289ce05fecfe1687c59049724c0f49f9973f22d3d84b3f15082c192c9db
Jul 22 03:35:11.818705 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:11.818629    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-drd6x" podStartSLOduration=1.60982934 podStartE2EDuration="3.818607467s" totalImagesPullingTime="2.208778127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:35:11.81732841 +0000 UTC m=+88.984563077" watchObservedRunningTime="2026-07-22 03:35:11.818607467 +0000 UTC m=+88.985842134"
Jul 22 03:35:12.541212 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.541164    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6f98474868-w5kkg"]
Jul 22 03:35:12.543626 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.543603    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.548618 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.548588    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 03:35:12.549829 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.549805    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 22 03:35:12.550143 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.550118    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 22 03:35:12.550351 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.550334    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7u0kekj7pj453\""
Jul 22 03:35:12.550759 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.550740    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 22 03:35:12.551147 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.551126    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-z672q\""
Jul 22 03:35:12.557078 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.557049    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f98474868-w5kkg"]
Jul 22 03:35:12.616066 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.616034    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/47dafcd3-ccee-4898-9492-9f74d6fecd7c-audit-log\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.616235 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.616072    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/47dafcd3-ccee-4898-9492-9f74d6fecd7c-secret-metrics-server-client-certs\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.616235 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.616092    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/47dafcd3-ccee-4898-9492-9f74d6fecd7c-secret-metrics-server-tls\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.616235 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.616183    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47dafcd3-ccee-4898-9492-9f74d6fecd7c-client-ca-bundle\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.616235 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.616210    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/47dafcd3-ccee-4898-9492-9f74d6fecd7c-metrics-server-audit-profiles\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.616235 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.616233    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtlvn\" (UniqueName: \"kubernetes.io/projected/47dafcd3-ccee-4898-9492-9f74d6fecd7c-kube-api-access-gtlvn\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.616420 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.616263    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47dafcd3-ccee-4898-9492-9f74d6fecd7c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.717658 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.717618    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/47dafcd3-ccee-4898-9492-9f74d6fecd7c-secret-metrics-server-tls\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.718117 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.717698    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47dafcd3-ccee-4898-9492-9f74d6fecd7c-client-ca-bundle\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.718117 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.717729    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/47dafcd3-ccee-4898-9492-9f74d6fecd7c-metrics-server-audit-profiles\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.718117 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.717766    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtlvn\" (UniqueName: \"kubernetes.io/projected/47dafcd3-ccee-4898-9492-9f74d6fecd7c-kube-api-access-gtlvn\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.718117 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.717804    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47dafcd3-ccee-4898-9492-9f74d6fecd7c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.718117 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.717868    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/47dafcd3-ccee-4898-9492-9f74d6fecd7c-audit-log\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.718117 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.717895    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/47dafcd3-ccee-4898-9492-9f74d6fecd7c-secret-metrics-server-client-certs\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.718441 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.718314    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/47dafcd3-ccee-4898-9492-9f74d6fecd7c-audit-log\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.718691 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.718560    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/47dafcd3-ccee-4898-9492-9f74d6fecd7c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.718817 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.718799    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/47dafcd3-ccee-4898-9492-9f74d6fecd7c-metrics-server-audit-profiles\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.720297 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.720276    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/47dafcd3-ccee-4898-9492-9f74d6fecd7c-secret-metrics-server-client-certs\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.720735 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.720713    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/47dafcd3-ccee-4898-9492-9f74d6fecd7c-client-ca-bundle\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.720835 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.720789    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/47dafcd3-ccee-4898-9492-9f74d6fecd7c-secret-metrics-server-tls\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.726774 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.726753    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtlvn\" (UniqueName: \"kubernetes.io/projected/47dafcd3-ccee-4898-9492-9f74d6fecd7c-kube-api-access-gtlvn\") pod \"metrics-server-6f98474868-w5kkg\" (UID: \"47dafcd3-ccee-4898-9492-9f74d6fecd7c\") " pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.730812 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.730788    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:12.783393 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.783364    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg" event={"ID":"0ea4abeb-e2a3-4092-bbb7-b90550c38d34","Type":"ContainerStarted","Data":"d13f0289ce05fecfe1687c59049724c0f49f9973f22d3d84b3f15082c192c9db"}
Jul 22 03:35:12.785543 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.785513    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6fbf" event={"ID":"db3a67a4-6a4e-4f60-82f4-5394cf4143fd","Type":"ContainerStarted","Data":"2cffe4dffb67faca4e8f424cac37df90721e147de9a76e1098ab8d141579d7fe"}
Jul 22 03:35:12.785661 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.785577    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-b6fbf" event={"ID":"db3a67a4-6a4e-4f60-82f4-5394cf4143fd","Type":"ContainerStarted","Data":"a7db9fa5fb9d6830574a21458d7a7fbc894d5bcf3f73b7b2bbe2b7466c044565"}
Jul 22 03:35:12.808662 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.806318    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-b6fbf" podStartSLOduration=3.015635751 podStartE2EDuration="4.806298163s" totalImagesPullingTime="1.669389696s" totalInitContainerRuntime="121.272716ms" isStatefulPod=true podCreationTimestamp="2026-07-22 03:35:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:35:12.804263941 +0000 UTC m=+89.971498616" watchObservedRunningTime="2026-07-22 03:35:12.806298163 +0000 UTC m=+89.973532828"
Jul 22 03:35:12.836235 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.836184    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:12.857135 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.857099    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:12.894999 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:12.894960    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:13.000619 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:13.000510    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f98474868-w5kkg"]
Jul 22 03:35:13.007816 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:35:13.007788    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47dafcd3_ccee_4898_9492_9f74d6fecd7c.slice/crio-15a6b38533403e71ceb1d6ae1a94d6d77c2713344c78668a9a27c0f3487eb46d WatchSource:0}: Error finding container 15a6b38533403e71ceb1d6ae1a94d6d77c2713344c78668a9a27c0f3487eb46d: Status 404 returned error can't find the container with id 15a6b38533403e71ceb1d6ae1a94d6d77c2713344c78668a9a27c0f3487eb46d
Jul 22 03:35:13.029266 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:13.029240    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:13.106159 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:13.106066    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:13.478104 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:13.478076    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:13.579266 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:13.579226    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:13.679963 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:13.679865    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:13.791816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:13.791732    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f98474868-w5kkg" event={"ID":"47dafcd3-ccee-4898-9492-9f74d6fecd7c","Type":"ContainerStarted","Data":"15a6b38533403e71ceb1d6ae1a94d6d77c2713344c78668a9a27c0f3487eb46d"}
Jul 22 03:35:14.489324 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:14.489286    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:14.566924 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:14.566727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:14.799203 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:14.798872    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg" event={"ID":"0ea4abeb-e2a3-4092-bbb7-b90550c38d34","Type":"ContainerStarted","Data":"810a1ccd69d4a457110306149653203024d4fa9345cb635d6a9c7adf35be09f3"}
Jul 22 03:35:14.799203 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:14.798958    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg" event={"ID":"0ea4abeb-e2a3-4092-bbb7-b90550c38d34","Type":"ContainerStarted","Data":"866f85171b484ec0c540464db14dd61a23ce73dcd018a47f121d2087e55a017e"}
Jul 22 03:35:14.800673 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:14.800629    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f98474868-w5kkg" event={"ID":"47dafcd3-ccee-4898-9492-9f74d6fecd7c","Type":"ContainerStarted","Data":"3ae5b9a089596d426b00f89243ec4a772d3c280b53fad697a185ac309d7e56d9"}
Jul 22 03:35:14.819608 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:14.819525    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6f98474868-w5kkg" podStartSLOduration=1.158956809 podStartE2EDuration="2.819505353s" totalImagesPullingTime="1.660548544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:35:14.817994497 +0000 UTC m=+91.985229161" watchObservedRunningTime="2026-07-22 03:35:14.819505353 +0000 UTC m=+91.986740020"
Jul 22 03:35:15.806630 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:15.806592    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg" event={"ID":"0ea4abeb-e2a3-4092-bbb7-b90550c38d34","Type":"ContainerStarted","Data":"b3044143dc26c8ef9e89bffd34e22539658909d5c49606c1c7c64f06cfb92ae6"}
Jul 22 03:35:16.812406 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:16.812371    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg" event={"ID":"0ea4abeb-e2a3-4092-bbb7-b90550c38d34","Type":"ContainerStarted","Data":"ac5d5618cde310311a8d954b69faffdfdb78becf9fb2b70da08b5bebffd9feea"}
Jul 22 03:35:16.812816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:16.812435    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg" event={"ID":"0ea4abeb-e2a3-4092-bbb7-b90550c38d34","Type":"ContainerStarted","Data":"8d7bc2529fd8cfc478d1f3a90cfa1101e3c42280e1fc57a317b3f440b514ede2"}
Jul 22 03:35:16.812816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:16.812461    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg" event={"ID":"0ea4abeb-e2a3-4092-bbb7-b90550c38d34","Type":"ContainerStarted","Data":"ea1fd6004b74bdbdd382e11605a34bc0f6ced13745cc59ae9e26be43220d2b40"}
Jul 22 03:35:16.812816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:16.812529    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:16.837151 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:16.837110    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg" podStartSLOduration=2.024667455 podStartE2EDuration="5.837097236s" totalImagesPullingTime="3.812429781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:35:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:35:16.835860149 +0000 UTC m=+94.003094814" watchObservedRunningTime="2026-07-22 03:35:16.837097236 +0000 UTC m=+94.004331905"
Jul 22 03:35:19.613863 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:19.613829    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:19.713136 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:19.713099    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:22.145753 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:22.145697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:22.246623 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:22.246579    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:22.301025 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:22.300984    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:22.823043 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:22.822972    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6557d747f9-xxjcg"
Jul 22 03:35:25.379175 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:25.379136    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:25.442143 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:25.442108    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:25.502081 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:25.502009    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:26.725531 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:26.725503    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lfnb9"
Jul 22 03:35:32.857377 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:32.857337    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:32.857795 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:32.857400    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:43.485683 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:43.485628    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:43.548698 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:43.548664    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:35:52.862666 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:52.862616    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:35:52.866510 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:35:52.866487    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6f98474868-w5kkg"
Jul 22 03:36:27.583858 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:27.583808    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:27.760328 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:27.760296    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:36.391239 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:36.391143    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:36.511461 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:36.511426    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:36.585773 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:36.585738    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:37.103503 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:37.103451    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:42.784925 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:42.784891    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:42.886121 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:42.886064    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:54.744345 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:54.744309    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:54.799943 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:54.799907    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:58.485983 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:58.485942    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:58.602226 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:58.602193    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:58.777413 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:58.777316    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:58.877762 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:58.877723    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:58.976989 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:58.976950    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:36:59.041700 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:36:59.041573    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:37:08.982680 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:37:08.982609    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:37:18.033561 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:37:18.033520    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:37:18.092733 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:37:18.092693    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:37:38.653765 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:37:38.653730    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:37:38.751653 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:37:38.751605    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:05.451964 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:05.451880    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:06.325936 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:06.325903    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:07.421100 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.421065    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9"]
Jul 22 03:38:07.423394 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.423369    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9"
Jul 22 03:38:07.429455 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.429433    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tbl5t\""
Jul 22 03:38:07.430162 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.430144    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 22 03:38:07.430389 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.430373    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:38:07.440834 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.440803    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcxtd\" (UniqueName: \"kubernetes.io/projected/925b4900-9f83-4c8a-806d-37139e0bc6ca-kube-api-access-jcxtd\") pod \"cert-manager-operator-controller-manager-55c444bf86-ht9c9\" (UID: \"925b4900-9f83-4c8a-806d-37139e0bc6ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9"
Jul 22 03:38:07.440963 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.440918    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/925b4900-9f83-4c8a-806d-37139e0bc6ca-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ht9c9\" (UID: \"925b4900-9f83-4c8a-806d-37139e0bc6ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9"
Jul 22 03:38:07.441019 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.440958    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9"]
Jul 22 03:38:07.541543 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.541508    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/925b4900-9f83-4c8a-806d-37139e0bc6ca-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ht9c9\" (UID: \"925b4900-9f83-4c8a-806d-37139e0bc6ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9"
Jul 22 03:38:07.541741 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.541560    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcxtd\" (UniqueName: \"kubernetes.io/projected/925b4900-9f83-4c8a-806d-37139e0bc6ca-kube-api-access-jcxtd\") pod \"cert-manager-operator-controller-manager-55c444bf86-ht9c9\" (UID: \"925b4900-9f83-4c8a-806d-37139e0bc6ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9"
Jul 22 03:38:07.541899 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.541883    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/925b4900-9f83-4c8a-806d-37139e0bc6ca-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ht9c9\" (UID: \"925b4900-9f83-4c8a-806d-37139e0bc6ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9"
Jul 22 03:38:07.550198 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.550175    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcxtd\" (UniqueName: \"kubernetes.io/projected/925b4900-9f83-4c8a-806d-37139e0bc6ca-kube-api-access-jcxtd\") pod \"cert-manager-operator-controller-manager-55c444bf86-ht9c9\" (UID: \"925b4900-9f83-4c8a-806d-37139e0bc6ca\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9"
Jul 22 03:38:07.732620 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.732570    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9"
Jul 22 03:38:07.868440 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:07.868410    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9"]
Jul 22 03:38:07.872019 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:38:07.871996    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod925b4900_9f83_4c8a_806d_37139e0bc6ca.slice/crio-259ecf7c789c911bc8cd72511e35d791c7939270065501fdcbb4af3b9d62dbab WatchSource:0}: Error finding container 259ecf7c789c911bc8cd72511e35d791c7939270065501fdcbb4af3b9d62dbab: Status 404 returned error can't find the container with id 259ecf7c789c911bc8cd72511e35d791c7939270065501fdcbb4af3b9d62dbab
Jul 22 03:38:08.368466 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:08.368423    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:08.430683 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:08.430625    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9" event={"ID":"925b4900-9f83-4c8a-806d-37139e0bc6ca","Type":"ContainerStarted","Data":"259ecf7c789c911bc8cd72511e35d791c7939270065501fdcbb4af3b9d62dbab"}
Jul 22 03:38:09.459267 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:09.459232    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:09.514294 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:09.514261    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:11.391156 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:11.391103    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:11.443007 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:11.442961    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9" event={"ID":"925b4900-9f83-4c8a-806d-37139e0bc6ca","Type":"ContainerStarted","Data":"1a52747167870eb0629c0e95b352b3522b6b0a4118b99509c8409c31279ffb88"}
Jul 22 03:38:11.467441 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:11.467381    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ht9c9" podStartSLOduration=1.7126744390000002 podStartE2EDuration="4.467365403s" totalImagesPullingTime="2.754690964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:38:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:38:11.464892444 +0000 UTC m=+268.632127133" watchObservedRunningTime="2026-07-22 03:38:11.467365403 +0000 UTC m=+268.634600067"
Jul 22 03:38:11.491395 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:11.491358    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:11.836188 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:11.836153    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:11.936758 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:11.936724    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:13.857078 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:13.857034    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:14.031364 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:14.031325    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:16.057862 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:16.057823    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:16.464980 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:16.464941    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:16.567098 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:16.567066    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:18.362807 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.362773    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p"]
Jul 22 03:38:18.366078 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.366062    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p"
Jul 22 03:38:18.368676 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.368655    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 22 03:38:18.368676 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.368664    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 22 03:38:18.369555 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.369535    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-zgw2n\""
Jul 22 03:38:18.373732 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.373709    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p"]
Jul 22 03:38:18.415427 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.415386    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6258373-88e0-42aa-a45c-6ab273f2f2d3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kgf9p\" (UID: \"b6258373-88e0-42aa-a45c-6ab273f2f2d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p"
Jul 22 03:38:18.415674 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.415457    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbx74\" (UniqueName: \"kubernetes.io/projected/b6258373-88e0-42aa-a45c-6ab273f2f2d3-kube-api-access-hbx74\") pod \"cert-manager-cainjector-559cdd8c87-kgf9p\" (UID: \"b6258373-88e0-42aa-a45c-6ab273f2f2d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p"
Jul 22 03:38:18.516787 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.516753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbx74\" (UniqueName: \"kubernetes.io/projected/b6258373-88e0-42aa-a45c-6ab273f2f2d3-kube-api-access-hbx74\") pod \"cert-manager-cainjector-559cdd8c87-kgf9p\" (UID: \"b6258373-88e0-42aa-a45c-6ab273f2f2d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p"
Jul 22 03:38:18.516963 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.516820    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6258373-88e0-42aa-a45c-6ab273f2f2d3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kgf9p\" (UID: \"b6258373-88e0-42aa-a45c-6ab273f2f2d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p"
Jul 22 03:38:18.526379 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.526348    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b6258373-88e0-42aa-a45c-6ab273f2f2d3-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kgf9p\" (UID: \"b6258373-88e0-42aa-a45c-6ab273f2f2d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p"
Jul 22 03:38:18.526605 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.526588    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbx74\" (UniqueName: \"kubernetes.io/projected/b6258373-88e0-42aa-a45c-6ab273f2f2d3-kube-api-access-hbx74\") pod \"cert-manager-cainjector-559cdd8c87-kgf9p\" (UID: \"b6258373-88e0-42aa-a45c-6ab273f2f2d3\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p"
Jul 22 03:38:18.675723 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.675610    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p"
Jul 22 03:38:18.803807 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:18.803782    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p"]
Jul 22 03:38:18.806196 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:38:18.806159    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6258373_88e0_42aa_a45c_6ab273f2f2d3.slice/crio-60ca86917533308debb2fcee9c7a0403003e78e719557c6a72ee27150fd01fa9 WatchSource:0}: Error finding container 60ca86917533308debb2fcee9c7a0403003e78e719557c6a72ee27150fd01fa9: Status 404 returned error can't find the container with id 60ca86917533308debb2fcee9c7a0403003e78e719557c6a72ee27150fd01fa9
Jul 22 03:38:19.473607 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:19.473573    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p" event={"ID":"b6258373-88e0-42aa-a45c-6ab273f2f2d3","Type":"ContainerStarted","Data":"60ca86917533308debb2fcee9c7a0403003e78e719557c6a72ee27150fd01fa9"}
Jul 22 03:38:21.398068 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:21.398027    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:22.224421 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:22.224386    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:22.286864 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:22.286828    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:22.486621 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:22.486528    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p" event={"ID":"b6258373-88e0-42aa-a45c-6ab273f2f2d3","Type":"ContainerStarted","Data":"65bf6e96d1397923717c7f8a312eaaabc30317243a8da47ae814a1f61e641a05"}
Jul 22 03:38:22.502339 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:22.502274    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kgf9p" podStartSLOduration=1.8623805089999999 podStartE2EDuration="4.502255736s" totalImagesPullingTime="2.639875227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:38:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:38:22.501989625 +0000 UTC m=+279.669224311" watchObservedRunningTime="2026-07-22 03:38:22.502255736 +0000 UTC m=+279.669490401"
Jul 22 03:38:22.871886 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:22.871798    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:22.973042 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:22.973012    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:25.140175 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.140140    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7"]
Jul 22 03:38:25.142426 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.142408    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7"
Jul 22 03:38:25.147175 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.147146    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-mdrg4\""
Jul 22 03:38:25.147175 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.147165    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 03:38:25.147375 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.147146    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 03:38:25.158913 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.158886    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7"]
Jul 22 03:38:25.168027 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.167991    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncqmh\" (UniqueName: \"kubernetes.io/projected/f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5-kube-api-access-ncqmh\") pod \"openshift-lws-operator-fd8ccff4c-9p9l7\" (UID: \"f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7"
Jul 22 03:38:25.168163 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.168082    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9p9l7\" (UID: \"f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7"
Jul 22 03:38:25.268963 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.268923    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncqmh\" (UniqueName: \"kubernetes.io/projected/f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5-kube-api-access-ncqmh\") pod \"openshift-lws-operator-fd8ccff4c-9p9l7\" (UID: \"f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7"
Jul 22 03:38:25.269139 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.268984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9p9l7\" (UID: \"f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7"
Jul 22 03:38:25.269301 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.269286    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9p9l7\" (UID: \"f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7"
Jul 22 03:38:25.279132 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.279106    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncqmh\" (UniqueName: \"kubernetes.io/projected/f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5-kube-api-access-ncqmh\") pod \"openshift-lws-operator-fd8ccff4c-9p9l7\" (UID: \"f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7"
Jul 22 03:38:25.451929 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.451904    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7"
Jul 22 03:38:25.591118 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:25.591095    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7"]
Jul 22 03:38:25.593143 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:38:25.593119    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf3e32c65_0d5c_45f7_bd2e_46cc0d6102b5.slice/crio-3225aa1586cb6220d9ea31dca3a06b568624c0931e0e6af945eb6080a4544f79 WatchSource:0}: Error finding container 3225aa1586cb6220d9ea31dca3a06b568624c0931e0e6af945eb6080a4544f79: Status 404 returned error can't find the container with id 3225aa1586cb6220d9ea31dca3a06b568624c0931e0e6af945eb6080a4544f79
Jul 22 03:38:26.504943 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:26.504897    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7" event={"ID":"f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5","Type":"ContainerStarted","Data":"3225aa1586cb6220d9ea31dca3a06b568624c0931e0e6af945eb6080a4544f79"}
Jul 22 03:38:28.513807 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:28.513767    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7" event={"ID":"f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5","Type":"ContainerStarted","Data":"58faefa575a21bc7a6d731c78d5c4f1df0a9363f5073892b2a2a183944b6992d"}
Jul 22 03:38:28.532015 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:28.531971    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9p9l7" podStartSLOduration=1.038667116 podStartE2EDuration="3.53195712s" totalImagesPullingTime="2.493290004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:38:28.530323423 +0000 UTC m=+285.697558087" watchObservedRunningTime="2026-07-22 03:38:28.53195712 +0000 UTC m=+285.699191788"
Jul 22 03:38:29.220078 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:29.220043    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:29.319403 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:29.319354    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:31.571320 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:31.571286    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:43.228062 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:43.228029    2569 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 03:38:43.853352 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:43.853320    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:44.892855 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:44.892822    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"]
Jul 22 03:38:44.896325 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:44.896298    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:44.899443 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:44.899418    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 03:38:44.899753 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:44.899729    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 03:38:44.900097 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:44.900076    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 03:38:44.900186 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:44.900094    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 03:38:44.900439 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:44.900425    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qfwz9\""
Jul 22 03:38:44.923421 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:44.923383    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"]
Jul 22 03:38:45.037564 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.037537    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-tmp\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.037785 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.037583    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.037785 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.037583    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:45.037785 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.037628    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-manifests\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.037785 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.037672    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.037967 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.037794    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzs8r\" (UniqueName: \"kubernetes.io/projected/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-kube-api-access-fzs8r\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.138414 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.138379    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-tmp\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.138585 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.138423    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.138585 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.138550    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-manifests\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.138706 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.138590    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.138756 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.138714    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzs8r\" (UniqueName: \"kubernetes.io/projected/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-kube-api-access-fzs8r\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.138969 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.138928    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-manifests\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.141397 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.141367    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-tmp\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.141510 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.141497    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-webhook-cert\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.141551 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.141512    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.149848 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.149777    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzs8r\" (UniqueName: \"kubernetes.io/projected/9a7a3c4a-26e5-46dc-b84c-1c00cba9b962-kube-api-access-fzs8r\") pod \"opendatahub-operator-controller-manager-5fd47b996b-sfxjh\" (UID: \"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962\") " pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.176528 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.176488    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:45.206587 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.206551    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:45.278576 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.278544    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:45.350526 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.350495    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"]
Jul 22 03:38:45.354036 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:38:45.354012    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7a3c4a_26e5_46dc_b84c_1c00cba9b962.slice/crio-fb63229e83c360d28ce7e21dc983d7ebc2760482c7d4aef45daaf11a10051366 WatchSource:0}: Error finding container fb63229e83c360d28ce7e21dc983d7ebc2760482c7d4aef45daaf11a10051366: Status 404 returned error can't find the container with id fb63229e83c360d28ce7e21dc983d7ebc2760482c7d4aef45daaf11a10051366
Jul 22 03:38:45.355942 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.355921    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:38:45.357071 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.357024    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:45.450918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.450872    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:45.550979 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.550945    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:45.586004 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.585973    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh" event={"ID":"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962","Type":"ContainerStarted","Data":"fb63229e83c360d28ce7e21dc983d7ebc2760482c7d4aef45daaf11a10051366"}
Jul 22 03:38:45.650487 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:45.650446    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:48.601987 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:48.601953    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh" event={"ID":"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962","Type":"ContainerStarted","Data":"a36dd8cd9815fa291a30989a8821b271b27f490003b245c666072d407cf8fd42"}
Jul 22 03:38:49.608288 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:49.608250    2569 generic.go:356] "Generic (PLEG): container finished" podID="9a7a3c4a-26e5-46dc-b84c-1c00cba9b962" containerID="a36dd8cd9815fa291a30989a8821b271b27f490003b245c666072d407cf8fd42" exitCode=0
Jul 22 03:38:49.608743 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:49.608333    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh" event={"ID":"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962","Type":"ContainerDied","Data":"a36dd8cd9815fa291a30989a8821b271b27f490003b245c666072d407cf8fd42"}
Jul 22 03:38:50.615076 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:50.615046    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh" event={"ID":"9a7a3c4a-26e5-46dc-b84c-1c00cba9b962","Type":"ContainerStarted","Data":"5ac82cb4b1f83aa21d62acf24c64cd24f45f82f9a417555cc0d3066b04b152e0"}
Jul 22 03:38:50.615498 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:50.615179    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:38:50.636181 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:50.636132    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh" podStartSLOduration=2.225014044 podStartE2EDuration="6.636114424s" totalImagesPullingTime="3.342153422s" totalInitContainerRuntime="1.068946958s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:38:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:38:50.634967878 +0000 UTC m=+307.802202542" watchObservedRunningTime="2026-07-22 03:38:50.636114424 +0000 UTC m=+307.803349087"
Jul 22 03:38:56.048785 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:56.048749    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:38:56.167959 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:38:56.167920    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:00.751467 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:00.751430    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:00.850592 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:00.850557    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:01.621604 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:01.621567    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5fd47b996b-sfxjh"
Jul 22 03:39:04.338519 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:04.338482    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:04.467975 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:04.467937    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:10.285411 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.285371    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:10.366127 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.366095    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"]
Jul 22 03:39:10.368561 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.368536    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"
Jul 22 03:39:10.375632 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.375609    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 03:39:10.375765 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.375699    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 03:39:10.380536 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.380512    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 03:39:10.380676 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.380518    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 03:39:10.381038 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.381024    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5dp79\""
Jul 22 03:39:10.400202 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.400181    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"]
Jul 22 03:39:10.453988 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.453955    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5460c5c2-bd2c-4093-94e0-5266fc561fca-tls-certs\") pod \"kube-auth-proxy-5bd5997d8b-4lt5q\" (UID: \"5460c5c2-bd2c-4093-94e0-5266fc561fca\") " pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"
Jul 22 03:39:10.454158 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.453994    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4p88\" (UniqueName: \"kubernetes.io/projected/5460c5c2-bd2c-4093-94e0-5266fc561fca-kube-api-access-g4p88\") pod \"kube-auth-proxy-5bd5997d8b-4lt5q\" (UID: \"5460c5c2-bd2c-4093-94e0-5266fc561fca\") " pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"
Jul 22 03:39:10.454158 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.454031    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5460c5c2-bd2c-4093-94e0-5266fc561fca-tmp\") pod \"kube-auth-proxy-5bd5997d8b-4lt5q\" (UID: \"5460c5c2-bd2c-4093-94e0-5266fc561fca\") " pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"
Jul 22 03:39:10.478249 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.478220    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:10.501470 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.501430    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hgp9l"]
Jul 22 03:39:10.503928 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.503903    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l"
Jul 22 03:39:10.506532 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.506506    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 22 03:39:10.506686 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.506537    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vpkht\""
Jul 22 03:39:10.518429 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.518401    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hgp9l"]
Jul 22 03:39:10.555239 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.555152    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5460c5c2-bd2c-4093-94e0-5266fc561fca-tmp\") pod \"kube-auth-proxy-5bd5997d8b-4lt5q\" (UID: \"5460c5c2-bd2c-4093-94e0-5266fc561fca\") " pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"
Jul 22 03:39:10.555239 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.555223    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn82s\" (UniqueName: \"kubernetes.io/projected/f9e07c01-5fbe-4d80-94a1-2771fb06b0fd-kube-api-access-tn82s\") pod \"odh-model-controller-7998c67dc4-hgp9l\" (UID: \"f9e07c01-5fbe-4d80-94a1-2771fb06b0fd\") " pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l"
Jul 22 03:39:10.555463 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.555291    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5460c5c2-bd2c-4093-94e0-5266fc561fca-tls-certs\") pod \"kube-auth-proxy-5bd5997d8b-4lt5q\" (UID: \"5460c5c2-bd2c-4093-94e0-5266fc561fca\") " pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"
Jul 22 03:39:10.555463 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.555349    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4p88\" (UniqueName: \"kubernetes.io/projected/5460c5c2-bd2c-4093-94e0-5266fc561fca-kube-api-access-g4p88\") pod \"kube-auth-proxy-5bd5997d8b-4lt5q\" (UID: \"5460c5c2-bd2c-4093-94e0-5266fc561fca\") " pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"
Jul 22 03:39:10.555463 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.555380    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9e07c01-5fbe-4d80-94a1-2771fb06b0fd-cert\") pod \"odh-model-controller-7998c67dc4-hgp9l\" (UID: \"f9e07c01-5fbe-4d80-94a1-2771fb06b0fd\") " pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l"
Jul 22 03:39:10.557846 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.557820    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5460c5c2-bd2c-4093-94e0-5266fc561fca-tmp\") pod \"kube-auth-proxy-5bd5997d8b-4lt5q\" (UID: \"5460c5c2-bd2c-4093-94e0-5266fc561fca\") " pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"
Jul 22 03:39:10.558060 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.558042    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5460c5c2-bd2c-4093-94e0-5266fc561fca-tls-certs\") pod \"kube-auth-proxy-5bd5997d8b-4lt5q\" (UID: \"5460c5c2-bd2c-4093-94e0-5266fc561fca\") " pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"
Jul 22 03:39:10.568459 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.568430    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4p88\" (UniqueName: \"kubernetes.io/projected/5460c5c2-bd2c-4093-94e0-5266fc561fca-kube-api-access-g4p88\") pod \"kube-auth-proxy-5bd5997d8b-4lt5q\" (UID: \"5460c5c2-bd2c-4093-94e0-5266fc561fca\") " pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"
Jul 22 03:39:10.587600 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.587561    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:10.656018 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.655984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9e07c01-5fbe-4d80-94a1-2771fb06b0fd-cert\") pod \"odh-model-controller-7998c67dc4-hgp9l\" (UID: \"f9e07c01-5fbe-4d80-94a1-2771fb06b0fd\") " pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l"
Jul 22 03:39:10.656205 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.656036    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn82s\" (UniqueName: \"kubernetes.io/projected/f9e07c01-5fbe-4d80-94a1-2771fb06b0fd-kube-api-access-tn82s\") pod \"odh-model-controller-7998c67dc4-hgp9l\" (UID: \"f9e07c01-5fbe-4d80-94a1-2771fb06b0fd\") " pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l"
Jul 22 03:39:10.656205 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:39:10.656153    2569 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 22 03:39:10.656325 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:39:10.656227    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e07c01-5fbe-4d80-94a1-2771fb06b0fd-cert podName:f9e07c01-5fbe-4d80-94a1-2771fb06b0fd nodeName:}" failed. No retries permitted until 2026-07-22 03:39:11.156205939 +0000 UTC m=+328.323440610 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f9e07c01-5fbe-4d80-94a1-2771fb06b0fd-cert") pod "odh-model-controller-7998c67dc4-hgp9l" (UID: "f9e07c01-5fbe-4d80-94a1-2771fb06b0fd") : secret "odh-model-controller-webhook-cert" not found
Jul 22 03:39:10.664789 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.664767    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn82s\" (UniqueName: \"kubernetes.io/projected/f9e07c01-5fbe-4d80-94a1-2771fb06b0fd-kube-api-access-tn82s\") pod \"odh-model-controller-7998c67dc4-hgp9l\" (UID: \"f9e07c01-5fbe-4d80-94a1-2771fb06b0fd\") " pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l"
Jul 22 03:39:10.678755 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.678728    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"
Jul 22 03:39:10.688112 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.688068    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:10.788688 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.788607    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:10.847768 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:10.847734    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q"]
Jul 22 03:39:10.850785 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:39:10.850751    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5460c5c2_bd2c_4093_94e0_5266fc561fca.slice/crio-8799a30c62a401dfefff52082d76d94f7ce415886df12148a4dd7301aaebb9f2 WatchSource:0}: Error finding container 8799a30c62a401dfefff52082d76d94f7ce415886df12148a4dd7301aaebb9f2: Status 404 returned error can't find the container with id 8799a30c62a401dfefff52082d76d94f7ce415886df12148a4dd7301aaebb9f2
Jul 22 03:39:11.072477 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.072440    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:11.160343 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.160215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9e07c01-5fbe-4d80-94a1-2771fb06b0fd-cert\") pod \"odh-model-controller-7998c67dc4-hgp9l\" (UID: \"f9e07c01-5fbe-4d80-94a1-2771fb06b0fd\") " pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l"
Jul 22 03:39:11.163336 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.163297    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f9e07c01-5fbe-4d80-94a1-2771fb06b0fd-cert\") pod \"odh-model-controller-7998c67dc4-hgp9l\" (UID: \"f9e07c01-5fbe-4d80-94a1-2771fb06b0fd\") " pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l"
Jul 22 03:39:11.252977 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.252939    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rkj2h"]
Jul 22 03:39:11.256964 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.256940    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h"
Jul 22 03:39:11.260861 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.260835    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 22 03:39:11.272045 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.271962    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:11.283793 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.283763    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rkj2h"]
Jul 22 03:39:11.362158 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.362100    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5086d01-4a12-4690-ba79-18d6d3573172-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkj2h\" (UID: \"c5086d01-4a12-4690-ba79-18d6d3573172\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h"
Jul 22 03:39:11.362158 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.362159    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzqcq\" (UniqueName: \"kubernetes.io/projected/c5086d01-4a12-4690-ba79-18d6d3573172-kube-api-access-rzqcq\") pod \"model-serving-api-54d89bd5fc-rkj2h\" (UID: \"c5086d01-4a12-4690-ba79-18d6d3573172\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h"
Jul 22 03:39:11.376776 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.376736    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:11.416018 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.415835    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l"
Jul 22 03:39:11.462825 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.462784    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5086d01-4a12-4690-ba79-18d6d3573172-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkj2h\" (UID: \"c5086d01-4a12-4690-ba79-18d6d3573172\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h"
Jul 22 03:39:11.463165 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.462843    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzqcq\" (UniqueName: \"kubernetes.io/projected/c5086d01-4a12-4690-ba79-18d6d3573172-kube-api-access-rzqcq\") pod \"model-serving-api-54d89bd5fc-rkj2h\" (UID: \"c5086d01-4a12-4690-ba79-18d6d3573172\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h"
Jul 22 03:39:11.466460 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.466431    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5086d01-4a12-4690-ba79-18d6d3573172-tls-certs\") pod \"model-serving-api-54d89bd5fc-rkj2h\" (UID: \"c5086d01-4a12-4690-ba79-18d6d3573172\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h"
Jul 22 03:39:11.477407 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.477383    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzqcq\" (UniqueName: \"kubernetes.io/projected/c5086d01-4a12-4690-ba79-18d6d3573172-kube-api-access-rzqcq\") pod \"model-serving-api-54d89bd5fc-rkj2h\" (UID: \"c5086d01-4a12-4690-ba79-18d6d3573172\") " pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h"
Jul 22 03:39:11.569302 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.569270    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h"
Jul 22 03:39:11.621179 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.621097    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hgp9l"]
Jul 22 03:39:11.704915 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.704833    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l" event={"ID":"f9e07c01-5fbe-4d80-94a1-2771fb06b0fd","Type":"ContainerStarted","Data":"bff0580123eb73499b388ec6320f841fd05e208f74e3a9ff8f889327b906314c"}
Jul 22 03:39:11.706624 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.706591    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q" event={"ID":"5460c5c2-bd2c-4093-94e0-5266fc561fca","Type":"ContainerStarted","Data":"8799a30c62a401dfefff52082d76d94f7ce415886df12148a4dd7301aaebb9f2"}
Jul 22 03:39:11.743204 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.743172    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-rkj2h"]
Jul 22 03:39:11.747374 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:39:11.747342    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5086d01_4a12_4690_ba79_18d6d3573172.slice/crio-1bfcd9fe640e1d525db8d9bcb095203772b8da6d7e86f0e2f578ef708bf70a2f WatchSource:0}: Error finding container 1bfcd9fe640e1d525db8d9bcb095203772b8da6d7e86f0e2f578ef708bf70a2f: Status 404 returned error can't find the container with id 1bfcd9fe640e1d525db8d9bcb095203772b8da6d7e86f0e2f578ef708bf70a2f
Jul 22 03:39:11.884446 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.884415    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"]
Jul 22 03:39:11.887246 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.887230    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:11.889809 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.889785    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 22 03:39:11.890032 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.890014    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2dtvq\""
Jul 22 03:39:11.890130 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.890117    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 22 03:39:11.890429 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.890411    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 22 03:39:11.890490 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.890469    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 22 03:39:11.903290 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.903260    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"]
Jul 22 03:39:11.917181 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.917099    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:11.967791 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.967757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:11.967994 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.967806    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:11.967994 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.967853    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9853aadc-41ee-4197-81c3-5c140400bf1f-local-certs\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:11.967994 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.967876    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-cacerts\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:11.967994 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.967902    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:11.968193 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.968011    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-token\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:11.968193 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.968041    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsgql\" (UniqueName: \"kubernetes.io/projected/9853aadc-41ee-4197-81c3-5c140400bf1f-kube-api-access-jsgql\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:11.981137 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:11.981096    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:12.069455 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.069422    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.069678 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.069487    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9853aadc-41ee-4197-81c3-5c140400bf1f-local-certs\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.069678 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.069597    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-cacerts\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.069678 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.069666    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.069853 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.069720    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-token\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.069853 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.069753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsgql\" (UniqueName: \"kubernetes.io/projected/9853aadc-41ee-4197-81c3-5c140400bf1f-kube-api-access-jsgql\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.069853 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.069803    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.070759 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.070725    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.072804 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.072784    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-cacerts\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.072804 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.072793    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.072948 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.072823    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9853aadc-41ee-4197-81c3-5c140400bf1f-local-certs\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.073300 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.073274    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.081991 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.081954    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsgql\" (UniqueName: \"kubernetes.io/projected/9853aadc-41ee-4197-81c3-5c140400bf1f-kube-api-access-jsgql\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.082122 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.082069    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-token\") pod \"istiod-openshift-gateway-7574459656-hj8sj\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.197087 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.197052    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:12.367015 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.366976    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"]
Jul 22 03:39:12.374572 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:39:12.374535    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9853aadc_41ee_4197_81c3_5c140400bf1f.slice/crio-30327c954f1e03eaa34084fffecafc0703b4c60202ab1dc41a8d23a5afcca792 WatchSource:0}: Error finding container 30327c954f1e03eaa34084fffecafc0703b4c60202ab1dc41a8d23a5afcca792: Status 404 returned error can't find the container with id 30327c954f1e03eaa34084fffecafc0703b4c60202ab1dc41a8d23a5afcca792
Jul 22 03:39:12.720230 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.720186    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h" event={"ID":"c5086d01-4a12-4690-ba79-18d6d3573172","Type":"ContainerStarted","Data":"1bfcd9fe640e1d525db8d9bcb095203772b8da6d7e86f0e2f578ef708bf70a2f"}
Jul 22 03:39:12.721861 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.721802    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj" event={"ID":"9853aadc-41ee-4197-81c3-5c140400bf1f","Type":"ContainerStarted","Data":"30327c954f1e03eaa34084fffecafc0703b4c60202ab1dc41a8d23a5afcca792"}
Jul 22 03:39:12.901475 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:12.901354    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:16.533356 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.533298    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 03:39:16.533765 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.533395    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Jul 22 03:39:16.745883 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.745776    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h" event={"ID":"c5086d01-4a12-4690-ba79-18d6d3573172","Type":"ContainerStarted","Data":"e5e6aa1f3cd65548cf75cef82647b094321002c76bca91e05ace91637f28ad71"}
Jul 22 03:39:16.746049 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.745906    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h"
Jul 22 03:39:16.747503 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.747478    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l" event={"ID":"f9e07c01-5fbe-4d80-94a1-2771fb06b0fd","Type":"ContainerStarted","Data":"b26d7c63dfa367c72893f8323df2e6daf8fcded0ddbbb53815b8b1b82f6edd3d"}
Jul 22 03:39:16.747623 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.747528    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l"
Jul 22 03:39:16.749036 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.749010    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q" event={"ID":"5460c5c2-bd2c-4093-94e0-5266fc561fca","Type":"ContainerStarted","Data":"cc1e38cd1892a5abb7d7117731c4ef477edd258f5c3acb3e724d6e6eacaa6b5c"}
Jul 22 03:39:16.750541 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.750520    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj" event={"ID":"9853aadc-41ee-4197-81c3-5c140400bf1f","Type":"ContainerStarted","Data":"f7b073a8f69a5b60501aae7b9808feab83e7b8a5ec7d257afd819d72e35a0c1d"}
Jul 22 03:39:16.750697 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.750681    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:16.780483 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.780430    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h" podStartSLOduration=1.044946886 podStartE2EDuration="5.780414525s" totalImagesPullingTime="4.735467639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:39:16.779554544 +0000 UTC m=+333.946789209" watchObservedRunningTime="2026-07-22 03:39:16.780414525 +0000 UTC m=+333.947649168"
Jul 22 03:39:16.797260 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.797202    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l" podStartSLOduration=1.907153214 podStartE2EDuration="6.79718574s" totalImagesPullingTime="4.890032526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:39:16.796377385 +0000 UTC m=+333.963612053" watchObservedRunningTime="2026-07-22 03:39:16.79718574 +0000 UTC m=+333.964420382"
Jul 22 03:39:16.818388 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.818339    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj" podStartSLOduration=1.663299586 podStartE2EDuration="5.818322033s" totalImagesPullingTime="4.155022447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:39:16.817283693 +0000 UTC m=+333.984518389" watchObservedRunningTime="2026-07-22 03:39:16.818322033 +0000 UTC m=+333.985556694"
Jul 22 03:39:16.833373 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:16.833311    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5bd5997d8b-4lt5q" podStartSLOduration=1.202509777 podStartE2EDuration="6.83328822s" totalImagesPullingTime="5.630778443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:39:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:39:16.832034346 +0000 UTC m=+333.999269011" watchObservedRunningTime="2026-07-22 03:39:16.83328822 +0000 UTC m=+334.000522885"
Jul 22 03:39:17.008523 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:17.008417    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:17.090145 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:17.090108    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:17.323986 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:17.323897    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:17.554005 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:17.553955    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:17.660256 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:17.660154    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:17.758195 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:17.758166    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:22.195501 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.195465    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:22.262991 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.262960    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"]
Jul 22 03:39:22.289936 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.289883    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:22.338192 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.338159    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"]
Jul 22 03:39:22.338355 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.338285    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"
Jul 22 03:39:22.341035 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.341007    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 22 03:39:22.341150 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.341107    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5bpq6\""
Jul 22 03:39:22.352748 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.352731    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"]
Jul 22 03:39:22.352847 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.352760    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"]
Jul 22 03:39:22.352847 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.352839    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"
Jul 22 03:39:22.355500 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.355482    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hxhvv\""
Jul 22 03:39:22.355677 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.355482    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 22 03:39:22.467109 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.467084    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zxfc\" (UniqueName: \"kubernetes.io/projected/5671cfc0-5bf7-4654-876e-8335dac8f778-kube-api-access-6zxfc\") pod \"llmisvc-controller-manager-777c6bd7d5-8cvnv\" (UID: \"5671cfc0-5bf7-4654-876e-8335dac8f778\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"
Jul 22 03:39:22.467271 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.467122    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8bdc597-44a4-43d7-a5d2-b2fa7d81b687-cert\") pod \"kserve-controller-manager-d6f4b65b8-kbn64\" (UID: \"c8bdc597-44a4-43d7-a5d2-b2fa7d81b687\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"
Jul 22 03:39:22.467271 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.467139    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5671cfc0-5bf7-4654-876e-8335dac8f778-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8cvnv\" (UID: \"5671cfc0-5bf7-4654-876e-8335dac8f778\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"
Jul 22 03:39:22.467271 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.467174    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzltm\" (UniqueName: \"kubernetes.io/projected/c8bdc597-44a4-43d7-a5d2-b2fa7d81b687-kube-api-access-nzltm\") pod \"kserve-controller-manager-d6f4b65b8-kbn64\" (UID: \"c8bdc597-44a4-43d7-a5d2-b2fa7d81b687\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"
Jul 22 03:39:22.567719 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.567688    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzltm\" (UniqueName: \"kubernetes.io/projected/c8bdc597-44a4-43d7-a5d2-b2fa7d81b687-kube-api-access-nzltm\") pod \"kserve-controller-manager-d6f4b65b8-kbn64\" (UID: \"c8bdc597-44a4-43d7-a5d2-b2fa7d81b687\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"
Jul 22 03:39:22.567902 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.567792    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zxfc\" (UniqueName: \"kubernetes.io/projected/5671cfc0-5bf7-4654-876e-8335dac8f778-kube-api-access-6zxfc\") pod \"llmisvc-controller-manager-777c6bd7d5-8cvnv\" (UID: \"5671cfc0-5bf7-4654-876e-8335dac8f778\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"
Jul 22 03:39:22.567902 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.567829    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8bdc597-44a4-43d7-a5d2-b2fa7d81b687-cert\") pod \"kserve-controller-manager-d6f4b65b8-kbn64\" (UID: \"c8bdc597-44a4-43d7-a5d2-b2fa7d81b687\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"
Jul 22 03:39:22.567902 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.567852    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5671cfc0-5bf7-4654-876e-8335dac8f778-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8cvnv\" (UID: \"5671cfc0-5bf7-4654-876e-8335dac8f778\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"
Jul 22 03:39:22.568066 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:39:22.567965    2569 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 22 03:39:22.568066 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:39:22.568022    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5671cfc0-5bf7-4654-876e-8335dac8f778-cert podName:5671cfc0-5bf7-4654-876e-8335dac8f778 nodeName:}" failed. No retries permitted until 2026-07-22 03:39:23.068000852 +0000 UTC m=+340.235235494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5671cfc0-5bf7-4654-876e-8335dac8f778-cert") pod "llmisvc-controller-manager-777c6bd7d5-8cvnv" (UID: "5671cfc0-5bf7-4654-876e-8335dac8f778") : secret "llmisvc-webhook-server-cert" not found
Jul 22 03:39:22.570601 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.570580    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8bdc597-44a4-43d7-a5d2-b2fa7d81b687-cert\") pod \"kserve-controller-manager-d6f4b65b8-kbn64\" (UID: \"c8bdc597-44a4-43d7-a5d2-b2fa7d81b687\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"
Jul 22 03:39:22.585296 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.585264    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:22.589310 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.589288    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzltm\" (UniqueName: \"kubernetes.io/projected/c8bdc597-44a4-43d7-a5d2-b2fa7d81b687-kube-api-access-nzltm\") pod \"kserve-controller-manager-d6f4b65b8-kbn64\" (UID: \"c8bdc597-44a4-43d7-a5d2-b2fa7d81b687\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"
Jul 22 03:39:22.589419 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.589380    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zxfc\" (UniqueName: \"kubernetes.io/projected/5671cfc0-5bf7-4654-876e-8335dac8f778-kube-api-access-6zxfc\") pod \"llmisvc-controller-manager-777c6bd7d5-8cvnv\" (UID: \"5671cfc0-5bf7-4654-876e-8335dac8f778\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"
Jul 22 03:39:22.648284 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.648247    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"
Jul 22 03:39:22.749502 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.749400    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:22.800193 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:22.800041    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"]
Jul 22 03:39:22.802376 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:39:22.802350    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8bdc597_44a4_43d7_a5d2_b2fa7d81b687.slice/crio-00e6d2ae9cd3a21c935684f19f17f596ab4629a5b80006be7451fdee8067a038 WatchSource:0}: Error finding container 00e6d2ae9cd3a21c935684f19f17f596ab4629a5b80006be7451fdee8067a038: Status 404 returned error can't find the container with id 00e6d2ae9cd3a21c935684f19f17f596ab4629a5b80006be7451fdee8067a038
Jul 22 03:39:23.071709 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:23.071585    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5671cfc0-5bf7-4654-876e-8335dac8f778-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8cvnv\" (UID: \"5671cfc0-5bf7-4654-876e-8335dac8f778\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"
Jul 22 03:39:23.074128 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:23.074097    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5671cfc0-5bf7-4654-876e-8335dac8f778-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8cvnv\" (UID: \"5671cfc0-5bf7-4654-876e-8335dac8f778\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"
Jul 22 03:39:23.262157 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:23.262113    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"
Jul 22 03:39:23.439345 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:23.439303    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"]
Jul 22 03:39:23.441855 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:39:23.441828    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5671cfc0_5bf7_4654_876e_8335dac8f778.slice/crio-a3c4790a4fc6e66b941f311d2cb707adc48ef713d5272bb6703a3d5c6ae96a82 WatchSource:0}: Error finding container a3c4790a4fc6e66b941f311d2cb707adc48ef713d5272bb6703a3d5c6ae96a82: Status 404 returned error can't find the container with id a3c4790a4fc6e66b941f311d2cb707adc48ef713d5272bb6703a3d5c6ae96a82
Jul 22 03:39:23.534168 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:23.534094    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:23.630187 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:23.630087    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:39:23.782882 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:23.782845    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv" event={"ID":"5671cfc0-5bf7-4654-876e-8335dac8f778","Type":"ContainerStarted","Data":"a3c4790a4fc6e66b941f311d2cb707adc48ef713d5272bb6703a3d5c6ae96a82"}
Jul 22 03:39:23.783849 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:23.783826    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64" event={"ID":"c8bdc597-44a4-43d7-a5d2-b2fa7d81b687","Type":"ContainerStarted","Data":"00e6d2ae9cd3a21c935684f19f17f596ab4629a5b80006be7451fdee8067a038"}
Jul 22 03:39:24.330235 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:24.330194    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"]
Jul 22 03:39:24.331369 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:24.330408    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj" podUID="9853aadc-41ee-4197-81c3-5c140400bf1f" containerName="discovery" containerID="cri-o://f7b073a8f69a5b60501aae7b9808feab83e7b8a5ec7d257afd819d72e35a0c1d" gracePeriod=30
Jul 22 03:39:24.791741 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:24.791706    2569 generic.go:356] "Generic (PLEG): container finished" podID="9853aadc-41ee-4197-81c3-5c140400bf1f" containerID="f7b073a8f69a5b60501aae7b9808feab83e7b8a5ec7d257afd819d72e35a0c1d" exitCode=0
Jul 22 03:39:24.791902 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:24.791786    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj" event={"ID":"9853aadc-41ee-4197-81c3-5c140400bf1f","Type":"ContainerDied","Data":"f7b073a8f69a5b60501aae7b9808feab83e7b8a5ec7d257afd819d72e35a0c1d"}
Jul 22 03:39:25.235592 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.235570    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:25.289918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.289885    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-csr-ca-configmap\") pod \"9853aadc-41ee-4197-81c3-5c140400bf1f\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") "
Jul 22 03:39:25.290101 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.289955    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-csr-dns-cert\") pod \"9853aadc-41ee-4197-81c3-5c140400bf1f\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") "
Jul 22 03:39:25.290101 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.289993    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-token\") pod \"9853aadc-41ee-4197-81c3-5c140400bf1f\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") "
Jul 22 03:39:25.290225 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.290196    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "9853aadc-41ee-4197-81c3-5c140400bf1f" (UID: "9853aadc-41ee-4197-81c3-5c140400bf1f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:39:25.290225 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.290205    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-cacerts\") pod \"9853aadc-41ee-4197-81c3-5c140400bf1f\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") "
Jul 22 03:39:25.290337 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.290250    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jsgql\" (UniqueName: \"kubernetes.io/projected/9853aadc-41ee-4197-81c3-5c140400bf1f-kube-api-access-jsgql\") pod \"9853aadc-41ee-4197-81c3-5c140400bf1f\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") "
Jul 22 03:39:25.290393 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.290344    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-kubeconfig\") pod \"9853aadc-41ee-4197-81c3-5c140400bf1f\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") "
Jul 22 03:39:25.290446 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.290391    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9853aadc-41ee-4197-81c3-5c140400bf1f-local-certs\") pod \"9853aadc-41ee-4197-81c3-5c140400bf1f\" (UID: \"9853aadc-41ee-4197-81c3-5c140400bf1f\") "
Jul 22 03:39:25.290753 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.290730    2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-csr-ca-configmap\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:39:25.293769 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.293729    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-token" (OuterVolumeSpecName: "istio-token") pod "9853aadc-41ee-4197-81c3-5c140400bf1f" (UID: "9853aadc-41ee-4197-81c3-5c140400bf1f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:39:25.293769 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.293786    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9853aadc-41ee-4197-81c3-5c140400bf1f-local-certs" (OuterVolumeSpecName: "local-certs") pod "9853aadc-41ee-4197-81c3-5c140400bf1f" (UID: "9853aadc-41ee-4197-81c3-5c140400bf1f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:39:25.294278 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.294236    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9853aadc-41ee-4197-81c3-5c140400bf1f-kube-api-access-jsgql" (OuterVolumeSpecName: "kube-api-access-jsgql") pod "9853aadc-41ee-4197-81c3-5c140400bf1f" (UID: "9853aadc-41ee-4197-81c3-5c140400bf1f"). InnerVolumeSpecName "kube-api-access-jsgql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:39:25.294278 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.294255    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "9853aadc-41ee-4197-81c3-5c140400bf1f" (UID: "9853aadc-41ee-4197-81c3-5c140400bf1f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:39:25.294754 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.294722    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "9853aadc-41ee-4197-81c3-5c140400bf1f" (UID: "9853aadc-41ee-4197-81c3-5c140400bf1f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:39:25.295249 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.295214    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-cacerts" (OuterVolumeSpecName: "cacerts") pod "9853aadc-41ee-4197-81c3-5c140400bf1f" (UID: "9853aadc-41ee-4197-81c3-5c140400bf1f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:39:25.391532 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.391512    2569 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/9853aadc-41ee-4197-81c3-5c140400bf1f-local-certs\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:39:25.391532 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.391534    2569 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-csr-dns-cert\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:39:25.391947 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.391542    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-token\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:39:25.391947 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.391550    2569 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-cacerts\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:39:25.391947 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.391558    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jsgql\" (UniqueName: \"kubernetes.io/projected/9853aadc-41ee-4197-81c3-5c140400bf1f-kube-api-access-jsgql\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:39:25.391947 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.391577    2569 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9853aadc-41ee-4197-81c3-5c140400bf1f-istio-kubeconfig\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:39:25.799134 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.799100    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"
Jul 22 03:39:25.799134 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.799124    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj" event={"ID":"9853aadc-41ee-4197-81c3-5c140400bf1f","Type":"ContainerDied","Data":"30327c954f1e03eaa34084fffecafc0703b4c60202ab1dc41a8d23a5afcca792"}
Jul 22 03:39:25.799376 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.799249    2569 scope.go:117] "RemoveContainer" containerID="f7b073a8f69a5b60501aae7b9808feab83e7b8a5ec7d257afd819d72e35a0c1d"
Jul 22 03:39:25.800984 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.800958    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64" event={"ID":"c8bdc597-44a4-43d7-a5d2-b2fa7d81b687","Type":"ContainerStarted","Data":"e8b8aa9b962ad53eb39239d394da08d68af32ed291422e56654b0afd1848289d"}
Jul 22 03:39:25.801164 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.801150    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"
Jul 22 03:39:25.827935 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.827907    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"]
Jul 22 03:39:25.839939 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.839908    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-hj8sj"]
Jul 22 03:39:25.872989 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:25.872931    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64" podStartSLOduration=1.2990619589999999 podStartE2EDuration="3.872912402s" totalImagesPullingTime="2.573850443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:39:25.870568714 +0000 UTC m=+343.037803378" watchObservedRunningTime="2026-07-22 03:39:25.872912402 +0000 UTC m=+343.040147065"
Jul 22 03:39:26.808247 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:26.808213    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv" event={"ID":"5671cfc0-5bf7-4654-876e-8335dac8f778","Type":"ContainerStarted","Data":"79eac5a7e22dce9c936b4fc9efd83b20ca62aefe4f22dfb9b78e5f8733025ef4"}
Jul 22 03:39:26.808763 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:26.808351    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"
Jul 22 03:39:26.826441 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:26.826388    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv" podStartSLOduration=2.157304972 podStartE2EDuration="4.826365763s" totalImagesPullingTime="2.669060791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:39:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:39:26.82495226 +0000 UTC m=+343.992186918" watchObservedRunningTime="2026-07-22 03:39:26.826365763 +0000 UTC m=+343.993600438"
Jul 22 03:39:27.377391 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:27.377350    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9853aadc-41ee-4197-81c3-5c140400bf1f" path="/var/lib/kubelet/pods/9853aadc-41ee-4197-81c3-5c140400bf1f/volumes"
Jul 22 03:39:27.758621 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:27.758593    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hgp9l"
Jul 22 03:39:27.760556 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:27.760536    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-rkj2h"
Jul 22 03:39:56.814822 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:56.814791    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-kbn64"
Jul 22 03:39:57.818327 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:39:57.818301    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8cvnv"
Jul 22 03:40:05.798626 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.798565    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:05.893580 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.893545    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:05.912560 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.912524    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fmkw8"]
Jul 22 03:40:05.912880 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.912867    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9853aadc-41ee-4197-81c3-5c140400bf1f" containerName="discovery"
Jul 22 03:40:05.912936 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.912883    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9853aadc-41ee-4197-81c3-5c140400bf1f" containerName="discovery"
Jul 22 03:40:05.912973 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.912961    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9853aadc-41ee-4197-81c3-5c140400bf1f" containerName="discovery"
Jul 22 03:40:05.915185 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.915163    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fmkw8"
Jul 22 03:40:05.917825 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.917796    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 03:40:05.918613 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.918591    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-sjlkh\""
Jul 22 03:40:05.918740 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.918591    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 03:40:05.926574 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.926550    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fmkw8"]
Jul 22 03:40:05.936198 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.936165    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrj2c\" (UniqueName: \"kubernetes.io/projected/2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7-kube-api-access-qrj2c\") pod \"kuadrant-operator-catalog-fmkw8\" (UID: \"2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7\") " pod="kuadrant-system/kuadrant-operator-catalog-fmkw8"
Jul 22 03:40:05.992561 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:05.992522    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:06.037677 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.037614    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrj2c\" (UniqueName: \"kubernetes.io/projected/2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7-kube-api-access-qrj2c\") pod \"kuadrant-operator-catalog-fmkw8\" (UID: \"2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7\") " pod="kuadrant-system/kuadrant-operator-catalog-fmkw8"
Jul 22 03:40:06.046881 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.046844    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrj2c\" (UniqueName: \"kubernetes.io/projected/2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7-kube-api-access-qrj2c\") pod \"kuadrant-operator-catalog-fmkw8\" (UID: \"2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7\") " pod="kuadrant-system/kuadrant-operator-catalog-fmkw8"
Jul 22 03:40:06.226565 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.226535    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fmkw8"
Jul 22 03:40:06.284848 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.284815    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fmkw8"]
Jul 22 03:40:06.366543 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.366514    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fmkw8"]
Jul 22 03:40:06.368312 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:40:06.368279    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2568ebf8_f2b4_4b8a_b62d_10a5ab3535a7.slice/crio-ff9fa850a5c6ab7e375ba275d616af2d1a4d6105516cdd96426fff8e7c93335c WatchSource:0}: Error finding container ff9fa850a5c6ab7e375ba275d616af2d1a4d6105516cdd96426fff8e7c93335c: Status 404 returned error can't find the container with id ff9fa850a5c6ab7e375ba275d616af2d1a4d6105516cdd96426fff8e7c93335c
Jul 22 03:40:06.490267 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.490187    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-94cvl"]
Jul 22 03:40:06.493325 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.493307    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-94cvl"
Jul 22 03:40:06.502988 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.502965    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-94cvl"]
Jul 22 03:40:06.541954 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.541925    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kprv4\" (UniqueName: \"kubernetes.io/projected/70e7dbd3-3dbb-46cf-9d24-34996fefc9c4-kube-api-access-kprv4\") pod \"kuadrant-operator-catalog-94cvl\" (UID: \"70e7dbd3-3dbb-46cf-9d24-34996fefc9c4\") " pod="kuadrant-system/kuadrant-operator-catalog-94cvl"
Jul 22 03:40:06.642587 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.642552    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kprv4\" (UniqueName: \"kubernetes.io/projected/70e7dbd3-3dbb-46cf-9d24-34996fefc9c4-kube-api-access-kprv4\") pod \"kuadrant-operator-catalog-94cvl\" (UID: \"70e7dbd3-3dbb-46cf-9d24-34996fefc9c4\") " pod="kuadrant-system/kuadrant-operator-catalog-94cvl"
Jul 22 03:40:06.652407 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.652379    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kprv4\" (UniqueName: \"kubernetes.io/projected/70e7dbd3-3dbb-46cf-9d24-34996fefc9c4-kube-api-access-kprv4\") pod \"kuadrant-operator-catalog-94cvl\" (UID: \"70e7dbd3-3dbb-46cf-9d24-34996fefc9c4\") " pod="kuadrant-system/kuadrant-operator-catalog-94cvl"
Jul 22 03:40:06.802795 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.802706    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-94cvl"
Jul 22 03:40:06.945778 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.945753    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-94cvl"]
Jul 22 03:40:06.976227 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:40:06.976198    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e7dbd3_3dbb_46cf_9d24_34996fefc9c4.slice/crio-dd8336fe74ed1a858ef2488061b27205e5ad1e52066019394a59d4c2f97c33b4 WatchSource:0}: Error finding container dd8336fe74ed1a858ef2488061b27205e5ad1e52066019394a59d4c2f97c33b4: Status 404 returned error can't find the container with id dd8336fe74ed1a858ef2488061b27205e5ad1e52066019394a59d4c2f97c33b4
Jul 22 03:40:06.983071 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.983038    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-94cvl" event={"ID":"70e7dbd3-3dbb-46cf-9d24-34996fefc9c4","Type":"ContainerStarted","Data":"dd8336fe74ed1a858ef2488061b27205e5ad1e52066019394a59d4c2f97c33b4"}
Jul 22 03:40:06.984735 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:06.984706    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fmkw8" event={"ID":"2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7","Type":"ContainerStarted","Data":"ff9fa850a5c6ab7e375ba275d616af2d1a4d6105516cdd96426fff8e7c93335c"}
Jul 22 03:40:08.996289 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:08.996250    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-94cvl" event={"ID":"70e7dbd3-3dbb-46cf-9d24-34996fefc9c4","Type":"ContainerStarted","Data":"71b41d8771eb287e1c37a727e4a3b4101de6e9e6fdd954f73161eb71dda529e0"}
Jul 22 03:40:08.997688 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:08.997632    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fmkw8" event={"ID":"2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7","Type":"ContainerStarted","Data":"4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562"}
Jul 22 03:40:08.997817 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:08.997727    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-fmkw8" podUID="2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7" containerName="registry-server" containerID="cri-o://4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562" gracePeriod=2
Jul 22 03:40:09.013475 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:09.013428    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-94cvl" podStartSLOduration=1.636854276 podStartE2EDuration="3.013412205s" totalImagesPullingTime="1.376557929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:40:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:40:09.012146511 +0000 UTC m=+386.179381176" watchObservedRunningTime="2026-07-22 03:40:09.013412205 +0000 UTC m=+386.180646869"
Jul 22 03:40:09.028531 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:09.028482    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fmkw8" podStartSLOduration=2.05760465 podStartE2EDuration="4.028465576s" totalImagesPullingTime="1.970860926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:40:09.027073319 +0000 UTC m=+386.194307983" watchObservedRunningTime="2026-07-22 03:40:09.028465576 +0000 UTC m=+386.195700240"
Jul 22 03:40:09.250364 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:09.250303    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fmkw8"
Jul 22 03:40:09.366188 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:09.366153    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrj2c\" (UniqueName: \"kubernetes.io/projected/2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7-kube-api-access-qrj2c\") pod \"2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7\" (UID: \"2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7\") "
Jul 22 03:40:09.368481 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:09.368448    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7-kube-api-access-qrj2c" (OuterVolumeSpecName: "kube-api-access-qrj2c") pod "2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7" (UID: "2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7"). InnerVolumeSpecName "kube-api-access-qrj2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:40:09.468162 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:09.468120    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrj2c\" (UniqueName: \"kubernetes.io/projected/2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7-kube-api-access-qrj2c\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:40:10.002939 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:10.002897    2569 generic.go:356] "Generic (PLEG): container finished" podID="2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7" containerID="4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562" exitCode=0
Jul 22 03:40:10.003370 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:10.002965    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fmkw8"
Jul 22 03:40:10.003370 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:10.002984    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fmkw8" event={"ID":"2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7","Type":"ContainerDied","Data":"4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562"}
Jul 22 03:40:10.003370 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:10.003056    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fmkw8" event={"ID":"2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7","Type":"ContainerDied","Data":"ff9fa850a5c6ab7e375ba275d616af2d1a4d6105516cdd96426fff8e7c93335c"}
Jul 22 03:40:10.003370 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:10.003076    2569 scope.go:117] "RemoveContainer" containerID="4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562"
Jul 22 03:40:10.011995 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:10.011978    2569 scope.go:117] "RemoveContainer" containerID="4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562"
Jul 22 03:40:10.012274 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:40:10.012253    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562\": container with ID starting with 4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562 not found: ID does not exist" containerID="4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562"
Jul 22 03:40:10.012340 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:10.012283    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562"} err="failed to get container status \"4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562\": rpc error: code = NotFound desc = could not find container \"4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562\": container with ID starting with 4787e99e6c920e72b54956a7c419fb0175624d5c0e076e903d901ca8eeb92562 not found: ID does not exist"
Jul 22 03:40:10.021910 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:10.021878    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fmkw8"]
Jul 22 03:40:10.025539 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:10.025515    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fmkw8"]
Jul 22 03:40:11.377593 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:11.377558    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7" path="/var/lib/kubelet/pods/2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7/volumes"
Jul 22 03:40:16.803505 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:16.803463    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-94cvl"
Jul 22 03:40:16.803916 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:16.803537    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-94cvl"
Jul 22 03:40:16.826269 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:16.826245    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-94cvl"
Jul 22 03:40:17.054549 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:17.054490    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-94cvl"
Jul 22 03:40:31.817012 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:31.816971    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:36.524314 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:36.524279    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:36.893827 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:36.893750    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"]
Jul 22 03:40:36.894070 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:36.894058    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7" containerName="registry-server"
Jul 22 03:40:36.894112 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:36.894072    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7" containerName="registry-server"
Jul 22 03:40:36.894150 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:36.894128    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2568ebf8-f2b4-4b8a-b62d-10a5ab3535a7" containerName="registry-server"
Jul 22 03:40:36.896950 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:36.896930    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:36.899491 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:36.899460    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dlnqk\""
Jul 22 03:40:36.909809 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:36.909789    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"]
Jul 22 03:40:37.004328 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:37.004308    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdvkr\" (UniqueName: \"kubernetes.io/projected/047e8949-cd0c-4319-8a5e-6e8c7b288182-kube-api-access-sdvkr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b54b8\" (UID: \"047e8949-cd0c-4319-8a5e-6e8c7b288182\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:37.004430 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:37.004342    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/047e8949-cd0c-4319-8a5e-6e8c7b288182-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b54b8\" (UID: \"047e8949-cd0c-4319-8a5e-6e8c7b288182\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:37.105308 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:37.105286    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdvkr\" (UniqueName: \"kubernetes.io/projected/047e8949-cd0c-4319-8a5e-6e8c7b288182-kube-api-access-sdvkr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b54b8\" (UID: \"047e8949-cd0c-4319-8a5e-6e8c7b288182\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:37.105420 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:37.105323    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/047e8949-cd0c-4319-8a5e-6e8c7b288182-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b54b8\" (UID: \"047e8949-cd0c-4319-8a5e-6e8c7b288182\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:37.105700 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:37.105684    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/047e8949-cd0c-4319-8a5e-6e8c7b288182-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b54b8\" (UID: \"047e8949-cd0c-4319-8a5e-6e8c7b288182\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:37.114057 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:37.114024    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdvkr\" (UniqueName: \"kubernetes.io/projected/047e8949-cd0c-4319-8a5e-6e8c7b288182-kube-api-access-sdvkr\") pod \"kuadrant-operator-controller-manager-8684c9ff49-b54b8\" (UID: \"047e8949-cd0c-4319-8a5e-6e8c7b288182\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:37.200286 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:37.200254    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:37.207167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:37.207144    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:37.347897 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:37.347877    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"]
Jul 22 03:40:37.349936 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:40:37.349911    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047e8949_cd0c_4319_8a5e_6e8c7b288182.slice/crio-aff176af860844368f9ca97e592e75eb30d4d055f20e8ba0fd413ccfdc17bfbb WatchSource:0}: Error finding container aff176af860844368f9ca97e592e75eb30d4d055f20e8ba0fd413ccfdc17bfbb: Status 404 returned error can't find the container with id aff176af860844368f9ca97e592e75eb30d4d055f20e8ba0fd413ccfdc17bfbb
Jul 22 03:40:37.824175 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:37.824142    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:38.124858 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:38.124765    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8" event={"ID":"047e8949-cd0c-4319-8a5e-6e8c7b288182","Type":"ContainerStarted","Data":"aff176af860844368f9ca97e592e75eb30d4d055f20e8ba0fd413ccfdc17bfbb"}
Jul 22 03:40:39.847291 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:39.847255    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:40.142530 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:40.142453    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-994w8"]
Jul 22 03:40:40.146891 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:40.146869    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-994w8"
Jul 22 03:40:40.149502 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:40.149484    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-85ptk\""
Jul 22 03:40:40.156379 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:40.156354    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-994w8"]
Jul 22 03:40:40.234140 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:40.234107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkjfs\" (UniqueName: \"kubernetes.io/projected/2daa9b87-db14-4dda-b258-fb4c46cadb23-kube-api-access-kkjfs\") pod \"authorino-operator-75cc8d5cb7-994w8\" (UID: \"2daa9b87-db14-4dda-b258-fb4c46cadb23\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-994w8"
Jul 22 03:40:40.334861 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:40.334823    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkjfs\" (UniqueName: \"kubernetes.io/projected/2daa9b87-db14-4dda-b258-fb4c46cadb23-kube-api-access-kkjfs\") pod \"authorino-operator-75cc8d5cb7-994w8\" (UID: \"2daa9b87-db14-4dda-b258-fb4c46cadb23\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-994w8"
Jul 22 03:40:40.345316 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:40.345283    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkjfs\" (UniqueName: \"kubernetes.io/projected/2daa9b87-db14-4dda-b258-fb4c46cadb23-kube-api-access-kkjfs\") pod \"authorino-operator-75cc8d5cb7-994w8\" (UID: \"2daa9b87-db14-4dda-b258-fb4c46cadb23\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-994w8"
Jul 22 03:40:40.457624 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:40.457585    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-994w8"
Jul 22 03:40:40.608524 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:40.608489    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-994w8"]
Jul 22 03:40:40.612494 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:40:40.612468    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2daa9b87_db14_4dda_b258_fb4c46cadb23.slice/crio-94bbf21ba8a0676d24bdcad557b1c1fb2a2318e5286182d80a9f21d3fcb51d6e WatchSource:0}: Error finding container 94bbf21ba8a0676d24bdcad557b1c1fb2a2318e5286182d80a9f21d3fcb51d6e: Status 404 returned error can't find the container with id 94bbf21ba8a0676d24bdcad557b1c1fb2a2318e5286182d80a9f21d3fcb51d6e
Jul 22 03:40:41.140257 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:41.140219    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-994w8" event={"ID":"2daa9b87-db14-4dda-b258-fb4c46cadb23","Type":"ContainerStarted","Data":"94bbf21ba8a0676d24bdcad557b1c1fb2a2318e5286182d80a9f21d3fcb51d6e"}
Jul 22 03:40:41.225279 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:41.225236    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:42.840969 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:42.840919    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:42.974263 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:42.974227    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"]
Jul 22 03:40:42.981315 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:42.981286    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:42.987300 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:42.987277    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-69864\""
Jul 22 03:40:42.988489 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:42.988453    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"]
Jul 22 03:40:43.162720 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:43.162618    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xf8r\" (UniqueName: \"kubernetes.io/projected/4fe8cbe7-57c2-4ab2-8299-052e603c1200-kube-api-access-8xf8r\") pod \"limitador-operator-controller-manager-859d7b78bd-2xjch\" (UID: \"4fe8cbe7-57c2-4ab2-8299-052e603c1200\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:43.263373 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:43.263324    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xf8r\" (UniqueName: \"kubernetes.io/projected/4fe8cbe7-57c2-4ab2-8299-052e603c1200-kube-api-access-8xf8r\") pod \"limitador-operator-controller-manager-859d7b78bd-2xjch\" (UID: \"4fe8cbe7-57c2-4ab2-8299-052e603c1200\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:43.274296 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:43.274268    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xf8r\" (UniqueName: \"kubernetes.io/projected/4fe8cbe7-57c2-4ab2-8299-052e603c1200-kube-api-access-8xf8r\") pod \"limitador-operator-controller-manager-859d7b78bd-2xjch\" (UID: \"4fe8cbe7-57c2-4ab2-8299-052e603c1200\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:43.297955 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:43.297924    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-69864\""
Jul 22 03:40:43.306095 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:43.306068    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:43.781932 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:43.781907    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"]
Jul 22 03:40:43.784610 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:40:43.784584    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe8cbe7_57c2_4ab2_8299_052e603c1200.slice/crio-0cda665c55da2012134a96663c457283f0ff625f78619bb814084c93f980059d WatchSource:0}: Error finding container 0cda665c55da2012134a96663c457283f0ff625f78619bb814084c93f980059d: Status 404 returned error can't find the container with id 0cda665c55da2012134a96663c457283f0ff625f78619bb814084c93f980059d
Jul 22 03:40:43.819313 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:43.819284    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:44.157959 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:44.157921    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-994w8" event={"ID":"2daa9b87-db14-4dda-b258-fb4c46cadb23","Type":"ContainerStarted","Data":"797938543b68cc244b151f39a3ba98e2c0e0b6bfc16e0ec707d10876303e80f6"}
Jul 22 03:40:44.158438 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:44.158061    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-994w8"
Jul 22 03:40:44.159476 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:44.159446    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch" event={"ID":"4fe8cbe7-57c2-4ab2-8299-052e603c1200","Type":"ContainerStarted","Data":"0cda665c55da2012134a96663c457283f0ff625f78619bb814084c93f980059d"}
Jul 22 03:40:44.161677 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:44.161596    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8" event={"ID":"047e8949-cd0c-4319-8a5e-6e8c7b288182","Type":"ContainerStarted","Data":"c104ebe267c6ae196e53d7edc44aa28ea589d1e5466bbadd691af76ca7b70bdc"}
Jul 22 03:40:44.161808 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:44.161785    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:44.178398 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:44.178319    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-994w8" podStartSLOduration=1.107073674 podStartE2EDuration="4.178303224s" totalImagesPullingTime="3.07122955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:40:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:40:44.175997052 +0000 UTC m=+421.343231715" watchObservedRunningTime="2026-07-22 03:40:44.178303224 +0000 UTC m=+421.345537866"
Jul 22 03:40:44.195374 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:44.195315    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8" podStartSLOduration=1.870017243 podStartE2EDuration="8.19529172s" totalImagesPullingTime="6.325274477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:40:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:40:44.193000073 +0000 UTC m=+421.360234739" watchObservedRunningTime="2026-07-22 03:40:44.19529172 +0000 UTC m=+421.362526385"
Jul 22 03:40:45.648376 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:45.648285    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:46.173464 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:46.173426    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch" event={"ID":"4fe8cbe7-57c2-4ab2-8299-052e603c1200","Type":"ContainerStarted","Data":"740b5731ec44fb1b3b54049ac40a61f6d60dd96653d42484ecb260d008f332e2"}
Jul 22 03:40:46.173668 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:46.173557    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:46.195130 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:46.195081    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch" podStartSLOduration=2.6402179759999997 podStartE2EDuration="4.195066596s" totalImagesPullingTime="1.55484862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:40:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:40:46.1936764 +0000 UTC m=+423.360911086" watchObservedRunningTime="2026-07-22 03:40:46.195066596 +0000 UTC m=+423.362301259"
Jul 22 03:40:46.929900 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:46.929866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:47.219415 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:47.219377    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:48.018195 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:48.018146    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:48.119462 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:48.119412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:55.169747 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:55.169706    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:55.170207 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:55.169787    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-994w8"
Jul 22 03:40:57.056931 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.056893    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"]
Jul 22 03:40:57.057363 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.057072    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8" podUID="047e8949-cd0c-4319-8a5e-6e8c7b288182" containerName="manager" containerID="cri-o://c104ebe267c6ae196e53d7edc44aa28ea589d1e5466bbadd691af76ca7b70bdc" gracePeriod=2
Jul 22 03:40:57.068620 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.068589    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"]
Jul 22 03:40:57.078874 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.078843    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"]
Jul 22 03:40:57.079174 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.079128    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch" podUID="4fe8cbe7-57c2-4ab2-8299-052e603c1200" containerName="manager" containerID="cri-o://740b5731ec44fb1b3b54049ac40a61f6d60dd96653d42484ecb260d008f332e2" gracePeriod=2
Jul 22 03:40:57.081268 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.081229    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:57.081832 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.081810    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"]
Jul 22 03:40:57.082139 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.082123    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047e8949-cd0c-4319-8a5e-6e8c7b288182" containerName="manager"
Jul 22 03:40:57.082139 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.082137    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="047e8949-cd0c-4319-8a5e-6e8c7b288182" containerName="manager"
Jul 22 03:40:57.082289 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.082194    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="047e8949-cd0c-4319-8a5e-6e8c7b288182" containerName="manager"
Jul 22 03:40:57.085433 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.085411    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"
Jul 22 03:40:57.085601 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.085489    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"]
Jul 22 03:40:57.091613 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:40:57.091583    2569 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4fe8cbe7-57c2-4ab2-8299-052e603c1200\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-2xjch\": pods \"limitador-operator-controller-manager-859d7b78bd-2xjch\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:57.094453 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:40:57.094421    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b54b8\" is forbidden: User \"system:node:ip-10-0-142-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-88.ec2.internal' and this object" podUID="047e8949-cd0c-4319-8a5e-6e8c7b288182" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:57.098221 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.098195    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"]
Jul 22 03:40:57.102286 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.102262    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54"]
Jul 22 03:40:57.102622 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.102609    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fe8cbe7-57c2-4ab2-8299-052e603c1200" containerName="manager"
Jul 22 03:40:57.102691 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.102624    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fe8cbe7-57c2-4ab2-8299-052e603c1200" containerName="manager"
Jul 22 03:40:57.102726 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.102706    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fe8cbe7-57c2-4ab2-8299-052e603c1200" containerName="manager"
Jul 22 03:40:57.105462 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.105443    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54"
Jul 22 03:40:57.119670 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.119595    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54"]
Jul 22 03:40:57.123459 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:40:57.123428    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b54b8\" is forbidden: User \"system:node:ip-10-0-142-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-88.ec2.internal' and this object" podUID="047e8949-cd0c-4319-8a5e-6e8c7b288182" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:57.125672 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:40:57.125616    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2xjch\" is forbidden: User \"system:node:ip-10-0-142-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-88.ec2.internal' and this object" podUID="4fe8cbe7-57c2-4ab2-8299-052e603c1200" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:57.129949 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:40:57.129823    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2xjch\" is forbidden: User \"system:node:ip-10-0-142-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-88.ec2.internal' and this object" podUID="4fe8cbe7-57c2-4ab2-8299-052e603c1200" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:57.132098 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:40:57.132066    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b54b8\" is forbidden: User \"system:node:ip-10-0-142-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-88.ec2.internal' and this object" podUID="047e8949-cd0c-4319-8a5e-6e8c7b288182" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:57.169980 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.169943    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s4d74\" (UID: \"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"
Jul 22 03:40:57.169980 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.169979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sbqd\" (UniqueName: \"kubernetes.io/projected/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef-kube-api-access-6sbqd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s4d74\" (UID: \"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"
Jul 22 03:40:57.170167 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.170006    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ldtl\" (UniqueName: \"kubernetes.io/projected/6fbee01a-be34-4b5a-a5f4-99ec5809715e-kube-api-access-5ldtl\") pod \"limitador-operator-controller-manager-859d7b78bd-8pt54\" (UID: \"6fbee01a-be34-4b5a-a5f4-99ec5809715e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54"
Jul 22 03:40:57.227735 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.227699    2569 generic.go:356] "Generic (PLEG): container finished" podID="047e8949-cd0c-4319-8a5e-6e8c7b288182" containerID="c104ebe267c6ae196e53d7edc44aa28ea589d1e5466bbadd691af76ca7b70bdc" exitCode=0
Jul 22 03:40:57.230982 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.230952    2569 generic.go:356] "Generic (PLEG): container finished" podID="4fe8cbe7-57c2-4ab2-8299-052e603c1200" containerID="740b5731ec44fb1b3b54049ac40a61f6d60dd96653d42484ecb260d008f332e2" exitCode=0
Jul 22 03:40:57.271267 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.271239    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s4d74\" (UID: \"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"
Jul 22 03:40:57.271399 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.271276    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sbqd\" (UniqueName: \"kubernetes.io/projected/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef-kube-api-access-6sbqd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s4d74\" (UID: \"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"
Jul 22 03:40:57.271399 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.271309    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ldtl\" (UniqueName: \"kubernetes.io/projected/6fbee01a-be34-4b5a-a5f4-99ec5809715e-kube-api-access-5ldtl\") pod \"limitador-operator-controller-manager-859d7b78bd-8pt54\" (UID: \"6fbee01a-be34-4b5a-a5f4-99ec5809715e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54"
Jul 22 03:40:57.271673 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.271631    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s4d74\" (UID: \"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"
Jul 22 03:40:57.286380 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.286352    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sbqd\" (UniqueName: \"kubernetes.io/projected/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef-kube-api-access-6sbqd\") pod \"kuadrant-operator-controller-manager-8684c9ff49-s4d74\" (UID: \"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"
Jul 22 03:40:57.286538 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.286456    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ldtl\" (UniqueName: \"kubernetes.io/projected/6fbee01a-be34-4b5a-a5f4-99ec5809715e-kube-api-access-5ldtl\") pod \"limitador-operator-controller-manager-859d7b78bd-8pt54\" (UID: \"6fbee01a-be34-4b5a-a5f4-99ec5809715e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54"
Jul 22 03:40:57.330229 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.330199    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:57.332390 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.332368    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:57.332513 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:40:57.332491    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2xjch\" is forbidden: User \"system:node:ip-10-0-142-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-88.ec2.internal' and this object" podUID="4fe8cbe7-57c2-4ab2-8299-052e603c1200" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:57.334534 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:40:57.334510    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b54b8\" is forbidden: User \"system:node:ip-10-0-142-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-88.ec2.internal' and this object" podUID="047e8949-cd0c-4319-8a5e-6e8c7b288182" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:57.336482 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:40:57.336459    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-b54b8\" is forbidden: User \"system:node:ip-10-0-142-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-88.ec2.internal' and this object" podUID="047e8949-cd0c-4319-8a5e-6e8c7b288182" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:57.338368 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:40:57.338348    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2xjch\" is forbidden: User \"system:node:ip-10-0-142-88.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-88.ec2.internal' and this object" podUID="4fe8cbe7-57c2-4ab2-8299-052e603c1200" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:57.372490 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.372456    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/047e8949-cd0c-4319-8a5e-6e8c7b288182-extensions-socket-volume\") pod \"047e8949-cd0c-4319-8a5e-6e8c7b288182\" (UID: \"047e8949-cd0c-4319-8a5e-6e8c7b288182\") "
Jul 22 03:40:57.372692 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.372517    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8xf8r\" (UniqueName: \"kubernetes.io/projected/4fe8cbe7-57c2-4ab2-8299-052e603c1200-kube-api-access-8xf8r\") pod \"4fe8cbe7-57c2-4ab2-8299-052e603c1200\" (UID: \"4fe8cbe7-57c2-4ab2-8299-052e603c1200\") "
Jul 22 03:40:57.372692 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.372537    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdvkr\" (UniqueName: \"kubernetes.io/projected/047e8949-cd0c-4319-8a5e-6e8c7b288182-kube-api-access-sdvkr\") pod \"047e8949-cd0c-4319-8a5e-6e8c7b288182\" (UID: \"047e8949-cd0c-4319-8a5e-6e8c7b288182\") "
Jul 22 03:40:57.373025 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.373000    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047e8949-cd0c-4319-8a5e-6e8c7b288182-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "047e8949-cd0c-4319-8a5e-6e8c7b288182" (UID: "047e8949-cd0c-4319-8a5e-6e8c7b288182"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:40:57.374774 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.374752    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/047e8949-cd0c-4319-8a5e-6e8c7b288182-kube-api-access-sdvkr" (OuterVolumeSpecName: "kube-api-access-sdvkr") pod "047e8949-cd0c-4319-8a5e-6e8c7b288182" (UID: "047e8949-cd0c-4319-8a5e-6e8c7b288182"). InnerVolumeSpecName "kube-api-access-sdvkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:40:57.374855 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.374794    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fe8cbe7-57c2-4ab2-8299-052e603c1200-kube-api-access-8xf8r" (OuterVolumeSpecName: "kube-api-access-8xf8r") pod "4fe8cbe7-57c2-4ab2-8299-052e603c1200" (UID: "4fe8cbe7-57c2-4ab2-8299-052e603c1200"). InnerVolumeSpecName "kube-api-access-8xf8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:40:57.378259 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.378233    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="047e8949-cd0c-4319-8a5e-6e8c7b288182" path="/var/lib/kubelet/pods/047e8949-cd0c-4319-8a5e-6e8c7b288182/volumes"
Jul 22 03:40:57.378704 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.378685    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fe8cbe7-57c2-4ab2-8299-052e603c1200" path="/var/lib/kubelet/pods/4fe8cbe7-57c2-4ab2-8299-052e603c1200/volumes"
Jul 22 03:40:57.474034 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.473997    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/047e8949-cd0c-4319-8a5e-6e8c7b288182-extensions-socket-volume\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:40:57.474034 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.474026    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8xf8r\" (UniqueName: \"kubernetes.io/projected/4fe8cbe7-57c2-4ab2-8299-052e603c1200-kube-api-access-8xf8r\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:40:57.474034 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.474037    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdvkr\" (UniqueName: \"kubernetes.io/projected/047e8949-cd0c-4319-8a5e-6e8c7b288182-kube-api-access-sdvkr\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:40:57.501979 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.501948    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"
Jul 22 03:40:57.511344 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.511316    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54"
Jul 22 03:40:57.654060 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.653953    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"]
Jul 22 03:40:57.656525 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:40:57.656500    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c902b0_0aa1_4f2a_9d39_dac4edf2ddef.slice/crio-5e12850aeb7a984a76aebbed7444ce46e336eea740dcfb036437aa81d0b0d691 WatchSource:0}: Error finding container 5e12850aeb7a984a76aebbed7444ce46e336eea740dcfb036437aa81d0b0d691: Status 404 returned error can't find the container with id 5e12850aeb7a984a76aebbed7444ce46e336eea740dcfb036437aa81d0b0d691
Jul 22 03:40:57.668717 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.668695    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54"]
Jul 22 03:40:57.671792 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:40:57.671762    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fbee01a_be34_4b5a_a5f4_99ec5809715e.slice/crio-222ead4008b054d23d01844f4b4d6ae4a830939105ae47021d3929466eba70f7 WatchSource:0}: Error finding container 222ead4008b054d23d01844f4b4d6ae4a830939105ae47021d3929466eba70f7: Status 404 returned error can't find the container with id 222ead4008b054d23d01844f4b4d6ae4a830939105ae47021d3929466eba70f7
Jul 22 03:40:57.927844 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.927757    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"]
Jul 22 03:40:57.931256 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.931232    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"
Jul 22 03:40:57.944289 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.944259    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"]
Jul 22 03:40:57.979342 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.979300    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5bsp\" (UniqueName: \"kubernetes.io/projected/d70b5f53-1db6-4436-b095-1054bb8041f9-kube-api-access-v5bsp\") pod \"kuadrant-operator-controller-manager-86878c769f-hzmnh\" (UID: \"d70b5f53-1db6-4436-b095-1054bb8041f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"
Jul 22 03:40:57.979342 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:57.979340    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d70b5f53-1db6-4436-b095-1054bb8041f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hzmnh\" (UID: \"d70b5f53-1db6-4436-b095-1054bb8041f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"
Jul 22 03:40:58.054762 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.054727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:58.080565 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.080533    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5bsp\" (UniqueName: \"kubernetes.io/projected/d70b5f53-1db6-4436-b095-1054bb8041f9-kube-api-access-v5bsp\") pod \"kuadrant-operator-controller-manager-86878c769f-hzmnh\" (UID: \"d70b5f53-1db6-4436-b095-1054bb8041f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"
Jul 22 03:40:58.081024 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.080616    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d70b5f53-1db6-4436-b095-1054bb8041f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hzmnh\" (UID: \"d70b5f53-1db6-4436-b095-1054bb8041f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"
Jul 22 03:40:58.081096 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.081076    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d70b5f53-1db6-4436-b095-1054bb8041f9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hzmnh\" (UID: \"d70b5f53-1db6-4436-b095-1054bb8041f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"
Jul 22 03:40:58.090438 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.090412    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5bsp\" (UniqueName: \"kubernetes.io/projected/d70b5f53-1db6-4436-b095-1054bb8041f9-kube-api-access-v5bsp\") pod \"kuadrant-operator-controller-manager-86878c769f-hzmnh\" (UID: \"d70b5f53-1db6-4436-b095-1054bb8041f9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"
Jul 22 03:40:58.167293 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.167259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:40:58.237508 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.237478    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2xjch"
Jul 22 03:40:58.237753 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.237488    2569 scope.go:117] "RemoveContainer" containerID="740b5731ec44fb1b3b54049ac40a61f6d60dd96653d42484ecb260d008f332e2"
Jul 22 03:40:58.239212 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.239181    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54" event={"ID":"6fbee01a-be34-4b5a-a5f4-99ec5809715e","Type":"ContainerStarted","Data":"f25e3187ea67d9f5a7e81178000569990fd3d2506ad4bf98354d611b09e391a3"}
Jul 22 03:40:58.239308 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.239243    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54" event={"ID":"6fbee01a-be34-4b5a-a5f4-99ec5809715e","Type":"ContainerStarted","Data":"222ead4008b054d23d01844f4b4d6ae4a830939105ae47021d3929466eba70f7"}
Jul 22 03:40:58.239308 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.239300    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54"
Jul 22 03:40:58.241170 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.241146    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"
Jul 22 03:40:58.241288 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.241208    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74" event={"ID":"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef","Type":"ContainerStarted","Data":"2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f"}
Jul 22 03:40:58.241288 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.241246    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74" event={"ID":"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef","Type":"ContainerStarted","Data":"5e12850aeb7a984a76aebbed7444ce46e336eea740dcfb036437aa81d0b0d691"}
Jul 22 03:40:58.241288 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.241282    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"
Jul 22 03:40:58.242542 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.242525    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-b54b8"
Jul 22 03:40:58.250527 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.249949    2569 scope.go:117] "RemoveContainer" containerID="c104ebe267c6ae196e53d7edc44aa28ea589d1e5466bbadd691af76ca7b70bdc"
Jul 22 03:40:58.271022 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.270979    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54" podStartSLOduration=1.270965037 podStartE2EDuration="1.270965037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:40:58.268067581 +0000 UTC m=+435.435302244" watchObservedRunningTime="2026-07-22 03:40:58.270965037 +0000 UTC m=+435.438199701"
Jul 22 03:40:58.383264 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.383204    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74" podStartSLOduration=1.383183766 podStartE2EDuration="1.383183766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:40:58.298788992 +0000 UTC m=+435.466023659" watchObservedRunningTime="2026-07-22 03:40:58.383183766 +0000 UTC m=+435.550418613"
Jul 22 03:40:58.384944 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:58.384917    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"]
Jul 22 03:40:58.387990 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:40:58.387968    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd70b5f53_1db6_4436_b095_1054bb8041f9.slice/crio-cc997dd391fbe13f4c16dc1f3ccf7975742d43bc96b505299deb44a00fd5ec09 WatchSource:0}: Error finding container cc997dd391fbe13f4c16dc1f3ccf7975742d43bc96b505299deb44a00fd5ec09: Status 404 returned error can't find the container with id cc997dd391fbe13f4c16dc1f3ccf7975742d43bc96b505299deb44a00fd5ec09
Jul 22 03:40:59.250560 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:59.250524    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh" event={"ID":"d70b5f53-1db6-4436-b095-1054bb8041f9","Type":"ContainerStarted","Data":"6125d3eb54e40afa194bf8f64df160fefde58055d25d816a14d94e8caab76f43"}
Jul 22 03:40:59.251034 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:59.250577    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh" event={"ID":"d70b5f53-1db6-4436-b095-1054bb8041f9","Type":"ContainerStarted","Data":"cc997dd391fbe13f4c16dc1f3ccf7975742d43bc96b505299deb44a00fd5ec09"}
Jul 22 03:40:59.271458 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:40:59.271275    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh" podStartSLOduration=2.271257059 podStartE2EDuration="2.271257059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:40:59.270283775 +0000 UTC m=+436.437518452" watchObservedRunningTime="2026-07-22 03:40:59.271257059 +0000 UTC m=+436.438491725"
Jul 22 03:41:00.255315 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:00.255287    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"
Jul 22 03:41:01.040031 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:01.039994    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:01.144737 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:01.144698    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:03.505564 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:03.505440    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:03.606243 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:03.606192    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:09.234086 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:09.234044    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:09.253458 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:09.253433    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-8pt54"
Jul 22 03:41:09.253593 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:09.253512    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"
Jul 22 03:41:09.300818 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:09.300776    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:11.262893 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:11.262862    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"
Jul 22 03:41:11.338392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:11.338360    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"]
Jul 22 03:41:11.338583 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:11.338559    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74" podUID="a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef" containerName="manager" containerID="cri-o://2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f" gracePeriod=10
Jul 22 03:41:11.592632 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:11.592609    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"
Jul 22 03:41:11.693393 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:11.693363    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef-extensions-socket-volume\") pod \"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef\" (UID: \"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef\") "
Jul 22 03:41:11.693554 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:11.693435    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sbqd\" (UniqueName: \"kubernetes.io/projected/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef-kube-api-access-6sbqd\") pod \"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef\" (UID: \"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef\") "
Jul 22 03:41:11.693833 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:11.693812    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef" (UID: "a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:41:11.695663 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:11.695629    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef-kube-api-access-6sbqd" (OuterVolumeSpecName: "kube-api-access-6sbqd") pod "a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef" (UID: "a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef"). InnerVolumeSpecName "kube-api-access-6sbqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:41:11.795018 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:11.794975    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sbqd\" (UniqueName: \"kubernetes.io/projected/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef-kube-api-access-6sbqd\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:41:11.795018 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:11.795014    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef-extensions-socket-volume\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:41:12.313524 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:12.313490    2569 generic.go:356] "Generic (PLEG): container finished" podID="a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef" containerID="2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f" exitCode=0
Jul 22 03:41:12.314012 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:12.313530    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"
Jul 22 03:41:12.314012 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:12.313572    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74" event={"ID":"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef","Type":"ContainerDied","Data":"2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f"}
Jul 22 03:41:12.314012 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:12.313622    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74" event={"ID":"a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef","Type":"ContainerDied","Data":"5e12850aeb7a984a76aebbed7444ce46e336eea740dcfb036437aa81d0b0d691"}
Jul 22 03:41:12.314012 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:12.313666    2569 scope.go:117] "RemoveContainer" containerID="2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f"
Jul 22 03:41:12.322849 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:12.322830    2569 scope.go:117] "RemoveContainer" containerID="2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f"
Jul 22 03:41:12.323134 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:41:12.323111    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f\": container with ID starting with 2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f not found: ID does not exist" containerID="2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f"
Jul 22 03:41:12.323214 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:12.323148    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f"} err="failed to get container status \"2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f\": rpc error: code = NotFound desc = could not find container \"2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f\": container with ID starting with 2bc2683e26435b8295fc63086feb86163b8be2c2f0c27bc9dbc8ca8db8274f5f not found: ID does not exist"
Jul 22 03:41:12.336880 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:12.336839    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"]
Jul 22 03:41:12.342334 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:12.342309    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-s4d74"]
Jul 22 03:41:13.379326 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:13.379292    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef" path="/var/lib/kubelet/pods/a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef/volumes"
Jul 22 03:41:19.630546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:19.630502    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:19.689174 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:19.689143    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:20.029324 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:20.029285    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:20.094487 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:20.094448    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:23.830491 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:23.830451    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:23.931940 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:23.931904    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:24.891114 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:24.891074    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:24.952546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:24.952501    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:27.703121 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:27.703061    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:27.939557 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:27.939522    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:29.987245 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:29.987199    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:29.995187 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:29.995153    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"]
Jul 22 03:41:29.995536 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:29.995522    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef" containerName="manager"
Jul 22 03:41:29.995536 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:29.995536    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef" containerName="manager"
Jul 22 03:41:29.995671 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:29.995601    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0c902b0-0aa1-4f2a-9d39-dac4edf2ddef" containerName="manager"
Jul 22 03:41:30.001015 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.000992    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"
Jul 22 03:41:30.003753 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.003727    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 03:41:30.003889 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.003809    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bbdd8\""
Jul 22 03:41:30.010138 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.010099    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"]
Jul 22 03:41:30.090867 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.090826    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"]
Jul 22 03:41:30.094613 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.094583    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:30.148893 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.148850    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76bjd\" (UniqueName: \"kubernetes.io/projected/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8-kube-api-access-76bjd\") pod \"limitador-limitador-64c94fd64f-fmxg9\" (UID: \"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"
Jul 22 03:41:30.149079 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.148920    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8-config-file\") pod \"limitador-limitador-64c94fd64f-fmxg9\" (UID: \"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"
Jul 22 03:41:30.159700 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.159666    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:30.250100 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.250003    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76bjd\" (UniqueName: \"kubernetes.io/projected/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8-kube-api-access-76bjd\") pod \"limitador-limitador-64c94fd64f-fmxg9\" (UID: \"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"
Jul 22 03:41:30.250100 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.250071    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8-config-file\") pod \"limitador-limitador-64c94fd64f-fmxg9\" (UID: \"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"
Jul 22 03:41:30.250727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.250709    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8-config-file\") pod \"limitador-limitador-64c94fd64f-fmxg9\" (UID: \"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"
Jul 22 03:41:30.258657 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.258616    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76bjd\" (UniqueName: \"kubernetes.io/projected/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8-kube-api-access-76bjd\") pod \"limitador-limitador-64c94fd64f-fmxg9\" (UID: \"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"
Jul 22 03:41:30.312925 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.312885    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"
Jul 22 03:41:30.453851 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.453825    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"]
Jul 22 03:41:30.456830 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:41:30.456793    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod391fd6b6_21c4_440c_b9ed_5b3ac92dbca8.slice/crio-3b098516dae059dc7bbb663e7f7596788ac164e6a5752b11458a3762242ddf7a WatchSource:0}: Error finding container 3b098516dae059dc7bbb663e7f7596788ac164e6a5752b11458a3762242ddf7a: Status 404 returned error can't find the container with id 3b098516dae059dc7bbb663e7f7596788ac164e6a5752b11458a3762242ddf7a
Jul 22 03:41:30.789282 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.789253    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-pdpxs"]
Jul 22 03:41:30.792587 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.792565    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pdpxs"
Jul 22 03:41:30.795213 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.795196    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bmlf5\""
Jul 22 03:41:30.800866 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.800844    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-pdpxs"]
Jul 22 03:41:30.822469 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.822430    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:30.927096 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.927052    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:30.955917 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.955883    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-vqznj"]
Jul 22 03:41:30.957108 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.957083    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bswsw\" (UniqueName: \"kubernetes.io/projected/428d66e4-1d9f-4587-a306-5dbaaed73c10-kube-api-access-bswsw\") pod \"authorino-58cd955675-pdpxs\" (UID: \"428d66e4-1d9f-4587-a306-5dbaaed73c10\") " pod="kuadrant-system/authorino-58cd955675-pdpxs"
Jul 22 03:41:30.958336 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.958315    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vqznj"
Jul 22 03:41:30.966264 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:30.966240    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vqznj"]
Jul 22 03:41:31.057866 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:31.057776    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqfnk\" (UniqueName: \"kubernetes.io/projected/d7ccd110-3567-4708-8409-213ba56f53f9-kube-api-access-tqfnk\") pod \"authorino-75d556bd77-vqznj\" (UID: \"d7ccd110-3567-4708-8409-213ba56f53f9\") " pod="kuadrant-system/authorino-75d556bd77-vqznj"
Jul 22 03:41:31.057866 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:31.057835    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bswsw\" (UniqueName: \"kubernetes.io/projected/428d66e4-1d9f-4587-a306-5dbaaed73c10-kube-api-access-bswsw\") pod \"authorino-58cd955675-pdpxs\" (UID: \"428d66e4-1d9f-4587-a306-5dbaaed73c10\") " pod="kuadrant-system/authorino-58cd955675-pdpxs"
Jul 22 03:41:31.066756 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:31.066697    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bswsw\" (UniqueName: \"kubernetes.io/projected/428d66e4-1d9f-4587-a306-5dbaaed73c10-kube-api-access-bswsw\") pod \"authorino-58cd955675-pdpxs\" (UID: \"428d66e4-1d9f-4587-a306-5dbaaed73c10\") " pod="kuadrant-system/authorino-58cd955675-pdpxs"
Jul 22 03:41:31.103746 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:31.103495    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pdpxs"
Jul 22 03:41:31.158584 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:31.158483    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqfnk\" (UniqueName: \"kubernetes.io/projected/d7ccd110-3567-4708-8409-213ba56f53f9-kube-api-access-tqfnk\") pod \"authorino-75d556bd77-vqznj\" (UID: \"d7ccd110-3567-4708-8409-213ba56f53f9\") " pod="kuadrant-system/authorino-75d556bd77-vqznj"
Jul 22 03:41:31.175870 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:31.175632    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqfnk\" (UniqueName: \"kubernetes.io/projected/d7ccd110-3567-4708-8409-213ba56f53f9-kube-api-access-tqfnk\") pod \"authorino-75d556bd77-vqznj\" (UID: \"d7ccd110-3567-4708-8409-213ba56f53f9\") " pod="kuadrant-system/authorino-75d556bd77-vqznj"
Jul 22 03:41:31.270428 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:31.270232    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vqznj"
Jul 22 03:41:31.308957 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:31.306222    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-pdpxs"]
Jul 22 03:41:31.405899 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:31.405807    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9" event={"ID":"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8","Type":"ContainerStarted","Data":"3b098516dae059dc7bbb663e7f7596788ac164e6a5752b11458a3762242ddf7a"}
Jul 22 03:41:31.407605 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:31.407553    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pdpxs" event={"ID":"428d66e4-1d9f-4587-a306-5dbaaed73c10","Type":"ContainerStarted","Data":"4948047a55f5a9f03a42095daae90f59aa79aacf215d61248fc81e7471e005e4"}
Jul 22 03:41:31.468937 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:31.468865    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vqznj"]
Jul 22 03:41:31.472748 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:41:31.472715    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7ccd110_3567_4708_8409_213ba56f53f9.slice/crio-9288de0949fc5bd9aaa7a1a393a1dff05414aa4c0c0943f56e33852ccf189301 WatchSource:0}: Error finding container 9288de0949fc5bd9aaa7a1a393a1dff05414aa4c0c0943f56e33852ccf189301: Status 404 returned error can't find the container with id 9288de0949fc5bd9aaa7a1a393a1dff05414aa4c0c0943f56e33852ccf189301
Jul 22 03:41:32.422129 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:32.422088    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vqznj" event={"ID":"d7ccd110-3567-4708-8409-213ba56f53f9","Type":"ContainerStarted","Data":"9288de0949fc5bd9aaa7a1a393a1dff05414aa4c0c0943f56e33852ccf189301"}
Jul 22 03:41:36.446085 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:36.446049    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9" event={"ID":"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8","Type":"ContainerStarted","Data":"282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806"}
Jul 22 03:41:36.446543 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:36.446149    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"
Jul 22 03:41:36.447760 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:36.447727    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vqznj" event={"ID":"d7ccd110-3567-4708-8409-213ba56f53f9","Type":"ContainerStarted","Data":"5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9"}
Jul 22 03:41:36.449271 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:36.449241    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pdpxs" event={"ID":"428d66e4-1d9f-4587-a306-5dbaaed73c10","Type":"ContainerStarted","Data":"c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0"}
Jul 22 03:41:36.464274 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:36.464229    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9" podStartSLOduration=2.238883654 podStartE2EDuration="7.464215968s" totalImagesPullingTime="5.225332314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:41:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:41:36.462814486 +0000 UTC m=+473.630049150" watchObservedRunningTime="2026-07-22 03:41:36.464215968 +0000 UTC m=+473.631450633"
Jul 22 03:41:36.477832 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:36.477788    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-pdpxs" podStartSLOduration=2.10443418 podStartE2EDuration="6.477773256s" totalImagesPullingTime="4.373339076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:41:36.476823624 +0000 UTC m=+473.644058289" watchObservedRunningTime="2026-07-22 03:41:36.477773256 +0000 UTC m=+473.645007898"
Jul 22 03:41:36.493371 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:36.493313    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-vqznj" podStartSLOduration=2.272531421 podStartE2EDuration="6.49329571s" totalImagesPullingTime="4.220764289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:41:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:41:36.49269686 +0000 UTC m=+473.659931526" watchObservedRunningTime="2026-07-22 03:41:36.49329571 +0000 UTC m=+473.660530375"
Jul 22 03:41:36.515798 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:36.515773    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-pdpxs"]
Jul 22 03:41:38.458192 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:38.458128    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-pdpxs" podUID="428d66e4-1d9f-4587-a306-5dbaaed73c10" containerName="authorino" containerID="cri-o://c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0" gracePeriod=30
Jul 22 03:41:38.702172 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:38.702150    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pdpxs"
Jul 22 03:41:38.834942 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:38.834877    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bswsw\" (UniqueName: \"kubernetes.io/projected/428d66e4-1d9f-4587-a306-5dbaaed73c10-kube-api-access-bswsw\") pod \"428d66e4-1d9f-4587-a306-5dbaaed73c10\" (UID: \"428d66e4-1d9f-4587-a306-5dbaaed73c10\") "
Jul 22 03:41:38.836977 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:38.836955    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/428d66e4-1d9f-4587-a306-5dbaaed73c10-kube-api-access-bswsw" (OuterVolumeSpecName: "kube-api-access-bswsw") pod "428d66e4-1d9f-4587-a306-5dbaaed73c10" (UID: "428d66e4-1d9f-4587-a306-5dbaaed73c10"). InnerVolumeSpecName "kube-api-access-bswsw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:41:38.935447 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:38.935424    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bswsw\" (UniqueName: \"kubernetes.io/projected/428d66e4-1d9f-4587-a306-5dbaaed73c10-kube-api-access-bswsw\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:41:39.464785 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:39.464750    2569 generic.go:356] "Generic (PLEG): container finished" podID="428d66e4-1d9f-4587-a306-5dbaaed73c10" containerID="c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0" exitCode=0
Jul 22 03:41:39.465156 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:39.464799    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-pdpxs"
Jul 22 03:41:39.465156 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:39.464837    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pdpxs" event={"ID":"428d66e4-1d9f-4587-a306-5dbaaed73c10","Type":"ContainerDied","Data":"c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0"}
Jul 22 03:41:39.465156 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:39.464879    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-pdpxs" event={"ID":"428d66e4-1d9f-4587-a306-5dbaaed73c10","Type":"ContainerDied","Data":"4948047a55f5a9f03a42095daae90f59aa79aacf215d61248fc81e7471e005e4"}
Jul 22 03:41:39.465156 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:39.464895    2569 scope.go:117] "RemoveContainer" containerID="c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0"
Jul 22 03:41:39.473402 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:39.473387    2569 scope.go:117] "RemoveContainer" containerID="c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0"
Jul 22 03:41:39.473710 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:41:39.473689    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0\": container with ID starting with c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0 not found: ID does not exist" containerID="c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0"
Jul 22 03:41:39.473788 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:39.473722    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0"} err="failed to get container status \"c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0\": rpc error: code = NotFound desc = could not find container \"c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0\": container with ID starting with c18cbccc6311c29b3d8721c03963c71bc327c16eb063950b688a5f3e6749e3d0 not found: ID does not exist"
Jul 22 03:41:39.483184 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:39.483161    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-pdpxs"]
Jul 22 03:41:39.486679 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:39.486630    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-pdpxs"]
Jul 22 03:41:39.782756 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:39.782712    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:39.844169 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:39.844135    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:40.447187 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:40.447150    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:40.524536 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:40.524493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:41.378115 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:41.378079    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="428d66e4-1d9f-4587-a306-5dbaaed73c10" path="/var/lib/kubelet/pods/428d66e4-1d9f-4587-a306-5dbaaed73c10/volumes"
Jul 22 03:41:46.238191 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:46.238140    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"]
Jul 22 03:41:46.238601 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:46.238384    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9" podUID="391fd6b6-21c4-440c-b9ed-5b3ac92dbca8" containerName="limitador" containerID="cri-o://282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806" gracePeriod=30
Jul 22 03:41:46.239122 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:46.239110    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"
Jul 22 03:41:46.783412 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:46.783386    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"
Jul 22 03:41:46.806471 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:46.806399    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76bjd\" (UniqueName: \"kubernetes.io/projected/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8-kube-api-access-76bjd\") pod \"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8\" (UID: \"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8\") "
Jul 22 03:41:46.806574 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:46.806538    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8-config-file\") pod \"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8\" (UID: \"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8\") "
Jul 22 03:41:46.809740 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:46.807253    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8-config-file" (OuterVolumeSpecName: "config-file") pod "391fd6b6-21c4-440c-b9ed-5b3ac92dbca8" (UID: "391fd6b6-21c4-440c-b9ed-5b3ac92dbca8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 03:41:46.815871 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:46.815833    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8-kube-api-access-76bjd" (OuterVolumeSpecName: "kube-api-access-76bjd") pod "391fd6b6-21c4-440c-b9ed-5b3ac92dbca8" (UID: "391fd6b6-21c4-440c-b9ed-5b3ac92dbca8"). InnerVolumeSpecName "kube-api-access-76bjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:41:46.908623 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:46.908599    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76bjd\" (UniqueName: \"kubernetes.io/projected/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8-kube-api-access-76bjd\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:41:46.908623 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:46.908622    2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8-config-file\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:41:47.503735 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:47.503704    2569 generic.go:356] "Generic (PLEG): container finished" podID="391fd6b6-21c4-440c-b9ed-5b3ac92dbca8" containerID="282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806" exitCode=0
Jul 22 03:41:47.504132 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:47.503765    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9" event={"ID":"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8","Type":"ContainerDied","Data":"282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806"}
Jul 22 03:41:47.504132 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:47.503806    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9" event={"ID":"391fd6b6-21c4-440c-b9ed-5b3ac92dbca8","Type":"ContainerDied","Data":"3b098516dae059dc7bbb663e7f7596788ac164e6a5752b11458a3762242ddf7a"}
Jul 22 03:41:47.504132 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:47.503826    2569 scope.go:117] "RemoveContainer" containerID="282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806"
Jul 22 03:41:47.504132 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:47.503768    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"
Jul 22 03:41:47.512310 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:47.512291    2569 scope.go:117] "RemoveContainer" containerID="282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806"
Jul 22 03:41:47.512588 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:41:47.512568    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806\": container with ID starting with 282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806 not found: ID does not exist" containerID="282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806"
Jul 22 03:41:47.512666 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:47.512597    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806"} err="failed to get container status \"282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806\": rpc error: code = NotFound desc = could not find container \"282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806\": container with ID starting with 282643f673de57dc9f1b1d3eb2321aedba3ea4cab110c5c651c41e614020b806 not found: ID does not exist"
Jul 22 03:41:47.520381 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:47.520356    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"]
Jul 22 03:41:47.524366 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:47.524343    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-fmxg9"]
Jul 22 03:41:49.378935 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:49.378901    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="391fd6b6-21c4-440c-b9ed-5b3ac92dbca8" path="/var/lib/kubelet/pods/391fd6b6-21c4-440c-b9ed-5b3ac92dbca8/volumes"
Jul 22 03:41:51.202517 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.202482    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:51.296982 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.296956    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:51.397178 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.397132    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:51.650715 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.650611    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"]
Jul 22 03:41:51.650982 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.650970    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="428d66e4-1d9f-4587-a306-5dbaaed73c10" containerName="authorino"
Jul 22 03:41:51.651072 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.650983    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="428d66e4-1d9f-4587-a306-5dbaaed73c10" containerName="authorino"
Jul 22 03:41:51.651072 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.650992    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="391fd6b6-21c4-440c-b9ed-5b3ac92dbca8" containerName="limitador"
Jul 22 03:41:51.651072 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.650997    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="391fd6b6-21c4-440c-b9ed-5b3ac92dbca8" containerName="limitador"
Jul 22 03:41:51.651072 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.651048    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="428d66e4-1d9f-4587-a306-5dbaaed73c10" containerName="authorino"
Jul 22 03:41:51.651072 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.651057    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="391fd6b6-21c4-440c-b9ed-5b3ac92dbca8" containerName="limitador"
Jul 22 03:41:51.654016 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.653999    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"
Jul 22 03:41:51.657099 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.657070    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 03:41:51.657099 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.657073    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 03:41:51.657241 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.657227    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 22 03:41:51.661327 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.661311    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-cwqst\""
Jul 22 03:41:51.669069 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.669045    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"]
Jul 22 03:41:51.693726 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.693682    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:41:51.753721 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.753686    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ed0511b6-ff0c-4c38-8475-00a8e0c19bc2-data\") pod \"postgres-69fb4594cf-t8r8v\" (UID: \"ed0511b6-ff0c-4c38-8475-00a8e0c19bc2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"
Jul 22 03:41:51.753721 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.753727    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8jp5\" (UniqueName: \"kubernetes.io/projected/ed0511b6-ff0c-4c38-8475-00a8e0c19bc2-kube-api-access-n8jp5\") pod \"postgres-69fb4594cf-t8r8v\" (UID: \"ed0511b6-ff0c-4c38-8475-00a8e0c19bc2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"
Jul 22 03:41:51.854858 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.854824    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ed0511b6-ff0c-4c38-8475-00a8e0c19bc2-data\") pod \"postgres-69fb4594cf-t8r8v\" (UID: \"ed0511b6-ff0c-4c38-8475-00a8e0c19bc2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"
Jul 22 03:41:51.854858 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.854863    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8jp5\" (UniqueName: \"kubernetes.io/projected/ed0511b6-ff0c-4c38-8475-00a8e0c19bc2-kube-api-access-n8jp5\") pod \"postgres-69fb4594cf-t8r8v\" (UID: \"ed0511b6-ff0c-4c38-8475-00a8e0c19bc2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"
Jul 22 03:41:51.855212 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.855193    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ed0511b6-ff0c-4c38-8475-00a8e0c19bc2-data\") pod \"postgres-69fb4594cf-t8r8v\" (UID: \"ed0511b6-ff0c-4c38-8475-00a8e0c19bc2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"
Jul 22 03:41:51.863689 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.863633    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8jp5\" (UniqueName: \"kubernetes.io/projected/ed0511b6-ff0c-4c38-8475-00a8e0c19bc2-kube-api-access-n8jp5\") pod \"postgres-69fb4594cf-t8r8v\" (UID: \"ed0511b6-ff0c-4c38-8475-00a8e0c19bc2\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"
Jul 22 03:41:51.963832 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:51.963793    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"
Jul 22 03:41:52.099711 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:52.098119    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"]
Jul 22 03:41:52.530389 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:52.530350    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v" event={"ID":"ed0511b6-ff0c-4c38-8475-00a8e0c19bc2","Type":"ContainerStarted","Data":"a4e1a6e1c53b0d8c9b6eed0162b98d50a0c92ef3b1da13975f8011d2924db3a2"}
Jul 22 03:41:57.562261 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:57.562229    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v" event={"ID":"ed0511b6-ff0c-4c38-8475-00a8e0c19bc2","Type":"ContainerStarted","Data":"61f000ba36e4dd24946d72f05712d6ff4647750ffc9dd6d8fd6b26837e7069b7"}
Jul 22 03:41:57.562702 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:57.562305    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"
Jul 22 03:41:57.582150 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:41:57.582103    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v" podStartSLOduration=1.9034509160000002 podStartE2EDuration="6.582089959s" totalImagesPullingTime="4.678639043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:41:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:41:57.580378356 +0000 UTC m=+494.747613023" watchObservedRunningTime="2026-07-22 03:41:57.582089959 +0000 UTC m=+494.749324666"
Jul 22 03:42:03.597495 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:03.597468    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t8r8v"
Jul 22 03:42:04.002151 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.002103    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:04.138923 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.138883    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tldx4"]
Jul 22 03:42:04.141589 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.141567    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tldx4"
Jul 22 03:42:04.147365 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.147338    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:04.148444 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.148426    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tldx4"]
Jul 22 03:42:04.267623 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.267546    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj89g\" (UniqueName: \"kubernetes.io/projected/bc4605ea-9612-4140-920e-cb29123abfe6-kube-api-access-cj89g\") pod \"authorino-5d4b67c446-tldx4\" (UID: \"bc4605ea-9612-4140-920e-cb29123abfe6\") " pod="kuadrant-system/authorino-5d4b67c446-tldx4"
Jul 22 03:42:04.368358 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.368324    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj89g\" (UniqueName: \"kubernetes.io/projected/bc4605ea-9612-4140-920e-cb29123abfe6-kube-api-access-cj89g\") pod \"authorino-5d4b67c446-tldx4\" (UID: \"bc4605ea-9612-4140-920e-cb29123abfe6\") " pod="kuadrant-system/authorino-5d4b67c446-tldx4"
Jul 22 03:42:04.374017 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.373995    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tldx4"]
Jul 22 03:42:04.374190 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:42:04.374172    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cj89g], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-tldx4" podUID="bc4605ea-9612-4140-920e-cb29123abfe6"
Jul 22 03:42:04.378270 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.378249    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj89g\" (UniqueName: \"kubernetes.io/projected/bc4605ea-9612-4140-920e-cb29123abfe6-kube-api-access-cj89g\") pod \"authorino-5d4b67c446-tldx4\" (UID: \"bc4605ea-9612-4140-920e-cb29123abfe6\") " pod="kuadrant-system/authorino-5d4b67c446-tldx4"
Jul 22 03:42:04.403241 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.403220    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b59bd454c-kpf7n"]
Jul 22 03:42:04.406012 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.405995    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b59bd454c-kpf7n"
Jul 22 03:42:04.416364 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.416343    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b59bd454c-kpf7n"]
Jul 22 03:42:04.468942 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.468916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mp8jp\" (UniqueName: \"kubernetes.io/projected/5bc66bed-bdfb-4ae5-934f-8564117b1e2a-kube-api-access-mp8jp\") pod \"authorino-7b59bd454c-kpf7n\" (UID: \"5bc66bed-bdfb-4ae5-934f-8564117b1e2a\") " pod="kuadrant-system/authorino-7b59bd454c-kpf7n"
Jul 22 03:42:04.569447 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.569389    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mp8jp\" (UniqueName: \"kubernetes.io/projected/5bc66bed-bdfb-4ae5-934f-8564117b1e2a-kube-api-access-mp8jp\") pod \"authorino-7b59bd454c-kpf7n\" (UID: \"5bc66bed-bdfb-4ae5-934f-8564117b1e2a\") " pod="kuadrant-system/authorino-7b59bd454c-kpf7n"
Jul 22 03:42:04.579981 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.579956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mp8jp\" (UniqueName: \"kubernetes.io/projected/5bc66bed-bdfb-4ae5-934f-8564117b1e2a-kube-api-access-mp8jp\") pod \"authorino-7b59bd454c-kpf7n\" (UID: \"5bc66bed-bdfb-4ae5-934f-8564117b1e2a\") " pod="kuadrant-system/authorino-7b59bd454c-kpf7n"
Jul 22 03:42:04.584902 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.584879    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b59bd454c-kpf7n"]
Jul 22 03:42:04.585103 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.585091    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b59bd454c-kpf7n"
Jul 22 03:42:04.595755 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.595618    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tldx4"
Jul 22 03:42:04.611557 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.611538    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tldx4"
Jul 22 03:42:04.620914 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.620893    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cf9f9bfb7-nzdvb"]
Jul 22 03:42:04.623555 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.623538    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb"
Jul 22 03:42:04.626048 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.626030    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 22 03:42:04.633396 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.633373    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cf9f9bfb7-nzdvb"]
Jul 22 03:42:04.670421 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.670394    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj89g\" (UniqueName: \"kubernetes.io/projected/bc4605ea-9612-4140-920e-cb29123abfe6-kube-api-access-cj89g\") pod \"bc4605ea-9612-4140-920e-cb29123abfe6\" (UID: \"bc4605ea-9612-4140-920e-cb29123abfe6\") "
Jul 22 03:42:04.670579 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.670523    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjgxt\" (UniqueName: \"kubernetes.io/projected/15ee9475-91e0-433c-89bc-fabd5261368c-kube-api-access-zjgxt\") pod \"authorino-cf9f9bfb7-nzdvb\" (UID: \"15ee9475-91e0-433c-89bc-fabd5261368c\") " pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb"
Jul 22 03:42:04.670579 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.670570    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15ee9475-91e0-433c-89bc-fabd5261368c-tls-cert\") pod \"authorino-cf9f9bfb7-nzdvb\" (UID: \"15ee9475-91e0-433c-89bc-fabd5261368c\") " pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb"
Jul 22 03:42:04.673055 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.672532    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc4605ea-9612-4140-920e-cb29123abfe6-kube-api-access-cj89g" (OuterVolumeSpecName: "kube-api-access-cj89g") pod "bc4605ea-9612-4140-920e-cb29123abfe6" (UID: "bc4605ea-9612-4140-920e-cb29123abfe6"). InnerVolumeSpecName "kube-api-access-cj89g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:42:04.724308 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.724285    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b59bd454c-kpf7n"]
Jul 22 03:42:04.726039 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:42:04.726018    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bc66bed_bdfb_4ae5_934f_8564117b1e2a.slice/crio-bf46a104382c72ca9a7f5b1bedf5a99189e4b9b505e2158b6e960b76736b39c9 WatchSource:0}: Error finding container bf46a104382c72ca9a7f5b1bedf5a99189e4b9b505e2158b6e960b76736b39c9: Status 404 returned error can't find the container with id bf46a104382c72ca9a7f5b1bedf5a99189e4b9b505e2158b6e960b76736b39c9
Jul 22 03:42:04.771875 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.771853    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15ee9475-91e0-433c-89bc-fabd5261368c-tls-cert\") pod \"authorino-cf9f9bfb7-nzdvb\" (UID: \"15ee9475-91e0-433c-89bc-fabd5261368c\") " pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb"
Jul 22 03:42:04.771975 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.771928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjgxt\" (UniqueName: \"kubernetes.io/projected/15ee9475-91e0-433c-89bc-fabd5261368c-kube-api-access-zjgxt\") pod \"authorino-cf9f9bfb7-nzdvb\" (UID: \"15ee9475-91e0-433c-89bc-fabd5261368c\") " pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb"
Jul 22 03:42:04.772019 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.771976    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj89g\" (UniqueName: \"kubernetes.io/projected/bc4605ea-9612-4140-920e-cb29123abfe6-kube-api-access-cj89g\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:42:04.774209 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.774179    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15ee9475-91e0-433c-89bc-fabd5261368c-tls-cert\") pod \"authorino-cf9f9bfb7-nzdvb\" (UID: \"15ee9475-91e0-433c-89bc-fabd5261368c\") " pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb"
Jul 22 03:42:04.780309 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.780291    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjgxt\" (UniqueName: \"kubernetes.io/projected/15ee9475-91e0-433c-89bc-fabd5261368c-kube-api-access-zjgxt\") pod \"authorino-cf9f9bfb7-nzdvb\" (UID: \"15ee9475-91e0-433c-89bc-fabd5261368c\") " pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb"
Jul 22 03:42:04.934697 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:04.934608    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb"
Jul 22 03:42:05.070840 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.070733    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cf9f9bfb7-nzdvb"]
Jul 22 03:42:05.073427 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:42:05.073398    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15ee9475_91e0_433c_89bc_fabd5261368c.slice/crio-d9d1ec257b976f54a5c0c944465825495d2302b76c0d9b675eff941f7c53ec63 WatchSource:0}: Error finding container d9d1ec257b976f54a5c0c944465825495d2302b76c0d9b675eff941f7c53ec63: Status 404 returned error can't find the container with id d9d1ec257b976f54a5c0c944465825495d2302b76c0d9b675eff941f7c53ec63
Jul 22 03:42:05.603009 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.602972    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb" event={"ID":"15ee9475-91e0-433c-89bc-fabd5261368c","Type":"ContainerStarted","Data":"7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e"}
Jul 22 03:42:05.603220 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.603023    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb" event={"ID":"15ee9475-91e0-433c-89bc-fabd5261368c","Type":"ContainerStarted","Data":"d9d1ec257b976f54a5c0c944465825495d2302b76c0d9b675eff941f7c53ec63"}
Jul 22 03:42:05.604519 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.604475    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b59bd454c-kpf7n" event={"ID":"5bc66bed-bdfb-4ae5-934f-8564117b1e2a","Type":"ContainerStarted","Data":"88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5"}
Jul 22 03:42:05.604519 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.604494    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-tldx4"
Jul 22 03:42:05.604519 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.604518    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b59bd454c-kpf7n" event={"ID":"5bc66bed-bdfb-4ae5-934f-8564117b1e2a","Type":"ContainerStarted","Data":"bf46a104382c72ca9a7f5b1bedf5a99189e4b9b505e2158b6e960b76736b39c9"}
Jul 22 03:42:05.604779 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.604574    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7b59bd454c-kpf7n" podUID="5bc66bed-bdfb-4ae5-934f-8564117b1e2a" containerName="authorino" containerID="cri-o://88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5" gracePeriod=30
Jul 22 03:42:05.620025 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.619979    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb" podStartSLOduration=1.184675514 podStartE2EDuration="1.619962677s" totalImagesPullingTime="435.287163ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:42:05.617635655 +0000 UTC m=+502.784870318" watchObservedRunningTime="2026-07-22 03:42:05.619962677 +0000 UTC m=+502.787197340"
Jul 22 03:42:05.669151 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.668624    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vqznj"]
Jul 22 03:42:05.669151 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.668905    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-vqznj" podUID="d7ccd110-3567-4708-8409-213ba56f53f9" containerName="authorino" containerID="cri-o://5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9" gracePeriod=30
Jul 22 03:42:05.674004 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.673953    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tldx4"]
Jul 22 03:42:05.675993 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.675957    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-tldx4"]
Jul 22 03:42:05.686716 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.686632    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b59bd454c-kpf7n" podStartSLOduration=1.2693348549999999 podStartE2EDuration="1.686614772s" totalImagesPullingTime="417.279917ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:42:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:42:05.683976054 +0000 UTC m=+502.851210723" watchObservedRunningTime="2026-07-22 03:42:05.686614772 +0000 UTC m=+502.853849476"
Jul 22 03:42:05.913185 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.913162    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b59bd454c-kpf7n"
Jul 22 03:42:05.941404 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.941381    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vqznj"
Jul 22 03:42:05.984162 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.984134    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mp8jp\" (UniqueName: \"kubernetes.io/projected/5bc66bed-bdfb-4ae5-934f-8564117b1e2a-kube-api-access-mp8jp\") pod \"5bc66bed-bdfb-4ae5-934f-8564117b1e2a\" (UID: \"5bc66bed-bdfb-4ae5-934f-8564117b1e2a\") "
Jul 22 03:42:05.986306 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:05.986282    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc66bed-bdfb-4ae5-934f-8564117b1e2a-kube-api-access-mp8jp" (OuterVolumeSpecName: "kube-api-access-mp8jp") pod "5bc66bed-bdfb-4ae5-934f-8564117b1e2a" (UID: "5bc66bed-bdfb-4ae5-934f-8564117b1e2a"). InnerVolumeSpecName "kube-api-access-mp8jp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:42:06.084895 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.084814    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tqfnk\" (UniqueName: \"kubernetes.io/projected/d7ccd110-3567-4708-8409-213ba56f53f9-kube-api-access-tqfnk\") pod \"d7ccd110-3567-4708-8409-213ba56f53f9\" (UID: \"d7ccd110-3567-4708-8409-213ba56f53f9\") "
Jul 22 03:42:06.085128 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.085110    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mp8jp\" (UniqueName: \"kubernetes.io/projected/5bc66bed-bdfb-4ae5-934f-8564117b1e2a-kube-api-access-mp8jp\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:42:06.087077 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.087032    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7ccd110-3567-4708-8409-213ba56f53f9-kube-api-access-tqfnk" (OuterVolumeSpecName: "kube-api-access-tqfnk") pod "d7ccd110-3567-4708-8409-213ba56f53f9" (UID: "d7ccd110-3567-4708-8409-213ba56f53f9"). InnerVolumeSpecName "kube-api-access-tqfnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:42:06.185666 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.185609    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tqfnk\" (UniqueName: \"kubernetes.io/projected/d7ccd110-3567-4708-8409-213ba56f53f9-kube-api-access-tqfnk\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:42:06.610971 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.610932    2569 generic.go:356] "Generic (PLEG): container finished" podID="d7ccd110-3567-4708-8409-213ba56f53f9" containerID="5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9" exitCode=0
Jul 22 03:42:06.610971 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.610972    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-vqznj"
Jul 22 03:42:06.611194 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.611023    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vqznj" event={"ID":"d7ccd110-3567-4708-8409-213ba56f53f9","Type":"ContainerDied","Data":"5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9"}
Jul 22 03:42:06.611194 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.611066    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-vqznj" event={"ID":"d7ccd110-3567-4708-8409-213ba56f53f9","Type":"ContainerDied","Data":"9288de0949fc5bd9aaa7a1a393a1dff05414aa4c0c0943f56e33852ccf189301"}
Jul 22 03:42:06.611194 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.611087    2569 scope.go:117] "RemoveContainer" containerID="5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9"
Jul 22 03:42:06.612511 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.612291    2569 generic.go:356] "Generic (PLEG): container finished" podID="5bc66bed-bdfb-4ae5-934f-8564117b1e2a" containerID="88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5" exitCode=0
Jul 22 03:42:06.612511 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.612324    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b59bd454c-kpf7n"
Jul 22 03:42:06.612511 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.612384    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b59bd454c-kpf7n" event={"ID":"5bc66bed-bdfb-4ae5-934f-8564117b1e2a","Type":"ContainerDied","Data":"88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5"}
Jul 22 03:42:06.612511 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.612423    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b59bd454c-kpf7n" event={"ID":"5bc66bed-bdfb-4ae5-934f-8564117b1e2a","Type":"ContainerDied","Data":"bf46a104382c72ca9a7f5b1bedf5a99189e4b9b505e2158b6e960b76736b39c9"}
Jul 22 03:42:06.621164 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.621141    2569 scope.go:117] "RemoveContainer" containerID="5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9"
Jul 22 03:42:06.621450 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:42:06.621401    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9\": container with ID starting with 5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9 not found: ID does not exist" containerID="5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9"
Jul 22 03:42:06.621450 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.621423    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9"} err="failed to get container status \"5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9\": rpc error: code = NotFound desc = could not find container \"5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9\": container with ID starting with 5385ca99ae538b664d16ac2a26993895ae76a60c5f3a360a042d0a844673ebc9 not found: ID does not exist"
Jul 22 03:42:06.621450 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.621447    2569 scope.go:117] "RemoveContainer" containerID="88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5"
Jul 22 03:42:06.629299 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.629283    2569 scope.go:117] "RemoveContainer" containerID="88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5"
Jul 22 03:42:06.629546 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:42:06.629528    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5\": container with ID starting with 88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5 not found: ID does not exist" containerID="88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5"
Jul 22 03:42:06.629600 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.629553    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5"} err="failed to get container status \"88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5\": rpc error: code = NotFound desc = could not find container \"88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5\": container with ID starting with 88e8499f199f8666fa32112fc28756907d88730140696a50d388cc5f974a10b5 not found: ID does not exist"
Jul 22 03:42:06.632619 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.632598    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vqznj"]
Jul 22 03:42:06.636847 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.636787    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-vqznj"]
Jul 22 03:42:06.646885 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.646862    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b59bd454c-kpf7n"]
Jul 22 03:42:06.650782 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:06.650760    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b59bd454c-kpf7n"]
Jul 22 03:42:07.378762 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:07.378731    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bc66bed-bdfb-4ae5-934f-8564117b1e2a" path="/var/lib/kubelet/pods/5bc66bed-bdfb-4ae5-934f-8564117b1e2a/volumes"
Jul 22 03:42:07.379079 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:07.379065    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc4605ea-9612-4140-920e-cb29123abfe6" path="/var/lib/kubelet/pods/bc4605ea-9612-4140-920e-cb29123abfe6/volumes"
Jul 22 03:42:07.379264 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:07.379253    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7ccd110-3567-4708-8409-213ba56f53f9" path="/var/lib/kubelet/pods/d7ccd110-3567-4708-8409-213ba56f53f9/volumes"
Jul 22 03:42:10.390101 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.390062    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:10.499545 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.499511    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:10.599424 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.599396    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:10.604795 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.604764    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74d8745f54-gf22b"]
Jul 22 03:42:10.605219 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.605200    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7ccd110-3567-4708-8409-213ba56f53f9" containerName="authorino"
Jul 22 03:42:10.605310 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.605226    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7ccd110-3567-4708-8409-213ba56f53f9" containerName="authorino"
Jul 22 03:42:10.605310 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.605246    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc66bed-bdfb-4ae5-934f-8564117b1e2a" containerName="authorino"
Jul 22 03:42:10.605310 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.605251    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc66bed-bdfb-4ae5-934f-8564117b1e2a" containerName="authorino"
Jul 22 03:42:10.605400 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.605317    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7ccd110-3567-4708-8409-213ba56f53f9" containerName="authorino"
Jul 22 03:42:10.605400 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.605326    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bc66bed-bdfb-4ae5-934f-8564117b1e2a" containerName="authorino"
Jul 22 03:42:10.608656 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.608625    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74d8745f54-gf22b"
Jul 22 03:42:10.611327 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.611298    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fkk4q\""
Jul 22 03:42:10.611327 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.611301    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 03:42:10.611490 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.611323    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 03:42:10.620271 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.620246    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74d8745f54-gf22b"]
Jul 22 03:42:10.733768 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.728696    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b4c9944-2916-4e70-b71a-8a53935c1327-webhook-cert\") pod \"maas-controller-74d8745f54-gf22b\" (UID: \"6b4c9944-2916-4e70-b71a-8a53935c1327\") " pod="opendatahub/maas-controller-74d8745f54-gf22b"
Jul 22 03:42:10.733768 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.728867    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm5wr\" (UniqueName: \"kubernetes.io/projected/6b4c9944-2916-4e70-b71a-8a53935c1327-kube-api-access-gm5wr\") pod \"maas-controller-74d8745f54-gf22b\" (UID: \"6b4c9944-2916-4e70-b71a-8a53935c1327\") " pod="opendatahub/maas-controller-74d8745f54-gf22b"
Jul 22 03:42:10.830267 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.830228    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b4c9944-2916-4e70-b71a-8a53935c1327-webhook-cert\") pod \"maas-controller-74d8745f54-gf22b\" (UID: \"6b4c9944-2916-4e70-b71a-8a53935c1327\") " pod="opendatahub/maas-controller-74d8745f54-gf22b"
Jul 22 03:42:10.830444 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.830297    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm5wr\" (UniqueName: \"kubernetes.io/projected/6b4c9944-2916-4e70-b71a-8a53935c1327-kube-api-access-gm5wr\") pod \"maas-controller-74d8745f54-gf22b\" (UID: \"6b4c9944-2916-4e70-b71a-8a53935c1327\") " pod="opendatahub/maas-controller-74d8745f54-gf22b"
Jul 22 03:42:10.832955 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.832935    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b4c9944-2916-4e70-b71a-8a53935c1327-webhook-cert\") pod \"maas-controller-74d8745f54-gf22b\" (UID: \"6b4c9944-2916-4e70-b71a-8a53935c1327\") " pod="opendatahub/maas-controller-74d8745f54-gf22b"
Jul 22 03:42:10.838779 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.838743    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm5wr\" (UniqueName: \"kubernetes.io/projected/6b4c9944-2916-4e70-b71a-8a53935c1327-kube-api-access-gm5wr\") pod \"maas-controller-74d8745f54-gf22b\" (UID: \"6b4c9944-2916-4e70-b71a-8a53935c1327\") " pod="opendatahub/maas-controller-74d8745f54-gf22b"
Jul 22 03:42:10.919297 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:10.919261    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74d8745f54-gf22b"
Jul 22 03:42:11.059929 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:11.059906    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74d8745f54-gf22b"]
Jul 22 03:42:11.062264 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:42:11.062239    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4c9944_2916_4e70_b71a_8a53935c1327.slice/crio-a9a5a0ca6020fbcdf4d0d13cdc9ccf6e1e0d846602e1752b460743ead911f05d WatchSource:0}: Error finding container a9a5a0ca6020fbcdf4d0d13cdc9ccf6e1e0d846602e1752b460743ead911f05d: Status 404 returned error can't find the container with id a9a5a0ca6020fbcdf4d0d13cdc9ccf6e1e0d846602e1752b460743ead911f05d
Jul 22 03:42:11.641715 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:11.641677    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74d8745f54-gf22b" event={"ID":"6b4c9944-2916-4e70-b71a-8a53935c1327","Type":"ContainerStarted","Data":"a9a5a0ca6020fbcdf4d0d13cdc9ccf6e1e0d846602e1752b460743ead911f05d"}
Jul 22 03:42:13.231472 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:13.231438    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:13.324667 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:13.324608    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:13.654531 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:13.654492    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74d8745f54-gf22b" event={"ID":"6b4c9944-2916-4e70-b71a-8a53935c1327","Type":"ContainerStarted","Data":"de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c"}
Jul 22 03:42:13.654711 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:13.654633    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74d8745f54-gf22b"
Jul 22 03:42:13.674322 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:13.674271    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74d8745f54-gf22b" podStartSLOduration=1.622544992 podStartE2EDuration="3.674253447s" totalImagesPullingTime="2.051708455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:42:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:42:13.673584563 +0000 UTC m=+510.840819229" watchObservedRunningTime="2026-07-22 03:42:13.674253447 +0000 UTC m=+510.841488126"
Jul 22 03:42:21.758706 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:21.758672    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:24.662112 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:24.662072    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74d8745f54-gf22b"
Jul 22 03:42:44.906234 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:44.906200    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:45.003146 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.003109    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:45.584659 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.584611    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:45.638568 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.638537    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"]
Jul 22 03:42:45.641786 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.641770    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:45.645479 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.645435    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 22 03:42:45.645592 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.645435    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9dw9g\""
Jul 22 03:42:45.652094 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.652072    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"]
Jul 22 03:42:45.673575 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.673544    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:45.746614 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.746587    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d50ca4-2555-48c8-9fc5-daa4cb072ba6-openshift-service-ca\") pod \"maas-api-5b77f8c7b9-jc9wv\" (UID: \"f9d50ca4-2555-48c8-9fc5-daa4cb072ba6\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:45.746768 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.746702    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9d50ca4-2555-48c8-9fc5-daa4cb072ba6-maas-api-tls\") pod \"maas-api-5b77f8c7b9-jc9wv\" (UID: \"f9d50ca4-2555-48c8-9fc5-daa4cb072ba6\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:45.746768 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.746721    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvbsl\" (UniqueName: \"kubernetes.io/projected/f9d50ca4-2555-48c8-9fc5-daa4cb072ba6-kube-api-access-wvbsl\") pod \"maas-api-5b77f8c7b9-jc9wv\" (UID: \"f9d50ca4-2555-48c8-9fc5-daa4cb072ba6\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:45.847256 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.847192    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d50ca4-2555-48c8-9fc5-daa4cb072ba6-openshift-service-ca\") pod \"maas-api-5b77f8c7b9-jc9wv\" (UID: \"f9d50ca4-2555-48c8-9fc5-daa4cb072ba6\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:45.847367 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.847260    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9d50ca4-2555-48c8-9fc5-daa4cb072ba6-maas-api-tls\") pod \"maas-api-5b77f8c7b9-jc9wv\" (UID: \"f9d50ca4-2555-48c8-9fc5-daa4cb072ba6\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:45.847367 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.847284    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvbsl\" (UniqueName: \"kubernetes.io/projected/f9d50ca4-2555-48c8-9fc5-daa4cb072ba6-kube-api-access-wvbsl\") pod \"maas-api-5b77f8c7b9-jc9wv\" (UID: \"f9d50ca4-2555-48c8-9fc5-daa4cb072ba6\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:45.847909 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.847885    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9d50ca4-2555-48c8-9fc5-daa4cb072ba6-openshift-service-ca\") pod \"maas-api-5b77f8c7b9-jc9wv\" (UID: \"f9d50ca4-2555-48c8-9fc5-daa4cb072ba6\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:45.849698 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.849679    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9d50ca4-2555-48c8-9fc5-daa4cb072ba6-maas-api-tls\") pod \"maas-api-5b77f8c7b9-jc9wv\" (UID: \"f9d50ca4-2555-48c8-9fc5-daa4cb072ba6\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:45.856770 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.856744    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvbsl\" (UniqueName: \"kubernetes.io/projected/f9d50ca4-2555-48c8-9fc5-daa4cb072ba6-kube-api-access-wvbsl\") pod \"maas-api-5b77f8c7b9-jc9wv\" (UID: \"f9d50ca4-2555-48c8-9fc5-daa4cb072ba6\") " pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:45.952446 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:45.952413    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:46.105467 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:46.105437    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"]
Jul 22 03:42:46.107197 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:42:46.107169    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d50ca4_2555_48c8_9fc5_daa4cb072ba6.slice/crio-6d61b93bdaf91c75a8d7cc96febb99392dba15be4a3b2166d239861fa1d7ab9a WatchSource:0}: Error finding container 6d61b93bdaf91c75a8d7cc96febb99392dba15be4a3b2166d239861fa1d7ab9a: Status 404 returned error can't find the container with id 6d61b93bdaf91c75a8d7cc96febb99392dba15be4a3b2166d239861fa1d7ab9a
Jul 22 03:42:46.127406 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:46.127380    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:46.238571 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:46.238531    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:46.824658 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:46.824596    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv" event={"ID":"f9d50ca4-2555-48c8-9fc5-daa4cb072ba6","Type":"ContainerStarted","Data":"6d61b93bdaf91c75a8d7cc96febb99392dba15be4a3b2166d239861fa1d7ab9a"}
Jul 22 03:42:48.835778 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:48.835742    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv" event={"ID":"f9d50ca4-2555-48c8-9fc5-daa4cb072ba6","Type":"ContainerStarted","Data":"97ee5778ec365386fc22aae3785161b5053184bdf6e1eadebbda10b46b72fbfa"}
Jul 22 03:42:48.836294 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:48.835895    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:48.853262 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:48.853207    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv" podStartSLOduration=2.185785389 podStartE2EDuration="3.853189784s" totalImagesPullingTime="1.667404395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:42:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:42:48.852469767 +0000 UTC m=+546.019704432" watchObservedRunningTime="2026-07-22 03:42:48.853189784 +0000 UTC m=+546.020424448"
Jul 22 03:42:54.845808 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:54.845775    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5b77f8c7b9-jc9wv"
Jul 22 03:42:56.611458 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:56.611419    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:56.706440 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:56.706397    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:57.962079 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:57.962048    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:42:58.065292 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:42:58.065220    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:43:03.097386 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:03.097344    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:43:09.969154 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:09.969113    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"]
Jul 22 03:43:09.971857 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:09.971838    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:09.975539 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:09.975481    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 03:43:09.975539 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:09.975512    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 22 03:43:09.975728 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:09.975541    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 03:43:09.975728 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:09.975510    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vmmxq\""
Jul 22 03:43:09.980922 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:09.980901    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"]
Jul 22 03:43:10.077871 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.077835    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:43:10.152543 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.152509    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d570f62-c044-405e-9539-302c1c11843c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.152543 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.152553    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d570f62-c044-405e-9539-302c1c11843c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.152816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.152604    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rskkd\" (UniqueName: \"kubernetes.io/projected/7d570f62-c044-405e-9539-302c1c11843c-kube-api-access-rskkd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.152816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.152622    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d570f62-c044-405e-9539-302c1c11843c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.152816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.152684    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d570f62-c044-405e-9539-302c1c11843c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.152816 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.152706    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d570f62-c044-405e-9539-302c1c11843c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.253430 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.253343    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d570f62-c044-405e-9539-302c1c11843c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.253594 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.253428    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rskkd\" (UniqueName: \"kubernetes.io/projected/7d570f62-c044-405e-9539-302c1c11843c-kube-api-access-rskkd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.253594 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.253457    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d570f62-c044-405e-9539-302c1c11843c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.253594 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.253493    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d570f62-c044-405e-9539-302c1c11843c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.253594 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.253520    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d570f62-c044-405e-9539-302c1c11843c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.253594 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.253583    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d570f62-c044-405e-9539-302c1c11843c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.253918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.253844    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d570f62-c044-405e-9539-302c1c11843c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.253918 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.253900    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d570f62-c044-405e-9539-302c1c11843c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.254017 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.253955    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d570f62-c044-405e-9539-302c1c11843c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.255988 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.255965    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d570f62-c044-405e-9539-302c1c11843c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.256366 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.256346    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d570f62-c044-405e-9539-302c1c11843c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.262621 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.262591    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rskkd\" (UniqueName: \"kubernetes.io/projected/7d570f62-c044-405e-9539-302c1c11843c-kube-api-access-rskkd\") pod \"e2e-distinct-simulated-kserve-59975d69f9-2vccv\" (UID: \"7d570f62-c044-405e-9539-302c1c11843c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.283387 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.283349    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:10.426442 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.426409    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"]
Jul 22 03:43:10.429941 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:43:10.429910    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d570f62_c044_405e_9539_302c1c11843c.slice/crio-0653bf52bbdad300f4e5990a728b42a932678e8874419b4daade487f3628eb95 WatchSource:0}: Error finding container 0653bf52bbdad300f4e5990a728b42a932678e8874419b4daade487f3628eb95: Status 404 returned error can't find the container with id 0653bf52bbdad300f4e5990a728b42a932678e8874419b4daade487f3628eb95
Jul 22 03:43:10.944347 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:10.944310    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv" event={"ID":"7d570f62-c044-405e-9539-302c1c11843c","Type":"ContainerStarted","Data":"0653bf52bbdad300f4e5990a728b42a932678e8874419b4daade487f3628eb95"}
Jul 22 03:43:11.950781 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:11.950749    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv" event={"ID":"7d570f62-c044-405e-9539-302c1c11843c","Type":"ContainerStarted","Data":"ec10722f70ea9ddb08bd76ad2bcfe0aeabab2381e928ef424fcb690ea901febc"}
Jul 22 03:43:11.972714 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:11.972667    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv" podStartSLOduration=1.850211391 podStartE2EDuration="2.972625449s" totalImagesPullingTime="1.122414058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:43:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:43:11.97126347 +0000 UTC m=+569.138498135" watchObservedRunningTime="2026-07-22 03:43:11.972625449 +0000 UTC m=+569.139860112"
Jul 22 03:43:17.115691 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:17.115635    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:43:20.283563 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:20.283524    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:20.284188 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:20.283594    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:20.296348 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:20.296322    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:21.005429 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:21.005398    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-2vccv"
Jul 22 03:43:23.354026 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.353994    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"]
Jul 22 03:43:23.360484 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.360455    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.363719 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.363691    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7613d5ed-6580-455c-86f9-a39b92fb8ce9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.363719 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.363699    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 22 03:43:23.363935 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.363800    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7613d5ed-6580-455c-86f9-a39b92fb8ce9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.363935 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.363841    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7613d5ed-6580-455c-86f9-a39b92fb8ce9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.363935 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.363882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7613d5ed-6580-455c-86f9-a39b92fb8ce9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.363935 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.363925    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjnxd\" (UniqueName: \"kubernetes.io/projected/7613d5ed-6580-455c-86f9-a39b92fb8ce9-kube-api-access-vjnxd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.364152 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.363972    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7613d5ed-6580-455c-86f9-a39b92fb8ce9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.370947 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.370925    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"]
Jul 22 03:43:23.413141 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.413105    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:43:23.465341 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.465298    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7613d5ed-6580-455c-86f9-a39b92fb8ce9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.465341 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.465342    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjnxd\" (UniqueName: \"kubernetes.io/projected/7613d5ed-6580-455c-86f9-a39b92fb8ce9-kube-api-access-vjnxd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.465587 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.465374    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7613d5ed-6580-455c-86f9-a39b92fb8ce9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.465587 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.465436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7613d5ed-6580-455c-86f9-a39b92fb8ce9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.465587 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.465494    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7613d5ed-6580-455c-86f9-a39b92fb8ce9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.465587 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.465523    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7613d5ed-6580-455c-86f9-a39b92fb8ce9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.465909 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.465878    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7613d5ed-6580-455c-86f9-a39b92fb8ce9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.466018 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.465971    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7613d5ed-6580-455c-86f9-a39b92fb8ce9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.466018 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.466004    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7613d5ed-6580-455c-86f9-a39b92fb8ce9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.467727 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.467711    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7613d5ed-6580-455c-86f9-a39b92fb8ce9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.467969 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.467950    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7613d5ed-6580-455c-86f9-a39b92fb8ce9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.473749 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.473720    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjnxd\" (UniqueName: \"kubernetes.io/projected/7613d5ed-6580-455c-86f9-a39b92fb8ce9-kube-api-access-vjnxd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg\" (UID: \"7613d5ed-6580-455c-86f9-a39b92fb8ce9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.673277 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.673187    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:23.810203 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:23.810179    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"]
Jul 22 03:43:23.812934 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:43:23.812905    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7613d5ed_6580_455c_86f9_a39b92fb8ce9.slice/crio-f94f2bfc5529a7058e01f3d75de1746ed2ef1ad84ef93675dd9ddc44e350deb2 WatchSource:0}: Error finding container f94f2bfc5529a7058e01f3d75de1746ed2ef1ad84ef93675dd9ddc44e350deb2: Status 404 returned error can't find the container with id f94f2bfc5529a7058e01f3d75de1746ed2ef1ad84ef93675dd9ddc44e350deb2
Jul 22 03:43:24.009005 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:24.008978    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg" event={"ID":"7613d5ed-6580-455c-86f9-a39b92fb8ce9","Type":"ContainerStarted","Data":"f94f2bfc5529a7058e01f3d75de1746ed2ef1ad84ef93675dd9ddc44e350deb2"}
Jul 22 03:43:25.015163 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:25.015131    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg" event={"ID":"7613d5ed-6580-455c-86f9-a39b92fb8ce9","Type":"ContainerStarted","Data":"3f475a51d808aa9a791a7087f965123400a7c3df3e368c3dbe231d79039bda5e"}
Jul 22 03:43:25.034546 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:25.034502    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg" podStartSLOduration=1.8428258469999999 podStartE2EDuration="2.034487099s" totalImagesPullingTime="191.661252ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:43:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:43:25.033205223 +0000 UTC m=+582.200439887" watchObservedRunningTime="2026-07-22 03:43:25.034487099 +0000 UTC m=+582.201721763"
Jul 22 03:43:33.673737 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:33.673684    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:33.674173 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:33.673773    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:33.686360 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:33.686329    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:34.070601 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:34.070568    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg"
Jul 22 03:43:42.242506 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:42.242460    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:43:44.982955 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:44.982923    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"]
Jul 22 03:43:44.985927 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:44.985911    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:44.989516 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:44.989496    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 22 03:43:44.999786 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:44.999761    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"]
Jul 22 03:43:45.021130 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.021094    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:43:45.063594 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.063555    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.063819 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.063604    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.063819 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.063702    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.063819 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.063728    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.063819 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.063770    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.063819 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.063802    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs5r6\" (UniqueName: \"kubernetes.io/projected/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-kube-api-access-zs5r6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.164876 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.164844    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.165064 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.164898    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.165064 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.164944    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.165064 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.164966    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.165064 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.165010    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.165064 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.165036    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs5r6\" (UniqueName: \"kubernetes.io/projected/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-kube-api-access-zs5r6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.165335 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.165314    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.165394 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.165373    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.165485 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.165445    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.167374 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.167346    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.167673 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.167623    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.177416 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.177397    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs5r6\" (UniqueName: \"kubernetes.io/projected/e5dc61ab-9f1f-4de2-82bc-05e8cecf7914-kube-api-access-zs5r6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-twmwb\" (UID: \"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.297209 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.297132    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:45.436272 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.436246    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"]
Jul 22 03:43:45.437590 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:43:45.437560    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5dc61ab_9f1f_4de2_82bc_05e8cecf7914.slice/crio-fc4a126f89aebecbc1d2f71a31e78363ecd5fff624951ce928bec4e018cdab29 WatchSource:0}: Error finding container fc4a126f89aebecbc1d2f71a31e78363ecd5fff624951ce928bec4e018cdab29: Status 404 returned error can't find the container with id fc4a126f89aebecbc1d2f71a31e78363ecd5fff624951ce928bec4e018cdab29
Jul 22 03:43:45.439046 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:45.439028    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 03:43:46.116366 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:46.116329    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb" event={"ID":"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914","Type":"ContainerStarted","Data":"31413b6237a479cceaffaab97affd564018dd3e9be10c378b57bfe5200969d27"}
Jul 22 03:43:46.116793 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:46.116430    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb" event={"ID":"e5dc61ab-9f1f-4de2-82bc-05e8cecf7914","Type":"ContainerStarted","Data":"fc4a126f89aebecbc1d2f71a31e78363ecd5fff624951ce928bec4e018cdab29"}
Jul 22 03:43:46.135788 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:46.135726    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb" podStartSLOduration=1.941484829 podStartE2EDuration="2.135706472s" totalImagesPullingTime="194.221643ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:43:46.134769775 +0000 UTC m=+603.302004443" watchObservedRunningTime="2026-07-22 03:43:46.135706472 +0000 UTC m=+603.302941136"
Jul 22 03:43:48.488935 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:48.488897    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:43:55.298302 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:55.298264    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:55.298868 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:55.298342    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:55.315747 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:55.315714    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:43:56.189235 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:43:56.189207    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-twmwb"
Jul 22 03:44:00.262038 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:00.261980    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:44:00.363791 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:00.363753    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:44:21.883395 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:21.883358    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:44:21.980450 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:21.980411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:44:26.449823 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:26.449785    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:44:49.591113 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:49.591075    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:44:57.489612 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.489571    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f9588658-xfmt6"]
Jul 22 03:44:57.493494 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.493472    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f9588658-xfmt6"
Jul 22 03:44:57.512362 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.512333    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f9588658-xfmt6"]
Jul 22 03:44:57.528088 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.528059    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/717a9764-22c0-4598-bb17-c196da15214b-tls-cert\") pod \"authorino-6f9588658-xfmt6\" (UID: \"717a9764-22c0-4598-bb17-c196da15214b\") " pod="kuadrant-system/authorino-6f9588658-xfmt6"
Jul 22 03:44:57.528228 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.528110    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsrdq\" (UniqueName: \"kubernetes.io/projected/717a9764-22c0-4598-bb17-c196da15214b-kube-api-access-tsrdq\") pod \"authorino-6f9588658-xfmt6\" (UID: \"717a9764-22c0-4598-bb17-c196da15214b\") " pod="kuadrant-system/authorino-6f9588658-xfmt6"
Jul 22 03:44:57.628595 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.628566    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/717a9764-22c0-4598-bb17-c196da15214b-tls-cert\") pod \"authorino-6f9588658-xfmt6\" (UID: \"717a9764-22c0-4598-bb17-c196da15214b\") " pod="kuadrant-system/authorino-6f9588658-xfmt6"
Jul 22 03:44:57.628778 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.628611    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsrdq\" (UniqueName: \"kubernetes.io/projected/717a9764-22c0-4598-bb17-c196da15214b-kube-api-access-tsrdq\") pod \"authorino-6f9588658-xfmt6\" (UID: \"717a9764-22c0-4598-bb17-c196da15214b\") " pod="kuadrant-system/authorino-6f9588658-xfmt6"
Jul 22 03:44:57.631371 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.631345    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/717a9764-22c0-4598-bb17-c196da15214b-tls-cert\") pod \"authorino-6f9588658-xfmt6\" (UID: \"717a9764-22c0-4598-bb17-c196da15214b\") " pod="kuadrant-system/authorino-6f9588658-xfmt6"
Jul 22 03:44:57.661117 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.661088    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsrdq\" (UniqueName: \"kubernetes.io/projected/717a9764-22c0-4598-bb17-c196da15214b-kube-api-access-tsrdq\") pod \"authorino-6f9588658-xfmt6\" (UID: \"717a9764-22c0-4598-bb17-c196da15214b\") " pod="kuadrant-system/authorino-6f9588658-xfmt6"
Jul 22 03:44:57.766012 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.765917    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:44:57.803177 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.803150    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f9588658-xfmt6"
Jul 22 03:44:57.938679 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.938621    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:44:57.954328 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:57.954303    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f9588658-xfmt6"]
Jul 22 03:44:57.956422 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:44:57.956398    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod717a9764_22c0_4598_bb17_c196da15214b.slice/crio-1a7c0b3ea6674ff9de68275557d4bb2040a366467140ee0ef92dbaf0225ccc5b WatchSource:0}: Error finding container 1a7c0b3ea6674ff9de68275557d4bb2040a366467140ee0ef92dbaf0225ccc5b: Status 404 returned error can't find the container with id 1a7c0b3ea6674ff9de68275557d4bb2040a366467140ee0ef92dbaf0225ccc5b
Jul 22 03:44:58.487560 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:58.487530    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f9588658-xfmt6" event={"ID":"717a9764-22c0-4598-bb17-c196da15214b","Type":"ContainerStarted","Data":"41a46b2ef96e939b1da314b3c4212692c866716cff9b52634a55aae8695b12d5"}
Jul 22 03:44:58.487560 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:58.487571    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f9588658-xfmt6" event={"ID":"717a9764-22c0-4598-bb17-c196da15214b","Type":"ContainerStarted","Data":"1a7c0b3ea6674ff9de68275557d4bb2040a366467140ee0ef92dbaf0225ccc5b"}
Jul 22 03:44:58.510392 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:58.510340    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f9588658-xfmt6" podStartSLOduration=1.072676615 podStartE2EDuration="1.510323799s" totalImagesPullingTime="437.647184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:44:58.508570826 +0000 UTC m=+675.675805505" watchObservedRunningTime="2026-07-22 03:44:58.510323799 +0000 UTC m=+675.677558463"
Jul 22 03:44:58.566823 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:58.566786    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cf9f9bfb7-nzdvb"]
Jul 22 03:44:58.567028 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:58.566992    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb" podUID="15ee9475-91e0-433c-89bc-fabd5261368c" containerName="authorino" containerID="cri-o://7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e" gracePeriod=30
Jul 22 03:44:58.841572 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:58.841546    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb"
Jul 22 03:44:58.939082 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:58.938993    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjgxt\" (UniqueName: \"kubernetes.io/projected/15ee9475-91e0-433c-89bc-fabd5261368c-kube-api-access-zjgxt\") pod \"15ee9475-91e0-433c-89bc-fabd5261368c\" (UID: \"15ee9475-91e0-433c-89bc-fabd5261368c\") "
Jul 22 03:44:58.939082 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:58.939066    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15ee9475-91e0-433c-89bc-fabd5261368c-tls-cert\") pod \"15ee9475-91e0-433c-89bc-fabd5261368c\" (UID: \"15ee9475-91e0-433c-89bc-fabd5261368c\") "
Jul 22 03:44:58.942062 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:58.942025    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ee9475-91e0-433c-89bc-fabd5261368c-kube-api-access-zjgxt" (OuterVolumeSpecName: "kube-api-access-zjgxt") pod "15ee9475-91e0-433c-89bc-fabd5261368c" (UID: "15ee9475-91e0-433c-89bc-fabd5261368c"). InnerVolumeSpecName "kube-api-access-zjgxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:44:58.950964 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:58.950934    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15ee9475-91e0-433c-89bc-fabd5261368c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "15ee9475-91e0-433c-89bc-fabd5261368c" (UID: "15ee9475-91e0-433c-89bc-fabd5261368c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:44:58.964830 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:58.964785    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:44:59.040658 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:59.040604    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjgxt\" (UniqueName: \"kubernetes.io/projected/15ee9475-91e0-433c-89bc-fabd5261368c-kube-api-access-zjgxt\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:44:59.040658 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:59.040634    2569 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/15ee9475-91e0-433c-89bc-fabd5261368c-tls-cert\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:44:59.137903 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:59.137859    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:44:59.494880 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:59.494849    2569 generic.go:356] "Generic (PLEG): container finished" podID="15ee9475-91e0-433c-89bc-fabd5261368c" containerID="7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e" exitCode=0
Jul 22 03:44:59.495056 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:59.494897    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb"
Jul 22 03:44:59.495056 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:59.494954    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb" event={"ID":"15ee9475-91e0-433c-89bc-fabd5261368c","Type":"ContainerDied","Data":"7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e"}
Jul 22 03:44:59.495056 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:59.494999    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cf9f9bfb7-nzdvb" event={"ID":"15ee9475-91e0-433c-89bc-fabd5261368c","Type":"ContainerDied","Data":"d9d1ec257b976f54a5c0c944465825495d2302b76c0d9b675eff941f7c53ec63"}
Jul 22 03:44:59.495056 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:59.495024    2569 scope.go:117] "RemoveContainer" containerID="7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e"
Jul 22 03:44:59.504359 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:59.504336    2569 scope.go:117] "RemoveContainer" containerID="7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e"
Jul 22 03:44:59.504626 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:44:59.504600    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e\": container with ID starting with 7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e not found: ID does not exist" containerID="7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e"
Jul 22 03:44:59.504741 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:59.504632    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e"} err="failed to get container status \"7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e\": rpc error: code = NotFound desc = could not find container \"7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e\": container with ID starting with 7ad7c858432db3fbbcdb7d6478e7912f0c93e9fecd7d6ee145f61766eb85aa2e not found: ID does not exist"
Jul 22 03:44:59.540253 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:59.540222    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cf9f9bfb7-nzdvb"]
Jul 22 03:44:59.541807 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:44:59.541788    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cf9f9bfb7-nzdvb"]
Jul 22 03:45:01.379137 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:01.379101    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ee9475-91e0-433c-89bc-fabd5261368c" path="/var/lib/kubelet/pods/15ee9475-91e0-433c-89bc-fabd5261368c/volumes"
Jul 22 03:45:44.817570 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:44.817524    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74d8745f54-gf22b"]
Jul 22 03:45:44.818234 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:44.818167    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-74d8745f54-gf22b" podUID="6b4c9944-2916-4e70-b71a-8a53935c1327" containerName="manager" containerID="cri-o://de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c" gracePeriod=30
Jul 22 03:45:45.105104 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.105038    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74d8745f54-gf22b"
Jul 22 03:45:45.163897 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.163864    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b4c9944-2916-4e70-b71a-8a53935c1327-webhook-cert\") pod \"6b4c9944-2916-4e70-b71a-8a53935c1327\" (UID: \"6b4c9944-2916-4e70-b71a-8a53935c1327\") "
Jul 22 03:45:45.164166 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.164142    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gm5wr\" (UniqueName: \"kubernetes.io/projected/6b4c9944-2916-4e70-b71a-8a53935c1327-kube-api-access-gm5wr\") pod \"6b4c9944-2916-4e70-b71a-8a53935c1327\" (UID: \"6b4c9944-2916-4e70-b71a-8a53935c1327\") "
Jul 22 03:45:45.166574 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.166540    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b4c9944-2916-4e70-b71a-8a53935c1327-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6b4c9944-2916-4e70-b71a-8a53935c1327" (UID: "6b4c9944-2916-4e70-b71a-8a53935c1327"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:45:45.167191 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.167163    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b4c9944-2916-4e70-b71a-8a53935c1327-kube-api-access-gm5wr" (OuterVolumeSpecName: "kube-api-access-gm5wr") pod "6b4c9944-2916-4e70-b71a-8a53935c1327" (UID: "6b4c9944-2916-4e70-b71a-8a53935c1327"). InnerVolumeSpecName "kube-api-access-gm5wr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:45:45.265382 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.265343    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b4c9944-2916-4e70-b71a-8a53935c1327-webhook-cert\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:45:45.265382 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.265376    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gm5wr\" (UniqueName: \"kubernetes.io/projected/6b4c9944-2916-4e70-b71a-8a53935c1327-kube-api-access-gm5wr\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:45:45.743903 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.743871    2569 generic.go:356] "Generic (PLEG): container finished" podID="6b4c9944-2916-4e70-b71a-8a53935c1327" containerID="de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c" exitCode=0
Jul 22 03:45:45.744353 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.743914    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74d8745f54-gf22b"
Jul 22 03:45:45.744353 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.743939    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74d8745f54-gf22b" event={"ID":"6b4c9944-2916-4e70-b71a-8a53935c1327","Type":"ContainerDied","Data":"de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c"}
Jul 22 03:45:45.744353 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.743980    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74d8745f54-gf22b" event={"ID":"6b4c9944-2916-4e70-b71a-8a53935c1327","Type":"ContainerDied","Data":"a9a5a0ca6020fbcdf4d0d13cdc9ccf6e1e0d846602e1752b460743ead911f05d"}
Jul 22 03:45:45.744353 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.744000    2569 scope.go:117] "RemoveContainer" containerID="de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c"
Jul 22 03:45:45.753309 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.753285    2569 scope.go:117] "RemoveContainer" containerID="de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c"
Jul 22 03:45:45.753613 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:45:45.753593    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c\": container with ID starting with de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c not found: ID does not exist" containerID="de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c"
Jul 22 03:45:45.753716 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.753624    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c"} err="failed to get container status \"de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c\": rpc error: code = NotFound desc = could not find container \"de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c\": container with ID starting with de5bb556abacd87359a0fc93777a0c8daf15ea7c796d91bfe7fe6daec315c36c not found: ID does not exist"
Jul 22 03:45:45.764468 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.764439    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74d8745f54-gf22b"]
Jul 22 03:45:45.769564 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:45.769535    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74d8745f54-gf22b"]
Jul 22 03:45:47.378416 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:45:47.378383    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b4c9944-2916-4e70-b71a-8a53935c1327" path="/var/lib/kubelet/pods/6b4c9944-2916-4e70-b71a-8a53935c1327/volumes"
Jul 22 03:46:07.069964 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:46:07.069924    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:47:03.188112 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:47:03.188072    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:47:04.423122 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:47:04.423081    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:47:40.027614 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:47:40.027576    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:47:40.127044 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:47:40.127005    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:47:40.266908 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:47:40.266869    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:47:46.128135 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:47:46.128100    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:47:46.232018 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:47:46.231963    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:47:46.329274 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:47:46.329236    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:47:46.490968 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:47:46.490933    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:47:52.548768 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:47:52.548730    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:47:52.647923 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:47:52.647877    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:51:25.191667 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:25.191607    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:51:46.430737 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:46.430621    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:51:46.497388 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:46.497353    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:51:49.917964 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:49.917920    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"]
Jul 22 03:51:49.918481 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:49.918225    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh" podUID="d70b5f53-1db6-4436-b095-1054bb8041f9" containerName="manager" containerID="cri-o://6125d3eb54e40afa194bf8f64df160fefde58055d25d816a14d94e8caab76f43" gracePeriod=10
Jul 22 03:51:52.575138 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:52.575111    2569 generic.go:356] "Generic (PLEG): container finished" podID="d70b5f53-1db6-4436-b095-1054bb8041f9" containerID="6125d3eb54e40afa194bf8f64df160fefde58055d25d816a14d94e8caab76f43" exitCode=0
Jul 22 03:51:52.575439 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:52.575178    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh" event={"ID":"d70b5f53-1db6-4436-b095-1054bb8041f9","Type":"ContainerDied","Data":"6125d3eb54e40afa194bf8f64df160fefde58055d25d816a14d94e8caab76f43"}
Jul 22 03:51:52.575439 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:52.575225    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh" event={"ID":"d70b5f53-1db6-4436-b095-1054bb8041f9","Type":"ContainerDied","Data":"cc997dd391fbe13f4c16dc1f3ccf7975742d43bc96b505299deb44a00fd5ec09"}
Jul 22 03:51:52.575439 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:52.575244    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc997dd391fbe13f4c16dc1f3ccf7975742d43bc96b505299deb44a00fd5ec09"
Jul 22 03:51:52.575439 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:52.575423    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"
Jul 22 03:51:52.644683 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:52.644635    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5bsp\" (UniqueName: \"kubernetes.io/projected/d70b5f53-1db6-4436-b095-1054bb8041f9-kube-api-access-v5bsp\") pod \"d70b5f53-1db6-4436-b095-1054bb8041f9\" (UID: \"d70b5f53-1db6-4436-b095-1054bb8041f9\") "
Jul 22 03:51:52.644812 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:52.644739    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d70b5f53-1db6-4436-b095-1054bb8041f9-extensions-socket-volume\") pod \"d70b5f53-1db6-4436-b095-1054bb8041f9\" (UID: \"d70b5f53-1db6-4436-b095-1054bb8041f9\") "
Jul 22 03:51:52.645081 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:52.645053    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d70b5f53-1db6-4436-b095-1054bb8041f9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d70b5f53-1db6-4436-b095-1054bb8041f9" (UID: "d70b5f53-1db6-4436-b095-1054bb8041f9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:51:52.646961 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:52.646933    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d70b5f53-1db6-4436-b095-1054bb8041f9-kube-api-access-v5bsp" (OuterVolumeSpecName: "kube-api-access-v5bsp") pod "d70b5f53-1db6-4436-b095-1054bb8041f9" (UID: "d70b5f53-1db6-4436-b095-1054bb8041f9"). InnerVolumeSpecName "kube-api-access-v5bsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:51:52.745391 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:52.745369    2569 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d70b5f53-1db6-4436-b095-1054bb8041f9-extensions-socket-volume\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:51:52.745391 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:52.745389    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v5bsp\" (UniqueName: \"kubernetes.io/projected/d70b5f53-1db6-4436-b095-1054bb8041f9-kube-api-access-v5bsp\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:51:53.579550 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:53.579522    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"
Jul 22 03:51:53.599687 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:53.599661    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"]
Jul 22 03:51:53.605896 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:53.605869    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hzmnh"]
Jul 22 03:51:55.379312 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:51:55.379277    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d70b5f53-1db6-4436-b095-1054bb8041f9" path="/var/lib/kubelet/pods/d70b5f53-1db6-4436-b095-1054bb8041f9/volumes"
Jul 22 03:52:43.479368 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:43.479341    2569 scope.go:117] "RemoveContainer" containerID="6125d3eb54e40afa194bf8f64df160fefde58055d25d816a14d94e8caab76f43"
Jul 22 03:52:46.967151 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:46.967121    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:52:51.044839 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.044797    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"]
Jul 22 03:52:51.045382 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.045362    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ee9475-91e0-433c-89bc-fabd5261368c" containerName="authorino"
Jul 22 03:52:51.045470 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.045386    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ee9475-91e0-433c-89bc-fabd5261368c" containerName="authorino"
Jul 22 03:52:51.045470 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.045398    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d70b5f53-1db6-4436-b095-1054bb8041f9" containerName="manager"
Jul 22 03:52:51.045470 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.045407    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d70b5f53-1db6-4436-b095-1054bb8041f9" containerName="manager"
Jul 22 03:52:51.045470 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.045434    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b4c9944-2916-4e70-b71a-8a53935c1327" containerName="manager"
Jul 22 03:52:51.045470 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.045443    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b4c9944-2916-4e70-b71a-8a53935c1327" containerName="manager"
Jul 22 03:52:51.045766 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.045538    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ee9475-91e0-433c-89bc-fabd5261368c" containerName="authorino"
Jul 22 03:52:51.045766 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.045554    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d70b5f53-1db6-4436-b095-1054bb8041f9" containerName="manager"
Jul 22 03:52:51.045766 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.045564    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b4c9944-2916-4e70-b71a-8a53935c1327" containerName="manager"
Jul 22 03:52:51.050327 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.050305    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"
Jul 22 03:52:51.053586 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.053562    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-dlnqk\""
Jul 22 03:52:51.060755 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.060731    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"]
Jul 22 03:52:51.142529 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.142494    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9472990c-a646-4b57-82fd-400750c40993-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p7g8w\" (UID: \"9472990c-a646-4b57-82fd-400750c40993\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"
Jul 22 03:52:51.142710 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.142565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcxdf\" (UniqueName: \"kubernetes.io/projected/9472990c-a646-4b57-82fd-400750c40993-kube-api-access-jcxdf\") pod \"kuadrant-operator-controller-manager-86878c769f-p7g8w\" (UID: \"9472990c-a646-4b57-82fd-400750c40993\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"
Jul 22 03:52:51.243615 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.243577    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9472990c-a646-4b57-82fd-400750c40993-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p7g8w\" (UID: \"9472990c-a646-4b57-82fd-400750c40993\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"
Jul 22 03:52:51.243801 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.243664    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcxdf\" (UniqueName: \"kubernetes.io/projected/9472990c-a646-4b57-82fd-400750c40993-kube-api-access-jcxdf\") pod \"kuadrant-operator-controller-manager-86878c769f-p7g8w\" (UID: \"9472990c-a646-4b57-82fd-400750c40993\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"
Jul 22 03:52:51.244001 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.243983    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9472990c-a646-4b57-82fd-400750c40993-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-p7g8w\" (UID: \"9472990c-a646-4b57-82fd-400750c40993\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"
Jul 22 03:52:51.253108 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.253084    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcxdf\" (UniqueName: \"kubernetes.io/projected/9472990c-a646-4b57-82fd-400750c40993-kube-api-access-jcxdf\") pod \"kuadrant-operator-controller-manager-86878c769f-p7g8w\" (UID: \"9472990c-a646-4b57-82fd-400750c40993\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"
Jul 22 03:52:51.361339 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.361233    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"
Jul 22 03:52:51.502269 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.502207    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"]
Jul 22 03:52:51.504693 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:52:51.504666    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9472990c_a646_4b57_82fd_400750c40993.slice/crio-1f0af0374dd32a59676bffcc831c3a48bdc518a70ffc65291cfbd101094baac0 WatchSource:0}: Error finding container 1f0af0374dd32a59676bffcc831c3a48bdc518a70ffc65291cfbd101094baac0: Status 404 returned error can't find the container with id 1f0af0374dd32a59676bffcc831c3a48bdc518a70ffc65291cfbd101094baac0
Jul 22 03:52:51.864825 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.864782    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w" event={"ID":"9472990c-a646-4b57-82fd-400750c40993","Type":"ContainerStarted","Data":"a1f01d63f70584f7018e08a90d9531505b068b6646d156eebd9e1b392046c7ec"}
Jul 22 03:52:51.865008 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.864839    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w" event={"ID":"9472990c-a646-4b57-82fd-400750c40993","Type":"ContainerStarted","Data":"1f0af0374dd32a59676bffcc831c3a48bdc518a70ffc65291cfbd101094baac0"}
Jul 22 03:52:51.865008 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.864872    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"
Jul 22 03:52:51.886301 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:51.886254    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w" podStartSLOduration=0.886238373 podStartE2EDuration="886.238373ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:52:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:52:51.885415165 +0000 UTC m=+1149.052649828" watchObservedRunningTime="2026-07-22 03:52:51.886238373 +0000 UTC m=+1149.053473038"
Jul 22 03:52:55.263058 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:52:55.263023    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:53:02.872102 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:53:02.872009    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-p7g8w"
Jul 22 03:55:33.527892 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:33.527853    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:55:48.017850 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.017811    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"]
Jul 22 03:55:48.021552 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.021535    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.026372 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.026349    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-d5e0b9c5-kserve-self-signed-certs\""
Jul 22 03:55:48.042584 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.042554    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"]
Jul 22 03:55:48.132556 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.132524    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:55:48.210767 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.210736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-home\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.210931 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.210774    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-tmp-dir\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.210931 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.210803    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-dshm\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.210931 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.210913    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtxv2\" (UniqueName: \"kubernetes.io/projected/b2e88809-7916-48ca-bdef-30e7852cdbf4-kube-api-access-wtxv2\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.211043 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.210985    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-model-cache\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.211043 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.211016    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2e88809-7916-48ca-bdef-30e7852cdbf4-tls-certs\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.312231 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.312146    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-home\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.312231 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.312191    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-tmp-dir\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.312231 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.312221    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-dshm\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.312495 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.312262    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtxv2\" (UniqueName: \"kubernetes.io/projected/b2e88809-7916-48ca-bdef-30e7852cdbf4-kube-api-access-wtxv2\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.312495 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.312325    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-model-cache\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.312495 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.312355    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2e88809-7916-48ca-bdef-30e7852cdbf4-tls-certs\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.312702 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.312674    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-home\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.312845 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.312722    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-tmp-dir\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.312845 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.312756    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-model-cache\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.314819 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.314787    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-dshm\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.315064 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.315044    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2e88809-7916-48ca-bdef-30e7852cdbf4-tls-certs\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.324969 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.324947    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtxv2\" (UniqueName: \"kubernetes.io/projected/b2e88809-7916-48ca-bdef-30e7852cdbf4-kube-api-access-wtxv2\") pod \"e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") " pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.330880 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.330861    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:48.483067 ip-10-0-142-88 kubenswrapper[2569]: W0722 03:55:48.483028    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2e88809_7916_48ca_bdef_30e7852cdbf4.slice/crio-a9083bacd504cf06baacabae5f37515fc1837c3eab7203a893b3f6c92f3e1537 WatchSource:0}: Error finding container a9083bacd504cf06baacabae5f37515fc1837c3eab7203a893b3f6c92f3e1537: Status 404 returned error can't find the container with id a9083bacd504cf06baacabae5f37515fc1837c3eab7203a893b3f6c92f3e1537
Jul 22 03:55:48.486283 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.486260    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"]
Jul 22 03:55:48.741614 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.741584    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9" event={"ID":"b2e88809-7916-48ca-bdef-30e7852cdbf4","Type":"ContainerStarted","Data":"b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70"}
Jul 22 03:55:48.741614 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:48.741622    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9" event={"ID":"b2e88809-7916-48ca-bdef-30e7852cdbf4","Type":"ContainerStarted","Data":"a9083bacd504cf06baacabae5f37515fc1837c3eab7203a893b3f6c92f3e1537"}
Jul 22 03:55:58.331142 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:58.331103    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:58.331690 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:58.331162    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:58.343748 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:58.343719    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:55:58.370951 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:58.370906    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9" podStartSLOduration=11.370890739 podStartE2EDuration="11.370890739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 03:55:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 03:55:48.772299674 +0000 UTC m=+1325.939534337" watchObservedRunningTime="2026-07-22 03:55:58.370890739 +0000 UTC m=+1335.538125421"
Jul 22 03:55:58.799960 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:55:58.799928    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:56:12.606725 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:12.606684    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:56:13.830519 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:13.830479    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"]
Jul 22 03:56:13.859206 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:13.859176    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:56:28.851067 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:28.851019    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9" podUID="b2e88809-7916-48ca-bdef-30e7852cdbf4" containerName="main" containerID="cri-o://b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70" gracePeriod=45
Jul 22 03:56:29.105504 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.105443    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:56:29.199601 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.199569    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-model-cache\") pod \"b2e88809-7916-48ca-bdef-30e7852cdbf4\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") "
Jul 22 03:56:29.199601 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.199613    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-dshm\") pod \"b2e88809-7916-48ca-bdef-30e7852cdbf4\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") "
Jul 22 03:56:29.199839 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.199700    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2e88809-7916-48ca-bdef-30e7852cdbf4-tls-certs\") pod \"b2e88809-7916-48ca-bdef-30e7852cdbf4\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") "
Jul 22 03:56:29.199839 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.199739    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-home\") pod \"b2e88809-7916-48ca-bdef-30e7852cdbf4\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") "
Jul 22 03:56:29.199839 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.199799    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-tmp-dir\") pod \"b2e88809-7916-48ca-bdef-30e7852cdbf4\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") "
Jul 22 03:56:29.199839 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.199830    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtxv2\" (UniqueName: \"kubernetes.io/projected/b2e88809-7916-48ca-bdef-30e7852cdbf4-kube-api-access-wtxv2\") pod \"b2e88809-7916-48ca-bdef-30e7852cdbf4\" (UID: \"b2e88809-7916-48ca-bdef-30e7852cdbf4\") "
Jul 22 03:56:29.200033 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.199931    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-model-cache" (OuterVolumeSpecName: "model-cache") pod "b2e88809-7916-48ca-bdef-30e7852cdbf4" (UID: "b2e88809-7916-48ca-bdef-30e7852cdbf4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:56:29.200094 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.200060    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b2e88809-7916-48ca-bdef-30e7852cdbf4" (UID: "b2e88809-7916-48ca-bdef-30e7852cdbf4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:56:29.200094 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.200079    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-home" (OuterVolumeSpecName: "home") pod "b2e88809-7916-48ca-bdef-30e7852cdbf4" (UID: "b2e88809-7916-48ca-bdef-30e7852cdbf4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:56:29.200209 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.200138    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-model-cache\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:56:29.202134 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.202101    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-dshm" (OuterVolumeSpecName: "dshm") pod "b2e88809-7916-48ca-bdef-30e7852cdbf4" (UID: "b2e88809-7916-48ca-bdef-30e7852cdbf4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 03:56:29.202255 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.202167    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2e88809-7916-48ca-bdef-30e7852cdbf4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b2e88809-7916-48ca-bdef-30e7852cdbf4" (UID: "b2e88809-7916-48ca-bdef-30e7852cdbf4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 03:56:29.202255 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.202172    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2e88809-7916-48ca-bdef-30e7852cdbf4-kube-api-access-wtxv2" (OuterVolumeSpecName: "kube-api-access-wtxv2") pod "b2e88809-7916-48ca-bdef-30e7852cdbf4" (UID: "b2e88809-7916-48ca-bdef-30e7852cdbf4"). InnerVolumeSpecName "kube-api-access-wtxv2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 03:56:29.301109 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.301081    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-dshm\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:56:29.301109 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.301106    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2e88809-7916-48ca-bdef-30e7852cdbf4-tls-certs\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:56:29.301109 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.301117    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-home\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:56:29.301325 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.301124    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2e88809-7916-48ca-bdef-30e7852cdbf4-tmp-dir\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:56:29.301325 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.301133    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtxv2\" (UniqueName: \"kubernetes.io/projected/b2e88809-7916-48ca-bdef-30e7852cdbf4-kube-api-access-wtxv2\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 03:56:29.951079 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.951044    2569 generic.go:356] "Generic (PLEG): container finished" podID="b2e88809-7916-48ca-bdef-30e7852cdbf4" containerID="b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70" exitCode=0
Jul 22 03:56:29.951480 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.951090    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"
Jul 22 03:56:29.951480 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.951132    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9" event={"ID":"b2e88809-7916-48ca-bdef-30e7852cdbf4","Type":"ContainerDied","Data":"b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70"}
Jul 22 03:56:29.951480 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.951177    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9" event={"ID":"b2e88809-7916-48ca-bdef-30e7852cdbf4","Type":"ContainerDied","Data":"a9083bacd504cf06baacabae5f37515fc1837c3eab7203a893b3f6c92f3e1537"}
Jul 22 03:56:29.951480 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.951197    2569 scope.go:117] "RemoveContainer" containerID="b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70"
Jul 22 03:56:29.959692 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.959670    2569 scope.go:117] "RemoveContainer" containerID="b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70"
Jul 22 03:56:29.959913 ip-10-0-142-88 kubenswrapper[2569]: E0722 03:56:29.959894    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70\": container with ID starting with b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70 not found: ID does not exist" containerID="b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70"
Jul 22 03:56:29.959964 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.959923    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70"} err="failed to get container status \"b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70\": rpc error: code = NotFound desc = could not find container \"b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70\": container with ID starting with b85fdeafe087034e26f28e514a08b18be7ab521b12595fc768be8102875a1e70 not found: ID does not exist"
Jul 22 03:56:29.974949 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.974923    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"]
Jul 22 03:56:29.979696 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:29.979667    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-d5e0b9c5-kserve-5fc8c8fdb7-66xf9"]
Jul 22 03:56:31.378020 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:56:31.377986    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2e88809-7916-48ca-bdef-30e7852cdbf4" path="/var/lib/kubelet/pods/b2e88809-7916-48ca-bdef-30e7852cdbf4/volumes"
Jul 22 03:58:35.158786 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:58:35.158748    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:59:26.542965 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:59:26.542922    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:59:54.313428 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:59:54.313391    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:59:57.171493 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:59:57.171442    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:59:57.321378 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:59:57.321343    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:59:57.424549 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:59:57.424468    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 03:59:57.789857 ip-10-0-142-88 kubenswrapper[2569]: I0722 03:59:57.789831    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:04.299127 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:04.299090    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:04.402165 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:04.402123    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:04.499844 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:04.499804    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:04.785922 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:04.785879    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:04.935325 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:04.935290    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:07.164111 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.164076    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:07.262799 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.262764    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:07.353063 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.353022    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"]
Jul 22 04:00:07.353550 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.353525    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e88809-7916-48ca-bdef-30e7852cdbf4" containerName="main"
Jul 22 04:00:07.353550 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.353549    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e88809-7916-48ca-bdef-30e7852cdbf4" containerName="main"
Jul 22 04:00:07.353756 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.353628    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2e88809-7916-48ca-bdef-30e7852cdbf4" containerName="main"
Jul 22 04:00:07.356378 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.356358    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:07.359598 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.359580    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8ed90c1e-serving-cert\""
Jul 22 04:00:07.369007 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.368985    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"]
Jul 22 04:00:07.394109 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.394084    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:07.475322 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.475293    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754f062e-9f5c-42bd-aa74-56272fe0519b-maas-api-tls\") pod \"maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:07.475491 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.475409    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754f062e-9f5c-42bd-aa74-56272fe0519b-openshift-service-ca\") pod \"maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:07.475491 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.475430    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld6lm\" (UniqueName: \"kubernetes.io/projected/754f062e-9f5c-42bd-aa74-56272fe0519b-kube-api-access-ld6lm\") pod \"maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:07.576552 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.576517    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754f062e-9f5c-42bd-aa74-56272fe0519b-openshift-service-ca\") pod \"maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:07.576744 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.576554    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld6lm\" (UniqueName: \"kubernetes.io/projected/754f062e-9f5c-42bd-aa74-56272fe0519b-kube-api-access-ld6lm\") pod \"maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:07.576744 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.576619    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754f062e-9f5c-42bd-aa74-56272fe0519b-maas-api-tls\") pod \"maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:07.576863 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:00:07.576841    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-serving-cert: secret "maas-api-e2e-ait-8ed90c1e-serving-cert" not found
Jul 22 04:00:07.576934 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:00:07.576922    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/754f062e-9f5c-42bd-aa74-56272fe0519b-maas-api-tls podName:754f062e-9f5c-42bd-aa74-56272fe0519b nodeName:}" failed. No retries permitted until 2026-07-22 04:00:08.076898271 +0000 UTC m=+1585.244132931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/754f062e-9f5c-42bd-aa74-56272fe0519b-maas-api-tls") pod "maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg" (UID: "754f062e-9f5c-42bd-aa74-56272fe0519b") : secret "maas-api-e2e-ait-8ed90c1e-serving-cert" not found
Jul 22 04:00:07.577272 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.577256    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754f062e-9f5c-42bd-aa74-56272fe0519b-openshift-service-ca\") pod \"maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:07.586364 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.586342    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld6lm\" (UniqueName: \"kubernetes.io/projected/754f062e-9f5c-42bd-aa74-56272fe0519b-kube-api-access-ld6lm\") pod \"maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:07.823334 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.823257    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:07.939745 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:07.939712    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:08.068464 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:08.068436    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:08.081718 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:08.081658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754f062e-9f5c-42bd-aa74-56272fe0519b-maas-api-tls\") pod \"maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:08.084102 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:08.084084    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754f062e-9f5c-42bd-aa74-56272fe0519b-maas-api-tls\") pod \"maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:08.266559 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:08.266523    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:08.403061 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:08.403028    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"]
Jul 22 04:00:08.406661 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:00:08.406606    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754f062e_9f5c_42bd_aa74_56272fe0519b.slice/crio-e11271719b24f1fc36a85aac7fbbc028eb6a464d2ab49b19bd610838198e6ed8 WatchSource:0}: Error finding container e11271719b24f1fc36a85aac7fbbc028eb6a464d2ab49b19bd610838198e6ed8: Status 404 returned error can't find the container with id e11271719b24f1fc36a85aac7fbbc028eb6a464d2ab49b19bd610838198e6ed8
Jul 22 04:00:08.408122 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:08.408099    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:00:09.022808 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:09.022777    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg" event={"ID":"754f062e-9f5c-42bd-aa74-56272fe0519b","Type":"ContainerStarted","Data":"c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358"}
Jul 22 04:00:09.022968 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:09.022839    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:09.022968 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:09.022861    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg" event={"ID":"754f062e-9f5c-42bd-aa74-56272fe0519b","Type":"ContainerStarted","Data":"e11271719b24f1fc36a85aac7fbbc028eb6a464d2ab49b19bd610838198e6ed8"}
Jul 22 04:00:09.048680 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:09.048616    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg" podStartSLOduration=1.57936895 podStartE2EDuration="2.048600731s" totalImagesPullingTime="469.231781ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:00:09.046611186 +0000 UTC m=+1586.213845852" watchObservedRunningTime="2026-07-22 04:00:09.048600731 +0000 UTC m=+1586.215835394"
Jul 22 04:00:15.034094 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:15.034061    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:43.341210 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.341175    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"]
Jul 22 04:00:43.341803 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.341398    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg" podUID="754f062e-9f5c-42bd-aa74-56272fe0519b" containerName="maas-api" containerID="cri-o://c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358" gracePeriod=30
Jul 22 04:00:43.382737 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.382705    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:43.605039 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.604966    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:43.700419 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.700392    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754f062e-9f5c-42bd-aa74-56272fe0519b-maas-api-tls\") pod \"754f062e-9f5c-42bd-aa74-56272fe0519b\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") "
Jul 22 04:00:43.700592 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.700462    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754f062e-9f5c-42bd-aa74-56272fe0519b-openshift-service-ca\") pod \"754f062e-9f5c-42bd-aa74-56272fe0519b\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") "
Jul 22 04:00:43.700592 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.700489    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld6lm\" (UniqueName: \"kubernetes.io/projected/754f062e-9f5c-42bd-aa74-56272fe0519b-kube-api-access-ld6lm\") pod \"754f062e-9f5c-42bd-aa74-56272fe0519b\" (UID: \"754f062e-9f5c-42bd-aa74-56272fe0519b\") "
Jul 22 04:00:43.700930 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.700894    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/754f062e-9f5c-42bd-aa74-56272fe0519b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "754f062e-9f5c-42bd-aa74-56272fe0519b" (UID: "754f062e-9f5c-42bd-aa74-56272fe0519b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:00:43.703002 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.702972    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/754f062e-9f5c-42bd-aa74-56272fe0519b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "754f062e-9f5c-42bd-aa74-56272fe0519b" (UID: "754f062e-9f5c-42bd-aa74-56272fe0519b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:00:43.703150 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.703123    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/754f062e-9f5c-42bd-aa74-56272fe0519b-kube-api-access-ld6lm" (OuterVolumeSpecName: "kube-api-access-ld6lm") pod "754f062e-9f5c-42bd-aa74-56272fe0519b" (UID: "754f062e-9f5c-42bd-aa74-56272fe0519b"). InnerVolumeSpecName "kube-api-access-ld6lm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:00:43.802180 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.802142    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/754f062e-9f5c-42bd-aa74-56272fe0519b-openshift-service-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:00:43.802180 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.802179    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld6lm\" (UniqueName: \"kubernetes.io/projected/754f062e-9f5c-42bd-aa74-56272fe0519b-kube-api-access-ld6lm\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:00:43.802383 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:43.802194    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/754f062e-9f5c-42bd-aa74-56272fe0519b-maas-api-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:00:44.191143 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:44.191109    2569 generic.go:356] "Generic (PLEG): container finished" podID="754f062e-9f5c-42bd-aa74-56272fe0519b" containerID="c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358" exitCode=0
Jul 22 04:00:44.191348 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:44.191161    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"
Jul 22 04:00:44.191348 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:44.191180    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg" event={"ID":"754f062e-9f5c-42bd-aa74-56272fe0519b","Type":"ContainerDied","Data":"c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358"}
Jul 22 04:00:44.191348 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:44.191246    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg" event={"ID":"754f062e-9f5c-42bd-aa74-56272fe0519b","Type":"ContainerDied","Data":"e11271719b24f1fc36a85aac7fbbc028eb6a464d2ab49b19bd610838198e6ed8"}
Jul 22 04:00:44.191348 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:44.191279    2569 scope.go:117] "RemoveContainer" containerID="c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358"
Jul 22 04:00:44.200875 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:44.200858    2569 scope.go:117] "RemoveContainer" containerID="c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358"
Jul 22 04:00:44.201129 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:00:44.201109    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358\": container with ID starting with c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358 not found: ID does not exist" containerID="c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358"
Jul 22 04:00:44.201194 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:44.201143    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358"} err="failed to get container status \"c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358\": rpc error: code = NotFound desc = could not find container \"c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358\": container with ID starting with c23a163b339783ad6f58a97e7cd3a8958dc0902434587a05fa83cda3eb457358 not found: ID does not exist"
Jul 22 04:00:44.213986 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:44.213954    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"]
Jul 22 04:00:44.218060 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:44.218036    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ed90c1e-fdf7d8997-wstpg"]
Jul 22 04:00:44.991797 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:44.991763    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:45.378780 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:45.378694    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="754f062e-9f5c-42bd-aa74-56272fe0519b" path="/var/lib/kubelet/pods/754f062e-9f5c-42bd-aa74-56272fe0519b/volumes"
Jul 22 04:00:47.768915 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:47.768881    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:47.929046 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:47.929005    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:48.215627 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:48.215595    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:48.443974 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:48.443938    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:48.539792 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:48.539697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:48.656902 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:48.656865    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:49.034554 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:49.034526    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:49.302025 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:49.301938    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:51.466379 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.466343    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:51.541235 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.541204    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"]
Jul 22 04:00:51.541673 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.541637    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="754f062e-9f5c-42bd-aa74-56272fe0519b" containerName="maas-api"
Jul 22 04:00:51.541784 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.541682    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="754f062e-9f5c-42bd-aa74-56272fe0519b" containerName="maas-api"
Jul 22 04:00:51.541839 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.541800    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="754f062e-9f5c-42bd-aa74-56272fe0519b" containerName="maas-api"
Jul 22 04:00:51.546328 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.546302    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:51.549169 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.549139    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-19ab37b5-serving-cert\""
Jul 22 04:00:51.557462 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.557439    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"]
Jul 22 04:00:51.579683 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.579629    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:51.673571 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.673536    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96183c7e-4734-4ea9-979e-7644c2ac2482-maas-api-tls\") pod \"maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:51.673571 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.673574    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96183c7e-4734-4ea9-979e-7644c2ac2482-openshift-service-ca\") pod \"maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:51.673808 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.673720    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hml7\" (UniqueName: \"kubernetes.io/projected/96183c7e-4734-4ea9-979e-7644c2ac2482-kube-api-access-4hml7\") pod \"maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:51.775175 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.775089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96183c7e-4734-4ea9-979e-7644c2ac2482-maas-api-tls\") pod \"maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:51.775175 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.775131    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96183c7e-4734-4ea9-979e-7644c2ac2482-openshift-service-ca\") pod \"maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:51.775476 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.775222    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hml7\" (UniqueName: \"kubernetes.io/projected/96183c7e-4734-4ea9-979e-7644c2ac2482-kube-api-access-4hml7\") pod \"maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:51.775476 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:00:51.775250    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-serving-cert: secret "maas-api-e2e-migrate-19ab37b5-serving-cert" not found
Jul 22 04:00:51.775476 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:00:51.775309    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96183c7e-4734-4ea9-979e-7644c2ac2482-maas-api-tls podName:96183c7e-4734-4ea9-979e-7644c2ac2482 nodeName:}" failed. No retries permitted until 2026-07-22 04:00:52.275293468 +0000 UTC m=+1629.442528115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/96183c7e-4734-4ea9-979e-7644c2ac2482-maas-api-tls") pod "maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q" (UID: "96183c7e-4734-4ea9-979e-7644c2ac2482") : secret "maas-api-e2e-migrate-19ab37b5-serving-cert" not found
Jul 22 04:00:51.775937 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.775914    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96183c7e-4734-4ea9-979e-7644c2ac2482-openshift-service-ca\") pod \"maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:51.785746 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.785727    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hml7\" (UniqueName: \"kubernetes.io/projected/96183c7e-4734-4ea9-979e-7644c2ac2482-kube-api-access-4hml7\") pod \"maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:51.917039 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:51.917003    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:52.200119 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:52.200088    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:52.279257 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:52.279224    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96183c7e-4734-4ea9-979e-7644c2ac2482-maas-api-tls\") pod \"maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:52.281859 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:52.281841    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96183c7e-4734-4ea9-979e-7644c2ac2482-maas-api-tls\") pod \"maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:52.301552 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:52.301528    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:00:52.459305 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:52.459222    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:52.605317 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:52.605293    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"]
Jul 22 04:00:52.607816 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:00:52.607792    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96183c7e_4734_4ea9_979e_7644c2ac2482.slice/crio-3b46bf1f8d15739abee8e7571357ef0bcc0e0a4706ddb6120899dec9c286db84 WatchSource:0}: Error finding container 3b46bf1f8d15739abee8e7571357ef0bcc0e0a4706ddb6120899dec9c286db84: Status 404 returned error can't find the container with id 3b46bf1f8d15739abee8e7571357ef0bcc0e0a4706ddb6120899dec9c286db84
Jul 22 04:00:53.237469 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:53.237433    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q" event={"ID":"96183c7e-4734-4ea9-979e-7644c2ac2482","Type":"ContainerStarted","Data":"f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643"}
Jul 22 04:00:53.237635 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:53.237482    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q" event={"ID":"96183c7e-4734-4ea9-979e-7644c2ac2482","Type":"ContainerStarted","Data":"3b46bf1f8d15739abee8e7571357ef0bcc0e0a4706ddb6120899dec9c286db84"}
Jul 22 04:00:53.237635 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:53.237511    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:00:53.257229 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:53.257185    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q" podStartSLOduration=1.8184508579999998 podStartE2EDuration="2.257168737s" totalImagesPullingTime="438.717879ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:00:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:00:53.256149188 +0000 UTC m=+1630.423383848" watchObservedRunningTime="2026-07-22 04:00:53.257168737 +0000 UTC m=+1630.424403379"
Jul 22 04:00:59.247448 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:00:59.247422    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:01:26.974187 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:26.974152    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"]
Jul 22 04:01:26.974862 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:26.974461    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q" podUID="96183c7e-4734-4ea9-979e-7644c2ac2482" containerName="maas-api" containerID="cri-o://f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643" gracePeriod=30
Jul 22 04:01:27.000559 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.000533    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:27.231116 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.231061    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:01:27.296506 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.296478    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hml7\" (UniqueName: \"kubernetes.io/projected/96183c7e-4734-4ea9-979e-7644c2ac2482-kube-api-access-4hml7\") pod \"96183c7e-4734-4ea9-979e-7644c2ac2482\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") "
Jul 22 04:01:27.296623 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.296548    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96183c7e-4734-4ea9-979e-7644c2ac2482-openshift-service-ca\") pod \"96183c7e-4734-4ea9-979e-7644c2ac2482\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") "
Jul 22 04:01:27.296623 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.296588    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96183c7e-4734-4ea9-979e-7644c2ac2482-maas-api-tls\") pod \"96183c7e-4734-4ea9-979e-7644c2ac2482\" (UID: \"96183c7e-4734-4ea9-979e-7644c2ac2482\") "
Jul 22 04:01:27.296937 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.296914    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96183c7e-4734-4ea9-979e-7644c2ac2482-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "96183c7e-4734-4ea9-979e-7644c2ac2482" (UID: "96183c7e-4734-4ea9-979e-7644c2ac2482"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:01:27.298753 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.298727    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96183c7e-4734-4ea9-979e-7644c2ac2482-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "96183c7e-4734-4ea9-979e-7644c2ac2482" (UID: "96183c7e-4734-4ea9-979e-7644c2ac2482"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:01:27.298851 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.298769    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96183c7e-4734-4ea9-979e-7644c2ac2482-kube-api-access-4hml7" (OuterVolumeSpecName: "kube-api-access-4hml7") pod "96183c7e-4734-4ea9-979e-7644c2ac2482" (UID: "96183c7e-4734-4ea9-979e-7644c2ac2482"). InnerVolumeSpecName "kube-api-access-4hml7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:01:27.397798 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.397775    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hml7\" (UniqueName: \"kubernetes.io/projected/96183c7e-4734-4ea9-979e-7644c2ac2482-kube-api-access-4hml7\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:01:27.397798 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.397798    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96183c7e-4734-4ea9-979e-7644c2ac2482-openshift-service-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:01:27.397933 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.397809    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96183c7e-4734-4ea9-979e-7644c2ac2482-maas-api-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:01:27.409047 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.409021    2569 generic.go:356] "Generic (PLEG): container finished" podID="96183c7e-4734-4ea9-979e-7644c2ac2482" containerID="f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643" exitCode=0
Jul 22 04:01:27.409174 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.409070    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"
Jul 22 04:01:27.409174 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.409070    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q" event={"ID":"96183c7e-4734-4ea9-979e-7644c2ac2482","Type":"ContainerDied","Data":"f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643"}
Jul 22 04:01:27.409293 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.409192    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q" event={"ID":"96183c7e-4734-4ea9-979e-7644c2ac2482","Type":"ContainerDied","Data":"3b46bf1f8d15739abee8e7571357ef0bcc0e0a4706ddb6120899dec9c286db84"}
Jul 22 04:01:27.409293 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.409225    2569 scope.go:117] "RemoveContainer" containerID="f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643"
Jul 22 04:01:27.419171 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.419157    2569 scope.go:117] "RemoveContainer" containerID="f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643"
Jul 22 04:01:27.419424 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:01:27.419397    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643\": container with ID starting with f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643 not found: ID does not exist" containerID="f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643"
Jul 22 04:01:27.419482 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.419423    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643"} err="failed to get container status \"f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643\": rpc error: code = NotFound desc = could not find container \"f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643\": container with ID starting with f9f87e95e42a40adcbed4b650ae05ec07831da8c111159e19fefdbbfc344f643 not found: ID does not exist"
Jul 22 04:01:27.425705 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.425683    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"]
Jul 22 04:01:27.430589 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:27.430569    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-19ab37b5-84684fcd79-m4b2q"]
Jul 22 04:01:29.378100 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:29.378067    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96183c7e-4734-4ea9-979e-7644c2ac2482" path="/var/lib/kubelet/pods/96183c7e-4734-4ea9-979e-7644c2ac2482/volumes"
Jul 22 04:01:31.571591 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:31.571540    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:31.792115 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:31.792079    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:32.035028 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:32.034992    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:32.278140 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:32.278108    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:32.605925 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:32.605883    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:32.854491 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:32.854441    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:34.703437 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.703408    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:34.813840 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.813803    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"]
Jul 22 04:01:34.814192 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.814180    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96183c7e-4734-4ea9-979e-7644c2ac2482" containerName="maas-api"
Jul 22 04:01:34.814236 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.814194    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="96183c7e-4734-4ea9-979e-7644c2ac2482" containerName="maas-api"
Jul 22 04:01:34.814271 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.814258    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="96183c7e-4734-4ea9-979e-7644c2ac2482" containerName="maas-api"
Jul 22 04:01:34.817301 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.817284    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:34.819737 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.819718    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a1bed135-serving-cert\""
Jul 22 04:01:34.831972 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.831945    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"]
Jul 22 04:01:34.834325 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.834302    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:34.968701 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.968571    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxnfj\" (UniqueName: \"kubernetes.io/projected/5745b2bc-8b76-4733-8f89-c0b413fb48f5-kube-api-access-kxnfj\") pod \"maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:34.968701 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.968638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5745b2bc-8b76-4733-8f89-c0b413fb48f5-openshift-service-ca\") pod \"maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:34.968925 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.968741    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5745b2bc-8b76-4733-8f89-c0b413fb48f5-maas-api-tls\") pod \"maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:34.987764 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:34.987719    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:35.069330 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:35.069294    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxnfj\" (UniqueName: \"kubernetes.io/projected/5745b2bc-8b76-4733-8f89-c0b413fb48f5-kube-api-access-kxnfj\") pod \"maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:35.069536 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:35.069350    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5745b2bc-8b76-4733-8f89-c0b413fb48f5-openshift-service-ca\") pod \"maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:35.069536 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:35.069370    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5745b2bc-8b76-4733-8f89-c0b413fb48f5-maas-api-tls\") pod \"maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:35.069536 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:01:35.069478    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-serving-cert: secret "maas-api-e2e-ait-a1bed135-serving-cert" not found
Jul 22 04:01:35.069536 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:01:35.069538    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5745b2bc-8b76-4733-8f89-c0b413fb48f5-maas-api-tls podName:5745b2bc-8b76-4733-8f89-c0b413fb48f5 nodeName:}" failed. No retries permitted until 2026-07-22 04:01:35.569522832 +0000 UTC m=+1672.736757473 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5745b2bc-8b76-4733-8f89-c0b413fb48f5-maas-api-tls") pod "maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd" (UID: "5745b2bc-8b76-4733-8f89-c0b413fb48f5") : secret "maas-api-e2e-ait-a1bed135-serving-cert" not found
Jul 22 04:01:35.069982 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:35.069963    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5745b2bc-8b76-4733-8f89-c0b413fb48f5-openshift-service-ca\") pod \"maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:35.088103 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:35.088073    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxnfj\" (UniqueName: \"kubernetes.io/projected/5745b2bc-8b76-4733-8f89-c0b413fb48f5-kube-api-access-kxnfj\") pod \"maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:35.177423 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:35.177380    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:35.573733 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:35.573701    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5745b2bc-8b76-4733-8f89-c0b413fb48f5-maas-api-tls\") pod \"maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:35.576208 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:35.576177    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5745b2bc-8b76-4733-8f89-c0b413fb48f5-maas-api-tls\") pod \"maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:35.727512 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:35.727479    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:35.783603 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:35.783569    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:35.893076 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:35.893045    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:01:35.895053 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:35.895033    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"]
Jul 22 04:01:35.896139 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:01:35.896114    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5745b2bc_8b76_4733_8f89_c0b413fb48f5.slice/crio-ca05173762776098a52a336362e0d242736e5f9e4c93019add5237c8b5c4c94f WatchSource:0}: Error finding container ca05173762776098a52a336362e0d242736e5f9e4c93019add5237c8b5c4c94f: Status 404 returned error can't find the container with id ca05173762776098a52a336362e0d242736e5f9e4c93019add5237c8b5c4c94f
Jul 22 04:01:36.453180 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:36.453142    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd" event={"ID":"5745b2bc-8b76-4733-8f89-c0b413fb48f5","Type":"ContainerStarted","Data":"ca05173762776098a52a336362e0d242736e5f9e4c93019add5237c8b5c4c94f"}
Jul 22 04:01:37.460260 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:37.460223    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd" event={"ID":"5745b2bc-8b76-4733-8f89-c0b413fb48f5","Type":"ContainerStarted","Data":"ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8"}
Jul 22 04:01:37.460674 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:37.460319    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:01:37.480935 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:37.480882    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd" podStartSLOduration=2.915599686 podStartE2EDuration="3.480867355s" totalImagesPullingTime="565.267669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:01:37.479003429 +0000 UTC m=+1674.646238094" watchObservedRunningTime="2026-07-22 04:01:37.480867355 +0000 UTC m=+1674.648102057"
Jul 22 04:01:43.471780 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:01:43.471750    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:02:10.944986 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:10.944954    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"]
Jul 22 04:02:10.945489 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:10.945198    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd" podUID="5745b2bc-8b76-4733-8f89-c0b413fb48f5" containerName="maas-api" containerID="cri-o://ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8" gracePeriod=30
Jul 22 04:02:10.966718 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:10.966690    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:11.190169 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.190144    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:02:11.284539 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.284500    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5745b2bc-8b76-4733-8f89-c0b413fb48f5-openshift-service-ca\") pod \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") "
Jul 22 04:02:11.284783 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.284554    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5745b2bc-8b76-4733-8f89-c0b413fb48f5-maas-api-tls\") pod \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") "
Jul 22 04:02:11.284783 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.284601    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxnfj\" (UniqueName: \"kubernetes.io/projected/5745b2bc-8b76-4733-8f89-c0b413fb48f5-kube-api-access-kxnfj\") pod \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\" (UID: \"5745b2bc-8b76-4733-8f89-c0b413fb48f5\") "
Jul 22 04:02:11.284913 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.284860    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5745b2bc-8b76-4733-8f89-c0b413fb48f5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5745b2bc-8b76-4733-8f89-c0b413fb48f5" (UID: "5745b2bc-8b76-4733-8f89-c0b413fb48f5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:02:11.286911 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.286878    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5745b2bc-8b76-4733-8f89-c0b413fb48f5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5745b2bc-8b76-4733-8f89-c0b413fb48f5" (UID: "5745b2bc-8b76-4733-8f89-c0b413fb48f5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:02:11.287023 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.286990    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5745b2bc-8b76-4733-8f89-c0b413fb48f5-kube-api-access-kxnfj" (OuterVolumeSpecName: "kube-api-access-kxnfj") pod "5745b2bc-8b76-4733-8f89-c0b413fb48f5" (UID: "5745b2bc-8b76-4733-8f89-c0b413fb48f5"). InnerVolumeSpecName "kube-api-access-kxnfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:02:11.385454 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.385426    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5745b2bc-8b76-4733-8f89-c0b413fb48f5-openshift-service-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:02:11.385560 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.385460    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5745b2bc-8b76-4733-8f89-c0b413fb48f5-maas-api-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:02:11.385560 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.385477    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxnfj\" (UniqueName: \"kubernetes.io/projected/5745b2bc-8b76-4733-8f89-c0b413fb48f5-kube-api-access-kxnfj\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:02:11.628109 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.628017    2569 generic.go:356] "Generic (PLEG): container finished" podID="5745b2bc-8b76-4733-8f89-c0b413fb48f5" containerID="ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8" exitCode=0
Jul 22 04:02:11.628109 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.628069    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd" event={"ID":"5745b2bc-8b76-4733-8f89-c0b413fb48f5","Type":"ContainerDied","Data":"ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8"}
Jul 22 04:02:11.628109 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.628088    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"
Jul 22 04:02:11.628334 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.628150    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd" event={"ID":"5745b2bc-8b76-4733-8f89-c0b413fb48f5","Type":"ContainerDied","Data":"ca05173762776098a52a336362e0d242736e5f9e4c93019add5237c8b5c4c94f"}
Jul 22 04:02:11.628334 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.628181    2569 scope.go:117] "RemoveContainer" containerID="ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8"
Jul 22 04:02:11.638906 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.638887    2569 scope.go:117] "RemoveContainer" containerID="ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8"
Jul 22 04:02:11.639173 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:02:11.639156    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8\": container with ID starting with ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8 not found: ID does not exist" containerID="ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8"
Jul 22 04:02:11.639222 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.639182    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8"} err="failed to get container status \"ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8\": rpc error: code = NotFound desc = could not find container \"ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8\": container with ID starting with ce3a0b940fdf010f66b8acf077ff9b022bb1fd8ae397aef7d8c94d6dfac6f1a8 not found: ID does not exist"
Jul 22 04:02:11.648272 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.648238    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"]
Jul 22 04:02:11.654707 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:11.654684    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a1bed135-6c76b95cc8-z9tdd"]
Jul 22 04:02:13.378157 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:13.378128    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5745b2bc-8b76-4733-8f89-c0b413fb48f5" path="/var/lib/kubelet/pods/5745b2bc-8b76-4733-8f89-c0b413fb48f5/volumes"
Jul 22 04:02:15.559422 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:15.559388    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:16.797577 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:16.797540    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:17.036101 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:17.036065    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:17.262536 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:17.262499    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:17.578028 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:17.577951    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:17.786286 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:17.786254    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:19.856469 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:19.856431    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:19.938592 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:19.938564    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"]
Jul 22 04:02:19.938968 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:19.938956    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5745b2bc-8b76-4733-8f89-c0b413fb48f5" containerName="maas-api"
Jul 22 04:02:19.939017 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:19.938970    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5745b2bc-8b76-4733-8f89-c0b413fb48f5" containerName="maas-api"
Jul 22 04:02:19.939052 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:19.939035    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5745b2bc-8b76-4733-8f89-c0b413fb48f5" containerName="maas-api"
Jul 22 04:02:19.942064 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:19.942045    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:19.945003 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:19.944978    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-9593c364-serving-cert\""
Jul 22 04:02:19.957714 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:19.957622    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:19.959077 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:19.959056    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"]
Jul 22 04:02:20.045224 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.045195    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:20.062928 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.062902    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjpq6\" (UniqueName: \"kubernetes.io/projected/5f270fe0-952d-47e2-bb82-ba77045cb6f2-kube-api-access-fjpq6\") pod \"maas-api-e2e-derive-9593c364-79c9667f97-4lhnw\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:20.063068 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.062936    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f270fe0-952d-47e2-bb82-ba77045cb6f2-openshift-service-ca\") pod \"maas-api-e2e-derive-9593c364-79c9667f97-4lhnw\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:20.063068 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.063027    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f270fe0-952d-47e2-bb82-ba77045cb6f2-maas-api-tls\") pod \"maas-api-e2e-derive-9593c364-79c9667f97-4lhnw\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:20.164206 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.164120    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f270fe0-952d-47e2-bb82-ba77045cb6f2-maas-api-tls\") pod \"maas-api-e2e-derive-9593c364-79c9667f97-4lhnw\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:20.164206 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.164195    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjpq6\" (UniqueName: \"kubernetes.io/projected/5f270fe0-952d-47e2-bb82-ba77045cb6f2-kube-api-access-fjpq6\") pod \"maas-api-e2e-derive-9593c364-79c9667f97-4lhnw\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:20.164435 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.164219    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f270fe0-952d-47e2-bb82-ba77045cb6f2-openshift-service-ca\") pod \"maas-api-e2e-derive-9593c364-79c9667f97-4lhnw\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:20.164435 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:02:20.164297    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-serving-cert: secret "maas-api-e2e-derive-9593c364-serving-cert" not found
Jul 22 04:02:20.164435 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:02:20.164387    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f270fe0-952d-47e2-bb82-ba77045cb6f2-maas-api-tls podName:5f270fe0-952d-47e2-bb82-ba77045cb6f2 nodeName:}" failed. No retries permitted until 2026-07-22 04:02:20.664363596 +0000 UTC m=+1717.831598242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5f270fe0-952d-47e2-bb82-ba77045cb6f2-maas-api-tls") pod "maas-api-e2e-derive-9593c364-79c9667f97-4lhnw" (UID: "5f270fe0-952d-47e2-bb82-ba77045cb6f2") : secret "maas-api-e2e-derive-9593c364-serving-cert" not found
Jul 22 04:02:20.164924 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.164908    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f270fe0-952d-47e2-bb82-ba77045cb6f2-openshift-service-ca\") pod \"maas-api-e2e-derive-9593c364-79c9667f97-4lhnw\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:20.179258 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.179233    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjpq6\" (UniqueName: \"kubernetes.io/projected/5f270fe0-952d-47e2-bb82-ba77045cb6f2-kube-api-access-fjpq6\") pod \"maas-api-e2e-derive-9593c364-79c9667f97-4lhnw\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:20.476796 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.476768    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:20.647968 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.647930    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:20.669010 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.668986    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f270fe0-952d-47e2-bb82-ba77045cb6f2-maas-api-tls\") pod \"maas-api-e2e-derive-9593c364-79c9667f97-4lhnw\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:20.671615 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.671570    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f270fe0-952d-47e2-bb82-ba77045cb6f2-maas-api-tls\") pod \"maas-api-e2e-derive-9593c364-79c9667f97-4lhnw\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:20.749406 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.749328    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:20.852537 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.852503    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:20.996704 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:20.996681    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"]
Jul 22 04:02:20.998378 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:02:20.998354    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f270fe0_952d_47e2_bb82_ba77045cb6f2.slice/crio-ccc000481d342e3838e8960f54b8d2b4ad184e507af4491d1917635d68e2a94b WatchSource:0}: Error finding container ccc000481d342e3838e8960f54b8d2b4ad184e507af4491d1917635d68e2a94b: Status 404 returned error can't find the container with id ccc000481d342e3838e8960f54b8d2b4ad184e507af4491d1917635d68e2a94b
Jul 22 04:02:21.678330 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:21.678293    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw" event={"ID":"5f270fe0-952d-47e2-bb82-ba77045cb6f2","Type":"ContainerStarted","Data":"4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990"}
Jul 22 04:02:21.678500 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:21.678355    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw" event={"ID":"5f270fe0-952d-47e2-bb82-ba77045cb6f2","Type":"ContainerStarted","Data":"ccc000481d342e3838e8960f54b8d2b4ad184e507af4491d1917635d68e2a94b"}
Jul 22 04:02:21.678500 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:21.678397    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:21.708181 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:21.708121    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw" podStartSLOduration=2.267622409 podStartE2EDuration="2.70809866s" totalImagesPullingTime="440.476251ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:02:21.707302967 +0000 UTC m=+1718.874537630" watchObservedRunningTime="2026-07-22 04:02:21.70809866 +0000 UTC m=+1718.875333327"
Jul 22 04:02:27.689765 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:27.689734    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:28.153139 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:28.153111    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:28.254427 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:28.254392    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:42.702470 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:42.702435    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:42.805290 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:42.805255    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:55.274163 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.274128    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"]
Jul 22 04:02:55.274760 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.274440    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw" podUID="5f270fe0-952d-47e2-bb82-ba77045cb6f2" containerName="maas-api" containerID="cri-o://4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990" gracePeriod=30
Jul 22 04:02:55.302137 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.302106    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:02:55.525428 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.525361    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:55.578863 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.578837    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f270fe0-952d-47e2-bb82-ba77045cb6f2-maas-api-tls\") pod \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") "
Jul 22 04:02:55.579035 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.578900    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f270fe0-952d-47e2-bb82-ba77045cb6f2-openshift-service-ca\") pod \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") "
Jul 22 04:02:55.579035 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.578992    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjpq6\" (UniqueName: \"kubernetes.io/projected/5f270fe0-952d-47e2-bb82-ba77045cb6f2-kube-api-access-fjpq6\") pod \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\" (UID: \"5f270fe0-952d-47e2-bb82-ba77045cb6f2\") "
Jul 22 04:02:55.579285 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.579257    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f270fe0-952d-47e2-bb82-ba77045cb6f2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f270fe0-952d-47e2-bb82-ba77045cb6f2" (UID: "5f270fe0-952d-47e2-bb82-ba77045cb6f2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:02:55.581108 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.581081    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f270fe0-952d-47e2-bb82-ba77045cb6f2-kube-api-access-fjpq6" (OuterVolumeSpecName: "kube-api-access-fjpq6") pod "5f270fe0-952d-47e2-bb82-ba77045cb6f2" (UID: "5f270fe0-952d-47e2-bb82-ba77045cb6f2"). InnerVolumeSpecName "kube-api-access-fjpq6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:02:55.581108 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.581099    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f270fe0-952d-47e2-bb82-ba77045cb6f2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f270fe0-952d-47e2-bb82-ba77045cb6f2" (UID: "5f270fe0-952d-47e2-bb82-ba77045cb6f2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:02:55.679626 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.679588    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f270fe0-952d-47e2-bb82-ba77045cb6f2-openshift-service-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:02:55.679626 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.679616    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjpq6\" (UniqueName: \"kubernetes.io/projected/5f270fe0-952d-47e2-bb82-ba77045cb6f2-kube-api-access-fjpq6\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:02:55.679626 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.679626    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f270fe0-952d-47e2-bb82-ba77045cb6f2-maas-api-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:02:55.852133 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.852042    2569 generic.go:356] "Generic (PLEG): container finished" podID="5f270fe0-952d-47e2-bb82-ba77045cb6f2" containerID="4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990" exitCode=0
Jul 22 04:02:55.852133 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.852095    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw" event={"ID":"5f270fe0-952d-47e2-bb82-ba77045cb6f2","Type":"ContainerDied","Data":"4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990"}
Jul 22 04:02:55.852322 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.852138    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw" event={"ID":"5f270fe0-952d-47e2-bb82-ba77045cb6f2","Type":"ContainerDied","Data":"ccc000481d342e3838e8960f54b8d2b4ad184e507af4491d1917635d68e2a94b"}
Jul 22 04:02:55.852322 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.852160    2569 scope.go:117] "RemoveContainer" containerID="4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990"
Jul 22 04:02:55.852322 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.852096    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"
Jul 22 04:02:55.861684 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.861637    2569 scope.go:117] "RemoveContainer" containerID="4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990"
Jul 22 04:02:55.861952 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:02:55.861933    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990\": container with ID starting with 4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990 not found: ID does not exist" containerID="4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990"
Jul 22 04:02:55.862022 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.861963    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990"} err="failed to get container status \"4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990\": rpc error: code = NotFound desc = could not find container \"4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990\": container with ID starting with 4751859cf2c6ad5d0f097d471e9b2da459e48a74467ff534a4eb19a17b76b990 not found: ID does not exist"
Jul 22 04:02:55.874035 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.874013    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"]
Jul 22 04:02:55.878561 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:55.878541    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9593c364-79c9667f97-4lhnw"]
Jul 22 04:02:57.378934 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:57.378902    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f270fe0-952d-47e2-bb82-ba77045cb6f2" path="/var/lib/kubelet/pods/5f270fe0-952d-47e2-bb82-ba77045cb6f2/volumes"
Jul 22 04:02:59.834963 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:02:59.834930    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:00.012827 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:00.012779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:00.246424 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:00.246394    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:00.747520 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:00.747483    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:00.841548 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:00.841516    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:00.942071 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:00.942028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:02.431176 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:02.431146    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:08.254827 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:08.254791    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:08.359266 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:08.359226    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:08.471345 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:08.471312    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:08.569293 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:08.569209    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:09.150060 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:09.150029    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:34.966587 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:34.966497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:41.320119 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:41.320081    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:43.181722 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:43.181682    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:03:57.439866 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:03:57.439828    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:03.839806 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:03.839767    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:04.008501 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:04.008462    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:04.149668 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:04.149564    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:14.638906 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:14.638865    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:15.433483 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:15.433449    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:22.045903 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:22.045864    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:22.180152 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:22.180117    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:22.364348 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:22.364263    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:22.567506 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:22.567476    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:23.239741 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:23.239697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:23.334912 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:23.334870    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:23.434322 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:23.434264    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:30.186011 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:30.185974    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:36.605484 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:36.605441    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:36.705930 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:36.705890    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:37.325993 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:37.325960    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:43.260389 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:43.260347    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:43.449358 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:43.449328    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:43.548397 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:43.548305    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:43.861140 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:43.861059    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:44.471743 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:44.471706    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:47.310138 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.310098    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:47.411828 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.411794    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:47.459698 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.459666    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"]
Jul 22 04:04:47.460056 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.460043    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f270fe0-952d-47e2-bb82-ba77045cb6f2" containerName="maas-api"
Jul 22 04:04:47.460123 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.460056    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f270fe0-952d-47e2-bb82-ba77045cb6f2" containerName="maas-api"
Jul 22 04:04:47.460123 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.460114    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f270fe0-952d-47e2-bb82-ba77045cb6f2" containerName="maas-api"
Jul 22 04:04:47.463347 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.463326    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:47.466214 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.466197    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9cb7aec7-serving-cert\""
Jul 22 04:04:47.476198 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.476174    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"]
Jul 22 04:04:47.495753 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.495729    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:47.575139 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.575044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-maas-api-tls\") pod \"maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:47.575139 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.575102    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2v8m\" (UniqueName: \"kubernetes.io/projected/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-kube-api-access-b2v8m\") pod \"maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:47.575334 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.575195    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-openshift-service-ca\") pod \"maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:47.676277 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.676242    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2v8m\" (UniqueName: \"kubernetes.io/projected/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-kube-api-access-b2v8m\") pod \"maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:47.676471 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.676300    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-openshift-service-ca\") pod \"maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:47.676471 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.676379    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-maas-api-tls\") pod \"maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:47.676591 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:04:47.676482    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-serving-cert: secret "maas-api-e2e-mt-9cb7aec7-serving-cert" not found
Jul 22 04:04:47.676591 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:04:47.676555    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-maas-api-tls podName:01a4edf4-a71b-49e5-8d05-9ee2f09a1251 nodeName:}" failed. No retries permitted until 2026-07-22 04:04:48.176535507 +0000 UTC m=+1865.343770166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-maas-api-tls") pod "maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2" (UID: "01a4edf4-a71b-49e5-8d05-9ee2f09a1251") : secret "maas-api-e2e-mt-9cb7aec7-serving-cert" not found
Jul 22 04:04:47.677063 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.677036    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-openshift-service-ca\") pod \"maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:47.687621 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.687598    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2v8m\" (UniqueName: \"kubernetes.io/projected/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-kube-api-access-b2v8m\") pod \"maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:47.847502 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:47.847402    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:48.019503 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:48.019468    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:48.120139 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:48.120054    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:48.181833 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:48.181797    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-maas-api-tls\") pod \"maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:48.184277 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:48.184258    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-maas-api-tls\") pod \"maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:48.374161 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:48.374066    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:48.526926 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:48.526895    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"]
Jul 22 04:04:48.534549 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:04:48.534525    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a4edf4_a71b_49e5_8d05_9ee2f09a1251.slice/crio-f21321076c744a81f34dec00b75371e76f6a741040dddacd75f19acf0a2e0eaa WatchSource:0}: Error finding container f21321076c744a81f34dec00b75371e76f6a741040dddacd75f19acf0a2e0eaa: Status 404 returned error can't find the container with id f21321076c744a81f34dec00b75371e76f6a741040dddacd75f19acf0a2e0eaa
Jul 22 04:04:49.430588 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:49.430550    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2" event={"ID":"01a4edf4-a71b-49e5-8d05-9ee2f09a1251","Type":"ContainerStarted","Data":"ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114"}
Jul 22 04:04:49.431024 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:49.430603    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2" event={"ID":"01a4edf4-a71b-49e5-8d05-9ee2f09a1251","Type":"ContainerStarted","Data":"f21321076c744a81f34dec00b75371e76f6a741040dddacd75f19acf0a2e0eaa"}
Jul 22 04:04:49.431024 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:49.430662    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:49.448078 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:49.448027    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2" podStartSLOduration=2.038516676 podStartE2EDuration="2.448012938s" totalImagesPullingTime="409.496262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:04:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:04:49.447187249 +0000 UTC m=+1866.614421917" watchObservedRunningTime="2026-07-22 04:04:49.448012938 +0000 UTC m=+1866.615247603"
Jul 22 04:04:51.747271 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:51.747241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:52.457970 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:52.457926    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:52.546915 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:52.546888    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:52.905413 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:52.905327    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:55.440691 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:55.440657    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:04:58.917943 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:58.917904    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:04:58.988617 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:04:58.988587    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:09.707866 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:09.707831    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"]
Jul 22 04:05:09.708716 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:09.708678    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2" podUID="01a4edf4-a71b-49e5-8d05-9ee2f09a1251" containerName="maas-api" containerID="cri-o://ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114" gracePeriod=30
Jul 22 04:05:09.791454 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:09.791425    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:09.962367 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:09.962308    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:05:10.084939 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.084911    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2v8m\" (UniqueName: \"kubernetes.io/projected/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-kube-api-access-b2v8m\") pod \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") "
Jul 22 04:05:10.085102 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.084988    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-openshift-service-ca\") pod \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") "
Jul 22 04:05:10.085102 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.085060    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-maas-api-tls\") pod \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\" (UID: \"01a4edf4-a71b-49e5-8d05-9ee2f09a1251\") "
Jul 22 04:05:10.085298 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.085281    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01a4edf4-a71b-49e5-8d05-9ee2f09a1251" (UID: "01a4edf4-a71b-49e5-8d05-9ee2f09a1251"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:05:10.087276 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.087254    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-kube-api-access-b2v8m" (OuterVolumeSpecName: "kube-api-access-b2v8m") pod "01a4edf4-a71b-49e5-8d05-9ee2f09a1251" (UID: "01a4edf4-a71b-49e5-8d05-9ee2f09a1251"). InnerVolumeSpecName "kube-api-access-b2v8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:05:10.087358 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.087282    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01a4edf4-a71b-49e5-8d05-9ee2f09a1251" (UID: "01a4edf4-a71b-49e5-8d05-9ee2f09a1251"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:05:10.186606 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.186571    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2v8m\" (UniqueName: \"kubernetes.io/projected/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-kube-api-access-b2v8m\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:05:10.186606 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.186601    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-openshift-service-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:05:10.186606 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.186612    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01a4edf4-a71b-49e5-8d05-9ee2f09a1251-maas-api-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:05:10.530844 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.530812    2569 generic.go:356] "Generic (PLEG): container finished" podID="01a4edf4-a71b-49e5-8d05-9ee2f09a1251" containerID="ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114" exitCode=0
Jul 22 04:05:10.531019 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.530853    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"
Jul 22 04:05:10.531019 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.530871    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2" event={"ID":"01a4edf4-a71b-49e5-8d05-9ee2f09a1251","Type":"ContainerDied","Data":"ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114"}
Jul 22 04:05:10.531019 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.530915    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2" event={"ID":"01a4edf4-a71b-49e5-8d05-9ee2f09a1251","Type":"ContainerDied","Data":"f21321076c744a81f34dec00b75371e76f6a741040dddacd75f19acf0a2e0eaa"}
Jul 22 04:05:10.531019 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.530936    2569 scope.go:117] "RemoveContainer" containerID="ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114"
Jul 22 04:05:10.540212 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.540196    2569 scope.go:117] "RemoveContainer" containerID="ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114"
Jul 22 04:05:10.540448 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:05:10.540431    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114\": container with ID starting with ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114 not found: ID does not exist" containerID="ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114"
Jul 22 04:05:10.540502 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.540455    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114"} err="failed to get container status \"ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114\": rpc error: code = NotFound desc = could not find container \"ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114\": container with ID starting with ab420854c37939d1412bb247d09e448e49d9f5e960c33b2199595001206e1114 not found: ID does not exist"
Jul 22 04:05:10.552394 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.552370    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"]
Jul 22 04:05:10.556455 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:10.556436    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9cb7aec7-786cccd5f4-rlds2"]
Jul 22 04:05:11.378099 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:11.378069    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01a4edf4-a71b-49e5-8d05-9ee2f09a1251" path="/var/lib/kubelet/pods/01a4edf4-a71b-49e5-8d05-9ee2f09a1251/volumes"
Jul 22 04:05:14.350842 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:14.350803    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:14.749623 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:14.749596    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:20.980464 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:20.980427    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:21.078291 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:21.078259    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:21.277837 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:21.277753    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:21.512795 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:21.512756    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:21.668208 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:21.668112    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:21.768793 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:21.768761    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:21.867444 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:21.867410    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:27.578857 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:27.578818    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:27.688280 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:27.688248    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:27.782626 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:27.782591    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:27.936049 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:27.935967    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:33.854131 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:33.854088    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:33.957247 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:33.957219    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:40.825576 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:40.825521    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:41.163924 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:41.163850    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:41.394521 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:41.394493    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:44.530856 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.530825    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:44.620788 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.620749    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:44.624893 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.624867    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"]
Jul 22 04:05:44.625318 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.625302    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01a4edf4-a71b-49e5-8d05-9ee2f09a1251" containerName="maas-api"
Jul 22 04:05:44.625362 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.625321    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="01a4edf4-a71b-49e5-8d05-9ee2f09a1251" containerName="maas-api"
Jul 22 04:05:44.625413 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.625404    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="01a4edf4-a71b-49e5-8d05-9ee2f09a1251" containerName="maas-api"
Jul 22 04:05:44.629424 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.629407    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:44.632883 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.632858    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-2f6647b0-serving-cert\""
Jul 22 04:05:44.641561 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.641536    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"]
Jul 22 04:05:44.720943 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.720912    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:44.793228 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.793133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69778ff2-7f12-4ad2-99ed-e97526982d99-maas-api-tls\") pod \"maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:44.793228 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.793174    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nsl2\" (UniqueName: \"kubernetes.io/projected/69778ff2-7f12-4ad2-99ed-e97526982d99-kube-api-access-9nsl2\") pod \"maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:44.793429 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.793263    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69778ff2-7f12-4ad2-99ed-e97526982d99-openshift-service-ca\") pod \"maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:44.894213 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.894173    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69778ff2-7f12-4ad2-99ed-e97526982d99-maas-api-tls\") pod \"maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:44.894213 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.894210    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nsl2\" (UniqueName: \"kubernetes.io/projected/69778ff2-7f12-4ad2-99ed-e97526982d99-kube-api-access-9nsl2\") pod \"maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:44.894464 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.894244    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69778ff2-7f12-4ad2-99ed-e97526982d99-openshift-service-ca\") pod \"maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:44.894464 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:05:44.894336    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-serving-cert: secret "maas-api-e2e-mt-2f6647b0-serving-cert" not found
Jul 22 04:05:44.894464 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:05:44.894403    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69778ff2-7f12-4ad2-99ed-e97526982d99-maas-api-tls podName:69778ff2-7f12-4ad2-99ed-e97526982d99 nodeName:}" failed. No retries permitted until 2026-07-22 04:05:45.394383752 +0000 UTC m=+1922.561618396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/69778ff2-7f12-4ad2-99ed-e97526982d99-maas-api-tls") pod "maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc" (UID: "69778ff2-7f12-4ad2-99ed-e97526982d99") : secret "maas-api-e2e-mt-2f6647b0-serving-cert" not found
Jul 22 04:05:44.894913 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.894893    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69778ff2-7f12-4ad2-99ed-e97526982d99-openshift-service-ca\") pod \"maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:44.907377 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:44.907355    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nsl2\" (UniqueName: \"kubernetes.io/projected/69778ff2-7f12-4ad2-99ed-e97526982d99-kube-api-access-9nsl2\") pod \"maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:45.090116 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:45.090015    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:45.339011 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:45.338977    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:45.399687 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:45.399572    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69778ff2-7f12-4ad2-99ed-e97526982d99-maas-api-tls\") pod \"maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:45.402210 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:45.402189    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69778ff2-7f12-4ad2-99ed-e97526982d99-maas-api-tls\") pod \"maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:45.539474 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:45.539445    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:45.682063 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:45.682040    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"]
Jul 22 04:05:45.683976 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:05:45.683947    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69778ff2_7f12_4ad2_99ed_e97526982d99.slice/crio-8fbc43074f61d75060d6361d1f1944b035d5daefd45b5a2d28a1bf78fa305e16 WatchSource:0}: Error finding container 8fbc43074f61d75060d6361d1f1944b035d5daefd45b5a2d28a1bf78fa305e16: Status 404 returned error can't find the container with id 8fbc43074f61d75060d6361d1f1944b035d5daefd45b5a2d28a1bf78fa305e16
Jul 22 04:05:45.685444 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:45.685421    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:05:45.705834 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:45.705797    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc" event={"ID":"69778ff2-7f12-4ad2-99ed-e97526982d99","Type":"ContainerStarted","Data":"8fbc43074f61d75060d6361d1f1944b035d5daefd45b5a2d28a1bf78fa305e16"}
Jul 22 04:05:45.891778 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:45.891741    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:46.713237 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:46.713204    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc" event={"ID":"69778ff2-7f12-4ad2-99ed-e97526982d99","Type":"ContainerStarted","Data":"0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943"}
Jul 22 04:05:46.713630 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:46.713343    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:05:46.734581 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:46.734512    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc" podStartSLOduration=2.374455821 podStartE2EDuration="2.734493969s" totalImagesPullingTime="360.038148ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:05:46.731302334 +0000 UTC m=+1923.898536990" watchObservedRunningTime="2026-07-22 04:05:46.734493969 +0000 UTC m=+1923.901728634"
Jul 22 04:05:49.038881 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:49.038840    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:05:52.724444 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:05:52.724420    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:06:01.995487 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:01.995452    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:06:12.333176 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:12.333125    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:06:38.549901 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.549710    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"]
Jul 22 04:06:38.552354 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.550603    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc" podUID="69778ff2-7f12-4ad2-99ed-e97526982d99" containerName="maas-api" containerID="cri-o://0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943" gracePeriod=30
Jul 22 04:06:38.586503 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.586479    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:06:38.798865 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.798837    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:06:38.972287 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.972253    2569 generic.go:356] "Generic (PLEG): container finished" podID="69778ff2-7f12-4ad2-99ed-e97526982d99" containerID="0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943" exitCode=0
Jul 22 04:06:38.972457 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.972301    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"
Jul 22 04:06:38.972457 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.972304    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc" event={"ID":"69778ff2-7f12-4ad2-99ed-e97526982d99","Type":"ContainerDied","Data":"0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943"}
Jul 22 04:06:38.972457 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.972357    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc" event={"ID":"69778ff2-7f12-4ad2-99ed-e97526982d99","Type":"ContainerDied","Data":"8fbc43074f61d75060d6361d1f1944b035d5daefd45b5a2d28a1bf78fa305e16"}
Jul 22 04:06:38.972457 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.972386    2569 scope.go:117] "RemoveContainer" containerID="0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943"
Jul 22 04:06:38.974615 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.974592    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69778ff2-7f12-4ad2-99ed-e97526982d99-maas-api-tls\") pod \"69778ff2-7f12-4ad2-99ed-e97526982d99\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") "
Jul 22 04:06:38.974615 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.974618    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69778ff2-7f12-4ad2-99ed-e97526982d99-openshift-service-ca\") pod \"69778ff2-7f12-4ad2-99ed-e97526982d99\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") "
Jul 22 04:06:38.974837 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.974692    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9nsl2\" (UniqueName: \"kubernetes.io/projected/69778ff2-7f12-4ad2-99ed-e97526982d99-kube-api-access-9nsl2\") pod \"69778ff2-7f12-4ad2-99ed-e97526982d99\" (UID: \"69778ff2-7f12-4ad2-99ed-e97526982d99\") "
Jul 22 04:06:38.975050 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.975020    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69778ff2-7f12-4ad2-99ed-e97526982d99-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "69778ff2-7f12-4ad2-99ed-e97526982d99" (UID: "69778ff2-7f12-4ad2-99ed-e97526982d99"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:06:38.976755 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.976731    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69778ff2-7f12-4ad2-99ed-e97526982d99-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "69778ff2-7f12-4ad2-99ed-e97526982d99" (UID: "69778ff2-7f12-4ad2-99ed-e97526982d99"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:06:38.976894 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.976873    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69778ff2-7f12-4ad2-99ed-e97526982d99-kube-api-access-9nsl2" (OuterVolumeSpecName: "kube-api-access-9nsl2") pod "69778ff2-7f12-4ad2-99ed-e97526982d99" (UID: "69778ff2-7f12-4ad2-99ed-e97526982d99"). InnerVolumeSpecName "kube-api-access-9nsl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:06:38.993079 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.993049    2569 scope.go:117] "RemoveContainer" containerID="0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943"
Jul 22 04:06:38.993359 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:06:38.993339    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943\": container with ID starting with 0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943 not found: ID does not exist" containerID="0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943"
Jul 22 04:06:38.993425 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:38.993370    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943"} err="failed to get container status \"0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943\": rpc error: code = NotFound desc = could not find container \"0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943\": container with ID starting with 0d110f01917322a7534be9cc24d4727f6d7dd38b61e20e0e4092056ac4f8e943 not found: ID does not exist"
Jul 22 04:06:39.075609 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:39.075578    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/69778ff2-7f12-4ad2-99ed-e97526982d99-maas-api-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:06:39.075609 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:39.075604    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/69778ff2-7f12-4ad2-99ed-e97526982d99-openshift-service-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:06:39.075609 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:39.075614    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9nsl2\" (UniqueName: \"kubernetes.io/projected/69778ff2-7f12-4ad2-99ed-e97526982d99-kube-api-access-9nsl2\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:06:39.297324 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:39.297291    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"]
Jul 22 04:06:39.302298 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:39.302264    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-2f6647b0-6cf559c686-wjwmc"]
Jul 22 04:06:39.378819 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:39.378787    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69778ff2-7f12-4ad2-99ed-e97526982d99" path="/var/lib/kubelet/pods/69778ff2-7f12-4ad2-99ed-e97526982d99/volumes"
Jul 22 04:06:41.812165 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:41.812116    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:06:43.170610 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:43.170572    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:06:45.444221 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:45.444179    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:06:50.476594 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:06:50.476557    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:26.648097 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:26.648046    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:26.748488 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:26.748453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:27.012011 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:27.011980    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:27.670019 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:27.669986    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:28.945037 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:28.945003    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:29.045226 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:29.045195    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:33.323025 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:33.322974    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:33.393694 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:33.393625    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:33.630329 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:33.630241    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:33.864908 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:33.864874    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:34.959726 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:34.959694    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:35.150860 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:35.150806    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:35.914669 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:35.914600    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:36.012000 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:36.011954    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:36.113758 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:36.113704    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:37.481700 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:37.481637    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:41.331272 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:41.331237    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:41.411824 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:41.411796    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:43.471083 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:43.471050    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:43.572291 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:43.572245    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:44.166329 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:44.166291    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:50.044135 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:50.044090    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:50.149348 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:50.149317    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:07:50.256480 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:07:50.256453    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:00.754256 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:00.754224    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:01.094862 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:01.094779    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:18.249324 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:18.249285    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:22.066091 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:22.066052    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:29.795312 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:29.795276    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:29.913773 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:29.913740    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:30.143981 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:30.143906    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:30.478183 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:30.478151    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:31.058488 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:31.058461    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:33.453315 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.453281    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:33.532429 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.532397    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"]
Jul 22 04:08:33.532827 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.532811    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69778ff2-7f12-4ad2-99ed-e97526982d99" containerName="maas-api"
Jul 22 04:08:33.532827 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.532827    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="69778ff2-7f12-4ad2-99ed-e97526982d99" containerName="maas-api"
Jul 22 04:08:33.532984 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.532903    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="69778ff2-7f12-4ad2-99ed-e97526982d99" containerName="maas-api"
Jul 22 04:08:33.535901 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.535882    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:33.538630 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.538601    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-41e8d3-serving-cert\""
Jul 22 04:08:33.549820 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.549798    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"]
Jul 22 04:08:33.557857 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.557832    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:33.585890 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.585854    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f77404-fa8a-41d3-9bf2-9b1754b8df23-openshift-service-ca\") pod \"maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:33.586034 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.585903    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ql4z\" (UniqueName: \"kubernetes.io/projected/96f77404-fa8a-41d3-9bf2-9b1754b8df23-kube-api-access-2ql4z\") pod \"maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:33.586034 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.585968    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96f77404-fa8a-41d3-9bf2-9b1754b8df23-maas-api-tls\") pod \"maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:33.649909 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.649880    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:33.686553 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.686527    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f77404-fa8a-41d3-9bf2-9b1754b8df23-openshift-service-ca\") pod \"maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:33.686723 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.686559    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ql4z\" (UniqueName: \"kubernetes.io/projected/96f77404-fa8a-41d3-9bf2-9b1754b8df23-kube-api-access-2ql4z\") pod \"maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:33.686723 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.686592    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96f77404-fa8a-41d3-9bf2-9b1754b8df23-maas-api-tls\") pod \"maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:33.686809 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:08:33.686721    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-serving-cert: secret "maas-api-e2e-inf-a-41e8d3-serving-cert" not found
Jul 22 04:08:33.686809 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:08:33.686800    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f77404-fa8a-41d3-9bf2-9b1754b8df23-maas-api-tls podName:96f77404-fa8a-41d3-9bf2-9b1754b8df23 nodeName:}" failed. No retries permitted until 2026-07-22 04:08:34.186782325 +0000 UTC m=+2091.354016970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/96f77404-fa8a-41d3-9bf2-9b1754b8df23-maas-api-tls") pod "maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn" (UID: "96f77404-fa8a-41d3-9bf2-9b1754b8df23") : secret "maas-api-e2e-inf-a-41e8d3-serving-cert" not found
Jul 22 04:08:33.687215 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.687196    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f77404-fa8a-41d3-9bf2-9b1754b8df23-openshift-service-ca\") pod \"maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:33.695278 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.695259    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ql4z\" (UniqueName: \"kubernetes.io/projected/96f77404-fa8a-41d3-9bf2-9b1754b8df23-kube-api-access-2ql4z\") pod \"maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:33.933893 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:33.933813    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:34.180002 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:34.179970    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:34.191630 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:34.191545    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96f77404-fa8a-41d3-9bf2-9b1754b8df23-maas-api-tls\") pod \"maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:34.194068 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:34.194041    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96f77404-fa8a-41d3-9bf2-9b1754b8df23-maas-api-tls\") pod \"maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:34.328399 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:34.328361    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:34.446839 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:34.446762    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:34.586811 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:34.586785    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"]
Jul 22 04:08:34.588159 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:08:34.588135    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f77404_fa8a_41d3_9bf2_9b1754b8df23.slice/crio-8e3d67fa01e10a2df0d9ac288d8f29b9b56cc71d40cbd3abaa8dc765dfc8fe66 WatchSource:0}: Error finding container 8e3d67fa01e10a2df0d9ac288d8f29b9b56cc71d40cbd3abaa8dc765dfc8fe66: Status 404 returned error can't find the container with id 8e3d67fa01e10a2df0d9ac288d8f29b9b56cc71d40cbd3abaa8dc765dfc8fe66
Jul 22 04:08:35.544262 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:35.544230    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn" event={"ID":"96f77404-fa8a-41d3-9bf2-9b1754b8df23","Type":"ContainerStarted","Data":"c99e2ab0e31055b9785141942ebe57b32f8d7bbd645ce474d975c326ff35e871"}
Jul 22 04:08:35.544459 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:35.544279    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn" event={"ID":"96f77404-fa8a-41d3-9bf2-9b1754b8df23","Type":"ContainerStarted","Data":"8e3d67fa01e10a2df0d9ac288d8f29b9b56cc71d40cbd3abaa8dc765dfc8fe66"}
Jul 22 04:08:35.544459 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:35.544365    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:35.563719 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:35.563676    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn" podStartSLOduration=2.139570236 podStartE2EDuration="2.563664616s" totalImagesPullingTime="424.09438ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:08:35.561745658 +0000 UTC m=+2092.728980324" watchObservedRunningTime="2026-07-22 04:08:35.563664616 +0000 UTC m=+2092.730899277"
Jul 22 04:08:37.926518 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:37.926484    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:38.266601 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:38.266569    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:38.598656 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:38.598568    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:38.854959 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:38.854881    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:41.528266 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:41.528233    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:41.555006 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:41.554980    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:08:41.622964 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:41.622930    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:41.839351 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:41.839266    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"]
Jul 22 04:08:41.843154 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:41.843133    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:41.847392 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:41.847369    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-b9a16f-serving-cert\""
Jul 22 04:08:41.870063 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:41.870034    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"]
Jul 22 04:08:41.893588 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:41.893544    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:41.961982 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:41.961953    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e691e6a6-480d-4eb5-b599-00c26e76274d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4\" (UID: \"e691e6a6-480d-4eb5-b599-00c26e76274d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:41.962138 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:41.962001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e691e6a6-480d-4eb5-b599-00c26e76274d-maas-api-tls\") pod \"maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4\" (UID: \"e691e6a6-480d-4eb5-b599-00c26e76274d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:41.962138 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:41.962027    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45ggn\" (UniqueName: \"kubernetes.io/projected/e691e6a6-480d-4eb5-b599-00c26e76274d-kube-api-access-45ggn\") pod \"maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4\" (UID: \"e691e6a6-480d-4eb5-b599-00c26e76274d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:42.046669 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:42.046618    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:42.062919 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:42.062881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e691e6a6-480d-4eb5-b599-00c26e76274d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4\" (UID: \"e691e6a6-480d-4eb5-b599-00c26e76274d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:42.063092 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:42.062951    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e691e6a6-480d-4eb5-b599-00c26e76274d-maas-api-tls\") pod \"maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4\" (UID: \"e691e6a6-480d-4eb5-b599-00c26e76274d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:42.063092 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:42.062990    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45ggn\" (UniqueName: \"kubernetes.io/projected/e691e6a6-480d-4eb5-b599-00c26e76274d-kube-api-access-45ggn\") pod \"maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4\" (UID: \"e691e6a6-480d-4eb5-b599-00c26e76274d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:42.063576 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:42.063553    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e691e6a6-480d-4eb5-b599-00c26e76274d-openshift-service-ca\") pod \"maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4\" (UID: \"e691e6a6-480d-4eb5-b599-00c26e76274d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:42.065532 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:42.065512    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e691e6a6-480d-4eb5-b599-00c26e76274d-maas-api-tls\") pod \"maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4\" (UID: \"e691e6a6-480d-4eb5-b599-00c26e76274d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:42.093055 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:42.093002    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45ggn\" (UniqueName: \"kubernetes.io/projected/e691e6a6-480d-4eb5-b599-00c26e76274d-kube-api-access-45ggn\") pod \"maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4\" (UID: \"e691e6a6-480d-4eb5-b599-00c26e76274d\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:42.153171 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:42.153142    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:42.301218 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:42.301189    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"]
Jul 22 04:08:42.303497 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:08:42.303467    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode691e6a6_480d_4eb5_b599_00c26e76274d.slice/crio-6b9fc82e64d1777f3d4c7f33b2d04e38aaba29cd973c40e6dd5979c3c9b58b7f WatchSource:0}: Error finding container 6b9fc82e64d1777f3d4c7f33b2d04e38aaba29cd973c40e6dd5979c3c9b58b7f: Status 404 returned error can't find the container with id 6b9fc82e64d1777f3d4c7f33b2d04e38aaba29cd973c40e6dd5979c3c9b58b7f
Jul 22 04:08:42.483826 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:42.483789    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:42.580397 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:42.580360    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4" event={"ID":"e691e6a6-480d-4eb5-b599-00c26e76274d","Type":"ContainerStarted","Data":"6b9fc82e64d1777f3d4c7f33b2d04e38aaba29cd973c40e6dd5979c3c9b58b7f"}
Jul 22 04:08:42.583259 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:42.583237    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:43.588023 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:43.587985    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4" event={"ID":"e691e6a6-480d-4eb5-b599-00c26e76274d","Type":"ContainerStarted","Data":"84c04d6a80e88823d89c2e584d2f68f8e896d53d99b9f78a6891fb6eb029ad29"}
Jul 22 04:08:43.588456 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:43.588137    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:43.608278 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:43.608224    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4" podStartSLOduration=2.257141463 podStartE2EDuration="2.608203617s" totalImagesPullingTime="351.062154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:08:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:08:43.6065005 +0000 UTC m=+2100.773735163" watchObservedRunningTime="2026-07-22 04:08:43.608203617 +0000 UTC m=+2100.775438282"
Jul 22 04:08:46.004939 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:46.004902    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:49.597590 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:49.597555    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:08:51.203608 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:51.203524    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:56.116287 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:56.116249    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:08:56.215045 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:08:56.215014    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:09:04.440100 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:09:04.440063    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:09:04.540986 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:09:04.540955    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:09:31.306220 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:09:31.306178    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:11.086353 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:11.086321    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:12.088464 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:12.088426    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:12.753183 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:12.753148    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:12.853520 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:12.853482    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:22.643328 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:22.643291    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"]
Jul 22 04:10:22.643814 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:22.643549    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn" podUID="96f77404-fa8a-41d3-9bf2-9b1754b8df23" containerName="maas-api" containerID="cri-o://c99e2ab0e31055b9785141942ebe57b32f8d7bbd645ce474d975c326ff35e871" gracePeriod=30
Jul 22 04:10:22.671099 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:22.671066    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:23.078358 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:23.078330    2569 generic.go:356] "Generic (PLEG): container finished" podID="96f77404-fa8a-41d3-9bf2-9b1754b8df23" containerID="c99e2ab0e31055b9785141942ebe57b32f8d7bbd645ce474d975c326ff35e871" exitCode=0
Jul 22 04:10:23.078494 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:23.078401    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn" event={"ID":"96f77404-fa8a-41d3-9bf2-9b1754b8df23","Type":"ContainerDied","Data":"c99e2ab0e31055b9785141942ebe57b32f8d7bbd645ce474d975c326ff35e871"}
Jul 22 04:10:23.097126 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:23.097102    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:10:23.164867 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:23.164822    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96f77404-fa8a-41d3-9bf2-9b1754b8df23-maas-api-tls\") pod \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") "
Jul 22 04:10:23.165048 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:23.164946    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f77404-fa8a-41d3-9bf2-9b1754b8df23-openshift-service-ca\") pod \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") "
Jul 22 04:10:23.165048 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:23.164994    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ql4z\" (UniqueName: \"kubernetes.io/projected/96f77404-fa8a-41d3-9bf2-9b1754b8df23-kube-api-access-2ql4z\") pod \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\" (UID: \"96f77404-fa8a-41d3-9bf2-9b1754b8df23\") "
Jul 22 04:10:23.165296 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:23.165272    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96f77404-fa8a-41d3-9bf2-9b1754b8df23-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "96f77404-fa8a-41d3-9bf2-9b1754b8df23" (UID: "96f77404-fa8a-41d3-9bf2-9b1754b8df23"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:10:23.167048 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:23.167024    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96f77404-fa8a-41d3-9bf2-9b1754b8df23-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "96f77404-fa8a-41d3-9bf2-9b1754b8df23" (UID: "96f77404-fa8a-41d3-9bf2-9b1754b8df23"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:10:23.167171 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:23.167147    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96f77404-fa8a-41d3-9bf2-9b1754b8df23-kube-api-access-2ql4z" (OuterVolumeSpecName: "kube-api-access-2ql4z") pod "96f77404-fa8a-41d3-9bf2-9b1754b8df23" (UID: "96f77404-fa8a-41d3-9bf2-9b1754b8df23"). InnerVolumeSpecName "kube-api-access-2ql4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:10:23.266285 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:23.266252    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ql4z\" (UniqueName: \"kubernetes.io/projected/96f77404-fa8a-41d3-9bf2-9b1754b8df23-kube-api-access-2ql4z\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:10:23.266285 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:23.266282    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96f77404-fa8a-41d3-9bf2-9b1754b8df23-maas-api-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:10:23.266285 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:23.266292    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96f77404-fa8a-41d3-9bf2-9b1754b8df23-openshift-service-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:10:24.084835 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:24.084806    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"
Jul 22 04:10:24.085309 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:24.084806    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn" event={"ID":"96f77404-fa8a-41d3-9bf2-9b1754b8df23","Type":"ContainerDied","Data":"8e3d67fa01e10a2df0d9ac288d8f29b9b56cc71d40cbd3abaa8dc765dfc8fe66"}
Jul 22 04:10:24.085309 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:24.084952    2569 scope.go:117] "RemoveContainer" containerID="c99e2ab0e31055b9785141942ebe57b32f8d7bbd645ce474d975c326ff35e871"
Jul 22 04:10:24.102402 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:24.102376    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"]
Jul 22 04:10:24.106659 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:24.106617    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-41e8d3-dd8979b56-bmhsn"]
Jul 22 04:10:25.378159 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:25.378132    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96f77404-fa8a-41d3-9bf2-9b1754b8df23" path="/var/lib/kubelet/pods/96f77404-fa8a-41d3-9bf2-9b1754b8df23/volumes"
Jul 22 04:10:27.277202 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:27.277169    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:27.714605 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:27.714570    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:33.843883 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:33.843847    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:33.945631 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:33.945599    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:34.136976 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:34.136897    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:34.377095 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:34.377068    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:35.208276 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:35.208248    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:35.306882 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:35.306827    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:44.938976 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:44.938934    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"]
Jul 22 04:10:44.939447 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:44.939208    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4" podUID="e691e6a6-480d-4eb5-b599-00c26e76274d" containerName="maas-api" containerID="cri-o://84c04d6a80e88823d89c2e584d2f68f8e896d53d99b9f78a6891fb6eb029ad29" gracePeriod=30
Jul 22 04:10:44.965391 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:44.965368    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:45.187725 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.187699    2569 generic.go:356] "Generic (PLEG): container finished" podID="e691e6a6-480d-4eb5-b599-00c26e76274d" containerID="84c04d6a80e88823d89c2e584d2f68f8e896d53d99b9f78a6891fb6eb029ad29" exitCode=0
Jul 22 04:10:45.187842 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.187781    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4" event={"ID":"e691e6a6-480d-4eb5-b599-00c26e76274d","Type":"ContainerDied","Data":"84c04d6a80e88823d89c2e584d2f68f8e896d53d99b9f78a6891fb6eb029ad29"}
Jul 22 04:10:45.187886 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.187849    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4" event={"ID":"e691e6a6-480d-4eb5-b599-00c26e76274d","Type":"ContainerDied","Data":"6b9fc82e64d1777f3d4c7f33b2d04e38aaba29cd973c40e6dd5979c3c9b58b7f"}
Jul 22 04:10:45.187886 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.187874    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b9fc82e64d1777f3d4c7f33b2d04e38aaba29cd973c40e6dd5979c3c9b58b7f"
Jul 22 04:10:45.197501 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.197450    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:10:45.362362 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.362329    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45ggn\" (UniqueName: \"kubernetes.io/projected/e691e6a6-480d-4eb5-b599-00c26e76274d-kube-api-access-45ggn\") pod \"e691e6a6-480d-4eb5-b599-00c26e76274d\" (UID: \"e691e6a6-480d-4eb5-b599-00c26e76274d\") "
Jul 22 04:10:45.362362 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.362377    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e691e6a6-480d-4eb5-b599-00c26e76274d-maas-api-tls\") pod \"e691e6a6-480d-4eb5-b599-00c26e76274d\" (UID: \"e691e6a6-480d-4eb5-b599-00c26e76274d\") "
Jul 22 04:10:45.362627 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.362413    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e691e6a6-480d-4eb5-b599-00c26e76274d-openshift-service-ca\") pod \"e691e6a6-480d-4eb5-b599-00c26e76274d\" (UID: \"e691e6a6-480d-4eb5-b599-00c26e76274d\") "
Jul 22 04:10:45.362856 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.362819    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e691e6a6-480d-4eb5-b599-00c26e76274d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e691e6a6-480d-4eb5-b599-00c26e76274d" (UID: "e691e6a6-480d-4eb5-b599-00c26e76274d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:10:45.364711 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.364687    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e691e6a6-480d-4eb5-b599-00c26e76274d-kube-api-access-45ggn" (OuterVolumeSpecName: "kube-api-access-45ggn") pod "e691e6a6-480d-4eb5-b599-00c26e76274d" (UID: "e691e6a6-480d-4eb5-b599-00c26e76274d"). InnerVolumeSpecName "kube-api-access-45ggn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:10:45.364806 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.364744    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e691e6a6-480d-4eb5-b599-00c26e76274d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e691e6a6-480d-4eb5-b599-00c26e76274d" (UID: "e691e6a6-480d-4eb5-b599-00c26e76274d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:10:45.463332 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.463304    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45ggn\" (UniqueName: \"kubernetes.io/projected/e691e6a6-480d-4eb5-b599-00c26e76274d-kube-api-access-45ggn\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:10:45.463332 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.463333    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e691e6a6-480d-4eb5-b599-00c26e76274d-maas-api-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:10:45.463519 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:45.463342    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e691e6a6-480d-4eb5-b599-00c26e76274d-openshift-service-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:10:46.193437 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:46.193405    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"
Jul 22 04:10:46.210486 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:46.210455    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"]
Jul 22 04:10:46.214785 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:46.214764    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-b9a16f-7c7dcb9499-xwhs4"]
Jul 22 04:10:47.378354 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:47.378320    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e691e6a6-480d-4eb5-b599-00c26e76274d" path="/var/lib/kubelet/pods/e691e6a6-480d-4eb5-b599-00c26e76274d/volumes"
Jul 22 04:10:49.585474 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:49.585441    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:49.963483 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:49.963447    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:55.754760 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:55.754721    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:55.829175 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:55.829144    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:56.031817 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:56.031731    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:56.267911 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:56.267885    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:56.625742 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:56.625712    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:56.942069 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:56.941984    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:10:57.177535 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:10:57.177489    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:00.220668 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.220621    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:00.304244 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.304210    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:00.305919 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.305890    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"]
Jul 22 04:11:00.306602 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.306578    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e691e6a6-480d-4eb5-b599-00c26e76274d" containerName="maas-api"
Jul 22 04:11:00.306602 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.306605    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e691e6a6-480d-4eb5-b599-00c26e76274d" containerName="maas-api"
Jul 22 04:11:00.306804 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.306633    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96f77404-fa8a-41d3-9bf2-9b1754b8df23" containerName="maas-api"
Jul 22 04:11:00.306804 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.306660    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="96f77404-fa8a-41d3-9bf2-9b1754b8df23" containerName="maas-api"
Jul 22 04:11:00.306804 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.306756    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e691e6a6-480d-4eb5-b599-00c26e76274d" containerName="maas-api"
Jul 22 04:11:00.306804 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.306771    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="96f77404-fa8a-41d3-9bf2-9b1754b8df23" containerName="maas-api"
Jul 22 04:11:00.310215 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.310193    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:00.312501 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.312480    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b721b6-serving-cert\""
Jul 22 04:11:00.319946 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.319925    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"]
Jul 22 04:11:00.374405 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.374371    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:00.388075 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.388046    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a45918e2-874b-4894-8714-a302af72494b-openshift-service-ca\") pod \"maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8\" (UID: \"a45918e2-874b-4894-8714-a302af72494b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:00.388195 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.388145    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcqdm\" (UniqueName: \"kubernetes.io/projected/a45918e2-874b-4894-8714-a302af72494b-kube-api-access-rcqdm\") pod \"maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8\" (UID: \"a45918e2-874b-4894-8714-a302af72494b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:00.388269 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.388251    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a45918e2-874b-4894-8714-a302af72494b-maas-api-tls\") pod \"maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8\" (UID: \"a45918e2-874b-4894-8714-a302af72494b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:00.476088 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.476004    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:00.489193 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.489170    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcqdm\" (UniqueName: \"kubernetes.io/projected/a45918e2-874b-4894-8714-a302af72494b-kube-api-access-rcqdm\") pod \"maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8\" (UID: \"a45918e2-874b-4894-8714-a302af72494b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:00.489281 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.489221    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a45918e2-874b-4894-8714-a302af72494b-maas-api-tls\") pod \"maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8\" (UID: \"a45918e2-874b-4894-8714-a302af72494b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:00.489281 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.489256    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a45918e2-874b-4894-8714-a302af72494b-openshift-service-ca\") pod \"maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8\" (UID: \"a45918e2-874b-4894-8714-a302af72494b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:00.489920 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.489857    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a45918e2-874b-4894-8714-a302af72494b-openshift-service-ca\") pod \"maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8\" (UID: \"a45918e2-874b-4894-8714-a302af72494b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:00.491952 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.491930    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a45918e2-874b-4894-8714-a302af72494b-maas-api-tls\") pod \"maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8\" (UID: \"a45918e2-874b-4894-8714-a302af72494b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:00.499561 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.499539    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcqdm\" (UniqueName: \"kubernetes.io/projected/a45918e2-874b-4894-8714-a302af72494b-kube-api-access-rcqdm\") pod \"maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8\" (UID: \"a45918e2-874b-4894-8714-a302af72494b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:00.622631 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.622596    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:00.763392 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.763364    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"]
Jul 22 04:11:00.765854 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:11:00.765826    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45918e2_874b_4894_8714_a302af72494b.slice/crio-f5dffa6315a4b6864d3960388649ad187ee4922c8ff56049faead11384537a08 WatchSource:0}: Error finding container f5dffa6315a4b6864d3960388649ad187ee4922c8ff56049faead11384537a08: Status 404 returned error can't find the container with id f5dffa6315a4b6864d3960388649ad187ee4922c8ff56049faead11384537a08
Jul 22 04:11:00.767706 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.767686    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:11:00.903025 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:00.902956    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:01.007257 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:01.007224    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:01.266523 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:01.266495    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8" event={"ID":"a45918e2-874b-4894-8714-a302af72494b","Type":"ContainerStarted","Data":"f5dffa6315a4b6864d3960388649ad187ee4922c8ff56049faead11384537a08"}
Jul 22 04:11:02.274565 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:02.274531    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8" event={"ID":"a45918e2-874b-4894-8714-a302af72494b","Type":"ContainerStarted","Data":"e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9"}
Jul 22 04:11:02.274980 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:02.274671    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:02.299512 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:02.299438    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8" podStartSLOduration=1.8063925429999999 podStartE2EDuration="2.29942321s" totalImagesPullingTime="493.030667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:11:02.297409755 +0000 UTC m=+2239.464644419" watchObservedRunningTime="2026-07-22 04:11:02.29942321 +0000 UTC m=+2239.466657874"
Jul 22 04:11:04.717147 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:04.717039    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:05.187804 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:05.187719    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:05.496895 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:05.496866    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:05.841516 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:05.841441    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:08.285855 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.285820    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:08.290991 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.290963    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:08.352272 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.352240    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"]
Jul 22 04:11:08.356140 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.356119    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:08.359209 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.359188    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-656735-serving-cert\""
Jul 22 04:11:08.366997 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.366970    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"]
Jul 22 04:11:08.386629 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.386604    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:08.460079 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.460045    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec1aa7c7-33de-4112-9057-83d63c66d4bf-openshift-service-ca\") pod \"maas-api-e2e-api-b-656735-fdff76b55-r8bjn\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:08.460252 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.460081    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwn6s\" (UniqueName: \"kubernetes.io/projected/ec1aa7c7-33de-4112-9057-83d63c66d4bf-kube-api-access-kwn6s\") pod \"maas-api-e2e-api-b-656735-fdff76b55-r8bjn\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:08.460252 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.460204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec1aa7c7-33de-4112-9057-83d63c66d4bf-maas-api-tls\") pod \"maas-api-e2e-api-b-656735-fdff76b55-r8bjn\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:08.460428 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.460412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:08.560750 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.560669    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec1aa7c7-33de-4112-9057-83d63c66d4bf-maas-api-tls\") pod \"maas-api-e2e-api-b-656735-fdff76b55-r8bjn\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:08.560913 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.560767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec1aa7c7-33de-4112-9057-83d63c66d4bf-openshift-service-ca\") pod \"maas-api-e2e-api-b-656735-fdff76b55-r8bjn\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:08.560913 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.560785    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwn6s\" (UniqueName: \"kubernetes.io/projected/ec1aa7c7-33de-4112-9057-83d63c66d4bf-kube-api-access-kwn6s\") pod \"maas-api-e2e-api-b-656735-fdff76b55-r8bjn\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:08.560913 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:11:08.560825    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-656735-serving-cert: secret "maas-api-e2e-api-b-656735-serving-cert" not found
Jul 22 04:11:08.561087 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:11:08.560918    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec1aa7c7-33de-4112-9057-83d63c66d4bf-maas-api-tls podName:ec1aa7c7-33de-4112-9057-83d63c66d4bf nodeName:}" failed. No retries permitted until 2026-07-22 04:11:09.060894981 +0000 UTC m=+2246.228129643 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ec1aa7c7-33de-4112-9057-83d63c66d4bf-maas-api-tls") pod "maas-api-e2e-api-b-656735-fdff76b55-r8bjn" (UID: "ec1aa7c7-33de-4112-9057-83d63c66d4bf") : secret "maas-api-e2e-api-b-656735-serving-cert" not found
Jul 22 04:11:08.561373 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.561356    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec1aa7c7-33de-4112-9057-83d63c66d4bf-openshift-service-ca\") pod \"maas-api-e2e-api-b-656735-fdff76b55-r8bjn\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:08.571178 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.571155    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwn6s\" (UniqueName: \"kubernetes.io/projected/ec1aa7c7-33de-4112-9057-83d63c66d4bf-kube-api-access-kwn6s\") pod \"maas-api-e2e-api-b-656735-fdff76b55-r8bjn\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:08.700680 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.700627    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:08.981807 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:08.981771    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:09.065406 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:09.065368    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec1aa7c7-33de-4112-9057-83d63c66d4bf-maas-api-tls\") pod \"maas-api-e2e-api-b-656735-fdff76b55-r8bjn\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:09.067910 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:09.067888    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec1aa7c7-33de-4112-9057-83d63c66d4bf-maas-api-tls\") pod \"maas-api-e2e-api-b-656735-fdff76b55-r8bjn\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:09.078844 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:09.078815    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:09.271839 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:09.271757    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:09.414362 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:09.414337    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"]
Jul 22 04:11:09.417162 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:11:09.417135    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1aa7c7_33de_4112_9057_83d63c66d4bf.slice/crio-dfbbb33868a8e476a1ab1ac50e600fc60aacf95241fb20aeb5f596a1fe450388 WatchSource:0}: Error finding container dfbbb33868a8e476a1ab1ac50e600fc60aacf95241fb20aeb5f596a1fe450388: Status 404 returned error can't find the container with id dfbbb33868a8e476a1ab1ac50e600fc60aacf95241fb20aeb5f596a1fe450388
Jul 22 04:11:10.326273 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:10.326237    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn" event={"ID":"ec1aa7c7-33de-4112-9057-83d63c66d4bf","Type":"ContainerStarted","Data":"2d38319e5f874c1d6298dd6f7aa6f1a1eb38a09ef74e12c1c4dbe9f1ccfb2308"}
Jul 22 04:11:10.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:10.326292    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn" event={"ID":"ec1aa7c7-33de-4112-9057-83d63c66d4bf","Type":"ContainerStarted","Data":"dfbbb33868a8e476a1ab1ac50e600fc60aacf95241fb20aeb5f596a1fe450388"}
Jul 22 04:11:10.326448 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:10.326324    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:10.350202 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:10.350158    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn" podStartSLOduration=2.044594864 podStartE2EDuration="2.350143988s" totalImagesPullingTime="305.549124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:11:10.348035114 +0000 UTC m=+2247.515269778" watchObservedRunningTime="2026-07-22 04:11:10.350143988 +0000 UTC m=+2247.517378651"
Jul 22 04:11:12.789527 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:12.789491    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:16.336769 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:16.336728    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:11:21.616932 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:21.616898    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:21.712136 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:21.712100    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:29.776016 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:29.775985    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:29.877349 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:29.877318    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:31.722308 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:31.722267    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:31.823099 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:31.823056    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:36.977222 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:36.977188    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"]
Jul 22 04:11:36.977707 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:36.977459    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8" podUID="a45918e2-874b-4894-8714-a302af72494b" containerName="maas-api" containerID="cri-o://e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9" gracePeriod=30
Jul 22 04:11:37.003462 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.003436    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:37.227512 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.227456    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:37.317777 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.317738    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a45918e2-874b-4894-8714-a302af72494b-openshift-service-ca\") pod \"a45918e2-874b-4894-8714-a302af72494b\" (UID: \"a45918e2-874b-4894-8714-a302af72494b\") "
Jul 22 04:11:37.317777 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.317776    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a45918e2-874b-4894-8714-a302af72494b-maas-api-tls\") pod \"a45918e2-874b-4894-8714-a302af72494b\" (UID: \"a45918e2-874b-4894-8714-a302af72494b\") "
Jul 22 04:11:37.318022 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.317923    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcqdm\" (UniqueName: \"kubernetes.io/projected/a45918e2-874b-4894-8714-a302af72494b-kube-api-access-rcqdm\") pod \"a45918e2-874b-4894-8714-a302af72494b\" (UID: \"a45918e2-874b-4894-8714-a302af72494b\") "
Jul 22 04:11:37.318217 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.318176    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a45918e2-874b-4894-8714-a302af72494b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a45918e2-874b-4894-8714-a302af72494b" (UID: "a45918e2-874b-4894-8714-a302af72494b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:11:37.320126 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.320099    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a45918e2-874b-4894-8714-a302af72494b-kube-api-access-rcqdm" (OuterVolumeSpecName: "kube-api-access-rcqdm") pod "a45918e2-874b-4894-8714-a302af72494b" (UID: "a45918e2-874b-4894-8714-a302af72494b"). InnerVolumeSpecName "kube-api-access-rcqdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:11:37.320424 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.320398    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a45918e2-874b-4894-8714-a302af72494b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a45918e2-874b-4894-8714-a302af72494b" (UID: "a45918e2-874b-4894-8714-a302af72494b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:11:37.419107 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.419078    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a45918e2-874b-4894-8714-a302af72494b-openshift-service-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:11:37.419107 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.419103    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a45918e2-874b-4894-8714-a302af72494b-maas-api-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:11:37.419273 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.419115    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcqdm\" (UniqueName: \"kubernetes.io/projected/a45918e2-874b-4894-8714-a302af72494b-kube-api-access-rcqdm\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:11:37.457950 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.457924    2569 generic.go:356] "Generic (PLEG): container finished" podID="a45918e2-874b-4894-8714-a302af72494b" containerID="e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9" exitCode=0
Jul 22 04:11:37.458076 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.457968    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"
Jul 22 04:11:37.458076 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.458002    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8" event={"ID":"a45918e2-874b-4894-8714-a302af72494b","Type":"ContainerDied","Data":"e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9"}
Jul 22 04:11:37.458076 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.458052    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8" event={"ID":"a45918e2-874b-4894-8714-a302af72494b","Type":"ContainerDied","Data":"f5dffa6315a4b6864d3960388649ad187ee4922c8ff56049faead11384537a08"}
Jul 22 04:11:37.458076 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.458075    2569 scope.go:117] "RemoveContainer" containerID="e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9"
Jul 22 04:11:37.466974 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.466953    2569 scope.go:117] "RemoveContainer" containerID="e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9"
Jul 22 04:11:37.467205 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:11:37.467190    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9\": container with ID starting with e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9 not found: ID does not exist" containerID="e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9"
Jul 22 04:11:37.467256 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.467213    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9"} err="failed to get container status \"e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9\": rpc error: code = NotFound desc = could not find container \"e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9\": container with ID starting with e1fab968e5e4cc8d07192b73b71fb2723da22fd48700437ce0bb8779c140ccd9 not found: ID does not exist"
Jul 22 04:11:37.477840 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.477789    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"]
Jul 22 04:11:37.481371 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:37.481350    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b721b6-6b44b97988-fjmz8"]
Jul 22 04:11:39.378412 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:39.378378    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a45918e2-874b-4894-8714-a302af72494b" path="/var/lib/kubelet/pods/a45918e2-874b-4894-8714-a302af72494b/volumes"
Jul 22 04:11:41.063581 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:41.063536    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:41.443338 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:41.443256    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:47.349706 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:47.349672    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:47.449597 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:47.449564    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:47.621195 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:47.621116    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:47.843948 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:47.843919    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:48.527951 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:48.527917    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:11:48.628361 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:11:48.628324    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:03.431539 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.431499    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"]
Jul 22 04:12:03.432197 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.431779    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn" podUID="ec1aa7c7-33de-4112-9057-83d63c66d4bf" containerName="maas-api" containerID="cri-o://2d38319e5f874c1d6298dd6f7aa6f1a1eb38a09ef74e12c1c4dbe9f1ccfb2308" gracePeriod=30
Jul 22 04:12:03.459173 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.459146    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:03.596454 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.596420    2569 generic.go:356] "Generic (PLEG): container finished" podID="ec1aa7c7-33de-4112-9057-83d63c66d4bf" containerID="2d38319e5f874c1d6298dd6f7aa6f1a1eb38a09ef74e12c1c4dbe9f1ccfb2308" exitCode=0
Jul 22 04:12:03.596623 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.596483    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn" event={"ID":"ec1aa7c7-33de-4112-9057-83d63c66d4bf","Type":"ContainerDied","Data":"2d38319e5f874c1d6298dd6f7aa6f1a1eb38a09ef74e12c1c4dbe9f1ccfb2308"}
Jul 22 04:12:03.708045 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.708016    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:12:03.733600 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.733568    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec1aa7c7-33de-4112-9057-83d63c66d4bf-maas-api-tls\") pod \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") "
Jul 22 04:12:03.733807 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.733619    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwn6s\" (UniqueName: \"kubernetes.io/projected/ec1aa7c7-33de-4112-9057-83d63c66d4bf-kube-api-access-kwn6s\") pod \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") "
Jul 22 04:12:03.733807 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.733686    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec1aa7c7-33de-4112-9057-83d63c66d4bf-openshift-service-ca\") pod \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\" (UID: \"ec1aa7c7-33de-4112-9057-83d63c66d4bf\") "
Jul 22 04:12:03.734032 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.734010    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec1aa7c7-33de-4112-9057-83d63c66d4bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ec1aa7c7-33de-4112-9057-83d63c66d4bf" (UID: "ec1aa7c7-33de-4112-9057-83d63c66d4bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:12:03.735791 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.735762    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec1aa7c7-33de-4112-9057-83d63c66d4bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ec1aa7c7-33de-4112-9057-83d63c66d4bf" (UID: "ec1aa7c7-33de-4112-9057-83d63c66d4bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:12:03.735917 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.735808    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec1aa7c7-33de-4112-9057-83d63c66d4bf-kube-api-access-kwn6s" (OuterVolumeSpecName: "kube-api-access-kwn6s") pod "ec1aa7c7-33de-4112-9057-83d63c66d4bf" (UID: "ec1aa7c7-33de-4112-9057-83d63c66d4bf"). InnerVolumeSpecName "kube-api-access-kwn6s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:12:03.834773 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.834743    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwn6s\" (UniqueName: \"kubernetes.io/projected/ec1aa7c7-33de-4112-9057-83d63c66d4bf-kube-api-access-kwn6s\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:12:03.834773 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.834768    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ec1aa7c7-33de-4112-9057-83d63c66d4bf-openshift-service-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:12:03.834773 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:03.834777    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ec1aa7c7-33de-4112-9057-83d63c66d4bf-maas-api-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:12:04.602600 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:04.602565    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn" event={"ID":"ec1aa7c7-33de-4112-9057-83d63c66d4bf","Type":"ContainerDied","Data":"dfbbb33868a8e476a1ab1ac50e600fc60aacf95241fb20aeb5f596a1fe450388"}
Jul 22 04:12:04.603097 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:04.602624    2569 scope.go:117] "RemoveContainer" containerID="2d38319e5f874c1d6298dd6f7aa6f1a1eb38a09ef74e12c1c4dbe9f1ccfb2308"
Jul 22 04:12:04.603097 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:04.602574    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"
Jul 22 04:12:04.626844 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:04.626809    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"]
Jul 22 04:12:04.632364 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:04.632337    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-656735-fdff76b55-r8bjn"]
Jul 22 04:12:05.378560 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:05.378525    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec1aa7c7-33de-4112-9057-83d63c66d4bf" path="/var/lib/kubelet/pods/ec1aa7c7-33de-4112-9057-83d63c66d4bf/volumes"
Jul 22 04:12:08.047915 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:08.047882    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:08.502385 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:08.502354    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:14.245605 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:14.245575    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:14.346364 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:14.346336    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:14.528754 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:14.528668    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:14.773375 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:14.773341    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:15.130414 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:15.130378    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:15.443911 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:15.443818    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:15.777306 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:15.777268    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:18.687287 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.687249    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:18.792060 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.792012    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:18.833400 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.833368    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"]
Jul 22 04:12:18.833824 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.833810    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a45918e2-874b-4894-8714-a302af72494b" containerName="maas-api"
Jul 22 04:12:18.833878 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.833826    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a45918e2-874b-4894-8714-a302af72494b" containerName="maas-api"
Jul 22 04:12:18.833878 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.833845    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec1aa7c7-33de-4112-9057-83d63c66d4bf" containerName="maas-api"
Jul 22 04:12:18.833878 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.833851    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec1aa7c7-33de-4112-9057-83d63c66d4bf" containerName="maas-api"
Jul 22 04:12:18.833976 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.833904    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a45918e2-874b-4894-8714-a302af72494b" containerName="maas-api"
Jul 22 04:12:18.833976 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.833913    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec1aa7c7-33de-4112-9057-83d63c66d4bf" containerName="maas-api"
Jul 22 04:12:18.836830 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.836815    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:18.839353 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.839334    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-dd1671-serving-cert\""
Jul 22 04:12:18.846996 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.846977    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"]
Jul 22 04:12:18.885767 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.885732    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:18.973293 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.973262    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngnph\" (UniqueName: \"kubernetes.io/projected/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-kube-api-access-ngnph\") pod \"maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt\" (UID: \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:18.973445 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.973307    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-maas-api-tls\") pod \"maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt\" (UID: \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:18.973445 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:18.973334    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt\" (UID: \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:19.074730 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:19.074692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngnph\" (UniqueName: \"kubernetes.io/projected/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-kube-api-access-ngnph\") pod \"maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt\" (UID: \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:19.074913 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:19.074758    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-maas-api-tls\") pod \"maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt\" (UID: \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:19.074913 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:19.074806    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt\" (UID: \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:19.075462 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:19.075441    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-openshift-service-ca\") pod \"maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt\" (UID: \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:19.077306 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:19.077282    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-maas-api-tls\") pod \"maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt\" (UID: \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:19.083339 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:19.083313    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngnph\" (UniqueName: \"kubernetes.io/projected/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-kube-api-access-ngnph\") pod \"maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt\" (UID: \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:19.085170 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:19.085151    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:19.147990 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:19.147955    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:19.306771 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:19.306747    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"]
Jul 22 04:12:19.309265 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:12:19.309236    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabb471be_2b80_4a6a_97ab_1f7de76cc6f6.slice/crio-c2c61be588ed7dd45be6f12ded6885452dadfb1f9cd647251327b8ec9bcbbdd2 WatchSource:0}: Error finding container c2c61be588ed7dd45be6f12ded6885452dadfb1f9cd647251327b8ec9bcbbdd2: Status 404 returned error can't find the container with id c2c61be588ed7dd45be6f12ded6885452dadfb1f9cd647251327b8ec9bcbbdd2
Jul 22 04:12:19.509822 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:19.509719    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:19.591310 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:19.591260    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:19.685462 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:19.685428    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt" event={"ID":"abb471be-2b80-4a6a-97ab-1f7de76cc6f6","Type":"ContainerStarted","Data":"c2c61be588ed7dd45be6f12ded6885452dadfb1f9cd647251327b8ec9bcbbdd2"}
Jul 22 04:12:20.692004 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:20.691972    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt" event={"ID":"abb471be-2b80-4a6a-97ab-1f7de76cc6f6","Type":"ContainerStarted","Data":"b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822"}
Jul 22 04:12:20.692371 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:20.692042    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:20.713592 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:20.713547    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt" podStartSLOduration=2.247282275 podStartE2EDuration="2.713532646s" totalImagesPullingTime="466.250371ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:12:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:12:20.712274996 +0000 UTC m=+2317.879509662" watchObservedRunningTime="2026-07-22 04:12:20.713532646 +0000 UTC m=+2317.880767310"
Jul 22 04:12:23.235382 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:23.235352    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:23.538670 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:23.538562    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:23.841499 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:23.841418    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:24.024307 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:24.024274    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:26.700602 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:26.700562    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:26.704540 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:26.704511    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:12:26.800044 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:26.800013    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:26.952383 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:26.952304    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"]
Jul 22 04:12:26.956041 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:26.956017    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:26.958483 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:26.958461    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-38610b-serving-cert\""
Jul 22 04:12:26.971555 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:26.971527    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"]
Jul 22 04:12:26.993313 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:26.993287    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:27.044877 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:27.044854    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q7hv\" (UniqueName: \"kubernetes.io/projected/45f61517-e76f-446d-9f56-a1a1406e8322-kube-api-access-6q7hv\") pod \"maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:27.045019 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:27.044940    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f61517-e76f-446d-9f56-a1a1406e8322-openshift-service-ca\") pod \"maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:27.045068 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:27.045038    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45f61517-e76f-446d-9f56-a1a1406e8322-maas-api-tls\") pod \"maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:27.146322 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:27.146288    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q7hv\" (UniqueName: \"kubernetes.io/projected/45f61517-e76f-446d-9f56-a1a1406e8322-kube-api-access-6q7hv\") pod \"maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:27.146473 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:27.146352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f61517-e76f-446d-9f56-a1a1406e8322-openshift-service-ca\") pod \"maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:27.146473 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:27.146403    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45f61517-e76f-446d-9f56-a1a1406e8322-maas-api-tls\") pod \"maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:27.146573 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:12:27.146510    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-serving-cert: secret "maas-api-e2e-shared-b-38610b-serving-cert" not found
Jul 22 04:12:27.146611 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:12:27.146576    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f61517-e76f-446d-9f56-a1a1406e8322-maas-api-tls podName:45f61517-e76f-446d-9f56-a1a1406e8322 nodeName:}" failed. No retries permitted until 2026-07-22 04:12:27.646556236 +0000 UTC m=+2324.813790880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/45f61517-e76f-446d-9f56-a1a1406e8322-maas-api-tls") pod "maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v" (UID: "45f61517-e76f-446d-9f56-a1a1406e8322") : secret "maas-api-e2e-shared-b-38610b-serving-cert" not found
Jul 22 04:12:27.147160 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:27.147141    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f61517-e76f-446d-9f56-a1a1406e8322-openshift-service-ca\") pod \"maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:27.158916 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:27.158887    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q7hv\" (UniqueName: \"kubernetes.io/projected/45f61517-e76f-446d-9f56-a1a1406e8322-kube-api-access-6q7hv\") pod \"maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:27.603893 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:27.603858    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:27.650719 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:27.650687    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45f61517-e76f-446d-9f56-a1a1406e8322-maas-api-tls\") pod \"maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:27.650874 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:12:27.650806    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-serving-cert: secret "maas-api-e2e-shared-b-38610b-serving-cert" not found
Jul 22 04:12:27.650874 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:12:27.650856    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45f61517-e76f-446d-9f56-a1a1406e8322-maas-api-tls podName:45f61517-e76f-446d-9f56-a1a1406e8322 nodeName:}" failed. No retries permitted until 2026-07-22 04:12:28.650843129 +0000 UTC m=+2325.818077771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/45f61517-e76f-446d-9f56-a1a1406e8322-maas-api-tls") pod "maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v" (UID: "45f61517-e76f-446d-9f56-a1a1406e8322") : secret "maas-api-e2e-shared-b-38610b-serving-cert" not found
Jul 22 04:12:27.702896 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:27.702854    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:27.802713 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:27.802675    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:28.659612 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:28.659575    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45f61517-e76f-446d-9f56-a1a1406e8322-maas-api-tls\") pod \"maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:28.662039 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:28.662010    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45f61517-e76f-446d-9f56-a1a1406e8322-maas-api-tls\") pod \"maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:28.770415 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:28.770383    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:28.906665 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:28.906613    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"]
Jul 22 04:12:28.909030 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:12:28.908998    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f61517_e76f_446d_9f56_a1a1406e8322.slice/crio-8992897e959c477dda215526bb129804d56a9cfe399342b328d61adcf1253fca WatchSource:0}: Error finding container 8992897e959c477dda215526bb129804d56a9cfe399342b328d61adcf1253fca: Status 404 returned error can't find the container with id 8992897e959c477dda215526bb129804d56a9cfe399342b328d61adcf1253fca
Jul 22 04:12:29.748296 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:29.748266    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v" event={"ID":"45f61517-e76f-446d-9f56-a1a1406e8322","Type":"ContainerStarted","Data":"0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85"}
Jul 22 04:12:29.748478 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:29.748314    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v" event={"ID":"45f61517-e76f-446d-9f56-a1a1406e8322","Type":"ContainerStarted","Data":"8992897e959c477dda215526bb129804d56a9cfe399342b328d61adcf1253fca"}
Jul 22 04:12:29.748478 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:29.748351    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:29.769056 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:29.769007    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v" podStartSLOduration=3.370490989 podStartE2EDuration="3.768994407s" totalImagesPullingTime="398.503418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:12:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:12:29.767781753 +0000 UTC m=+2326.935016418" watchObservedRunningTime="2026-07-22 04:12:29.768994407 +0000 UTC m=+2326.936229071"
Jul 22 04:12:29.790527 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:29.790501    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:29.891758 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:29.891727    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:31.169786 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:31.169737    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:35.759105 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:35.759016    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:12:40.444446 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:40.444411    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:40.545178 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:40.545142    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:41.668946 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:41.668914    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:48.560774 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:48.560732    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:12:48.661037 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:12:48.661008    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:13:10.491071 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:13:10.491028    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:13:21.667178 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:13:21.667138    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:13:29.607124 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:13:29.607086    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:13:29.708789 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:13:29.708752    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:14:04.957626 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:14:04.957547    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:14:43.704003 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:14:43.703962    2569 scope.go:117] "RemoveContainer" containerID="84c04d6a80e88823d89c2e584d2f68f8e896d53d99b9f78a6891fb6eb029ad29"
Jul 22 04:14:45.306502 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:14:45.306461    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:15:18.937755 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:15:18.937721    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:15:20.071163 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:15:20.071134    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:15:20.284551 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:15:20.284519    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:15:20.385038 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:15:20.384965    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:15:39.604233 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:15:39.604157    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:15:53.330744 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:15:53.330713    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:15:53.390489 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:15:53.390465    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:16:00.990743 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:00.990706    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:16:39.846197 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:39.846163    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:16:40.661500 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:40.661464    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:16:52.168051 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.167992    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"]
Jul 22 04:16:52.171318 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.171301    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.174094 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.174073    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dd1671\"/\"kube-root-ca.crt\""
Jul 22 04:16:52.174959 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.174854    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dd1671\"/\"rate-test-model-dd1671-kserve-self-signed-certs\""
Jul 22 04:16:52.174959 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.174916    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-dd1671\"/\"openshift-service-ca.crt\""
Jul 22 04:16:52.174959 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.174862    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-dd1671\"/\"default-dockercfg-2jjf2\""
Jul 22 04:16:52.180832 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.180808    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"]
Jul 22 04:16:52.200766 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.200736    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:16:52.321933 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.321904    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-home\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.322092 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.321956    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-tmp-dir\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.322092 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.321979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-model-cache\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.322092 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.322038    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-dshm\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.322092 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.322053    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftc4q\" (UniqueName: \"kubernetes.io/projected/f5f0fec4-3769-4474-aa92-d052fb6a0786-kube-api-access-ftc4q\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.322235 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.322125    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5f0fec4-3769-4474-aa92-d052fb6a0786-tls-certs\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.423081 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.423005    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-tmp-dir\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.423081 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.423046    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-model-cache\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.423309 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.423098    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-dshm\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.423309 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.423120    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftc4q\" (UniqueName: \"kubernetes.io/projected/f5f0fec4-3769-4474-aa92-d052fb6a0786-kube-api-access-ftc4q\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.423309 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.423151    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5f0fec4-3769-4474-aa92-d052fb6a0786-tls-certs\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.423309 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.423178    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-home\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.423534 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.423470    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-tmp-dir\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.423534 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.423481    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-model-cache\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.423622 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.423569    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-home\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.425403 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.425383    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-dshm\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.425766 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.425746    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5f0fec4-3769-4474-aa92-d052fb6a0786-tls-certs\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.431374 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.431351    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftc4q\" (UniqueName: \"kubernetes.io/projected/f5f0fec4-3769-4474-aa92-d052fb6a0786-kube-api-access-ftc4q\") pod \"rate-test-model-dd1671-kserve-8687bb4f79-2zgfv\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") " pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.481602 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.481572    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:16:52.623921 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:52.623899    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"]
Jul 22 04:16:52.625857 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:16:52.625831    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf5f0fec4_3769_4474_aa92_d052fb6a0786.slice/crio-ec990a4feeeda3f59e4bfa94517b8047040f9f894c8dc091a07213e410363800 WatchSource:0}: Error finding container ec990a4feeeda3f59e4bfa94517b8047040f9f894c8dc091a07213e410363800: Status 404 returned error can't find the container with id ec990a4feeeda3f59e4bfa94517b8047040f9f894c8dc091a07213e410363800
Jul 22 04:16:53.051553 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:53.051521    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv" event={"ID":"f5f0fec4-3769-4474-aa92-d052fb6a0786","Type":"ContainerStarted","Data":"505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8"}
Jul 22 04:16:53.051553 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:53.051559    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv" event={"ID":"f5f0fec4-3769-4474-aa92-d052fb6a0786","Type":"ContainerStarted","Data":"ec990a4feeeda3f59e4bfa94517b8047040f9f894c8dc091a07213e410363800"}
Jul 22 04:16:53.072332 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:16:53.072283    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv" podStartSLOduration=1.07226812 podStartE2EDuration="1.07226812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:16:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:16:53.070632481 +0000 UTC m=+2590.237867145" watchObservedRunningTime="2026-07-22 04:16:53.07226812 +0000 UTC m=+2590.239502784"
Jul 22 04:17:02.481927 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:17:02.481893    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:17:02.482329 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:17:02.481962    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:17:02.494162 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:17:02.494142    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:17:03.109853 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:17:03.109823    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:17:22.401376 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:17:22.401346    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:17:30.663830 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:17:30.663794    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:17:30.770775 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:17:30.770737    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:17:41.339739 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:17:41.339697    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:17:41.440691 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:17:41.440633    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:17:49.531534 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:17:49.531488    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:17:49.630634 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:17:49.630564    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:10.452194 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:10.452160    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"]
Jul 22 04:18:10.471049 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:10.471023    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:11.515250 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:11.515217    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:25.474618 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.474538    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv" podUID="f5f0fec4-3769-4474-aa92-d052fb6a0786" containerName="main" containerID="cri-o://505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8" gracePeriod=45
Jul 22 04:18:25.773257 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.773190    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:18:25.905898 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.905834    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-model-cache\") pod \"f5f0fec4-3769-4474-aa92-d052fb6a0786\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") "
Jul 22 04:18:25.906193 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.905933    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-tmp-dir\") pod \"f5f0fec4-3769-4474-aa92-d052fb6a0786\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") "
Jul 22 04:18:25.906193 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.905995    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-dshm\") pod \"f5f0fec4-3769-4474-aa92-d052fb6a0786\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") "
Jul 22 04:18:25.906193 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.906030    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-home\") pod \"f5f0fec4-3769-4474-aa92-d052fb6a0786\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") "
Jul 22 04:18:25.906193 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.906100    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5f0fec4-3769-4474-aa92-d052fb6a0786-tls-certs\") pod \"f5f0fec4-3769-4474-aa92-d052fb6a0786\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") "
Jul 22 04:18:25.906193 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.906192    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftc4q\" (UniqueName: \"kubernetes.io/projected/f5f0fec4-3769-4474-aa92-d052fb6a0786-kube-api-access-ftc4q\") pod \"f5f0fec4-3769-4474-aa92-d052fb6a0786\" (UID: \"f5f0fec4-3769-4474-aa92-d052fb6a0786\") "
Jul 22 04:18:25.906433 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.906242    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f5f0fec4-3769-4474-aa92-d052fb6a0786" (UID: "f5f0fec4-3769-4474-aa92-d052fb6a0786"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:18:25.906433 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.906280    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-home" (OuterVolumeSpecName: "home") pod "f5f0fec4-3769-4474-aa92-d052fb6a0786" (UID: "f5f0fec4-3769-4474-aa92-d052fb6a0786"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:18:25.906433 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.906302    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-model-cache" (OuterVolumeSpecName: "model-cache") pod "f5f0fec4-3769-4474-aa92-d052fb6a0786" (UID: "f5f0fec4-3769-4474-aa92-d052fb6a0786"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:18:25.906621 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.906598    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-home\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:18:25.906723 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.906629    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-model-cache\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:18:25.906723 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.906692    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-tmp-dir\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:18:25.909303 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.909240    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5f0fec4-3769-4474-aa92-d052fb6a0786-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f5f0fec4-3769-4474-aa92-d052fb6a0786" (UID: "f5f0fec4-3769-4474-aa92-d052fb6a0786"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:18:25.909519 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.909307    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-dshm" (OuterVolumeSpecName: "dshm") pod "f5f0fec4-3769-4474-aa92-d052fb6a0786" (UID: "f5f0fec4-3769-4474-aa92-d052fb6a0786"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:18:25.909519 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:25.909374    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5f0fec4-3769-4474-aa92-d052fb6a0786-kube-api-access-ftc4q" (OuterVolumeSpecName: "kube-api-access-ftc4q") pod "f5f0fec4-3769-4474-aa92-d052fb6a0786" (UID: "f5f0fec4-3769-4474-aa92-d052fb6a0786"). InnerVolumeSpecName "kube-api-access-ftc4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:18:26.007907 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:26.007707    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f5f0fec4-3769-4474-aa92-d052fb6a0786-dshm\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:18:26.007907 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:26.007768    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f5f0fec4-3769-4474-aa92-d052fb6a0786-tls-certs\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:18:26.007907 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:26.007782    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftc4q\" (UniqueName: \"kubernetes.io/projected/f5f0fec4-3769-4474-aa92-d052fb6a0786-kube-api-access-ftc4q\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:18:26.560390 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:26.560346    2569 generic.go:356] "Generic (PLEG): container finished" podID="f5f0fec4-3769-4474-aa92-d052fb6a0786" containerID="505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8" exitCode=0
Jul 22 04:18:26.560883 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:26.560398    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"
Jul 22 04:18:26.560883 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:26.560433    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv" event={"ID":"f5f0fec4-3769-4474-aa92-d052fb6a0786","Type":"ContainerDied","Data":"505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8"}
Jul 22 04:18:26.560883 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:26.560481    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv" event={"ID":"f5f0fec4-3769-4474-aa92-d052fb6a0786","Type":"ContainerDied","Data":"ec990a4feeeda3f59e4bfa94517b8047040f9f894c8dc091a07213e410363800"}
Jul 22 04:18:26.560883 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:26.560498    2569 scope.go:117] "RemoveContainer" containerID="505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8"
Jul 22 04:18:26.578331 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:26.578309    2569 scope.go:117] "RemoveContainer" containerID="505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8"
Jul 22 04:18:26.578678 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:18:26.578637    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8\": container with ID starting with 505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8 not found: ID does not exist" containerID="505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8"
Jul 22 04:18:26.578742 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:26.578688    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8"} err="failed to get container status \"505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8\": rpc error: code = NotFound desc = could not find container \"505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8\": container with ID starting with 505f30860fbfdf626815e883aea9787d0836ef5f47ea0b69ea1905618b92a8d8 not found: ID does not exist"
Jul 22 04:18:26.594137 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:26.594093    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"]
Jul 22 04:18:26.599201 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:26.599162    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-dd1671/rate-test-model-dd1671-kserve-8687bb4f79-2zgfv"]
Jul 22 04:18:27.378324 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:27.378296    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5f0fec4-3769-4474-aa92-d052fb6a0786" path="/var/lib/kubelet/pods/f5f0fec4-3769-4474-aa92-d052fb6a0786/volumes"
Jul 22 04:18:31.601453 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:31.601413    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:31.702581 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:31.702544    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:41.357670 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.357558    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"]
Jul 22 04:18:41.358129 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.357832    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt" podUID="abb471be-2b80-4a6a-97ab-1f7de76cc6f6" containerName="maas-api" containerID="cri-o://b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822" gracePeriod=30
Jul 22 04:18:41.380169 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.380100    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:41.613721 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.613620    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:18:41.634525 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.634394    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-maas-api-tls\") pod \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\" (UID: \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\") "
Jul 22 04:18:41.634525 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.634433    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-openshift-service-ca\") pod \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\" (UID: \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\") "
Jul 22 04:18:41.634525 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.634492    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngnph\" (UniqueName: \"kubernetes.io/projected/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-kube-api-access-ngnph\") pod \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\" (UID: \"abb471be-2b80-4a6a-97ab-1f7de76cc6f6\") "
Jul 22 04:18:41.635338 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.635307    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "abb471be-2b80-4a6a-97ab-1f7de76cc6f6" (UID: "abb471be-2b80-4a6a-97ab-1f7de76cc6f6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:18:41.637460 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.637410    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "abb471be-2b80-4a6a-97ab-1f7de76cc6f6" (UID: "abb471be-2b80-4a6a-97ab-1f7de76cc6f6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:18:41.638050 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.638000    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-kube-api-access-ngnph" (OuterVolumeSpecName: "kube-api-access-ngnph") pod "abb471be-2b80-4a6a-97ab-1f7de76cc6f6" (UID: "abb471be-2b80-4a6a-97ab-1f7de76cc6f6"). InnerVolumeSpecName "kube-api-access-ngnph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:18:41.639354 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.639323    2569 generic.go:356] "Generic (PLEG): container finished" podID="abb471be-2b80-4a6a-97ab-1f7de76cc6f6" containerID="b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822" exitCode=0
Jul 22 04:18:41.639468 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.639375    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"
Jul 22 04:18:41.639468 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.639403    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt" event={"ID":"abb471be-2b80-4a6a-97ab-1f7de76cc6f6","Type":"ContainerDied","Data":"b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822"}
Jul 22 04:18:41.639584 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.639473    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt" event={"ID":"abb471be-2b80-4a6a-97ab-1f7de76cc6f6","Type":"ContainerDied","Data":"c2c61be588ed7dd45be6f12ded6885452dadfb1f9cd647251327b8ec9bcbbdd2"}
Jul 22 04:18:41.639584 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.639504    2569 scope.go:117] "RemoveContainer" containerID="b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822"
Jul 22 04:18:41.660305 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.659539    2569 scope.go:117] "RemoveContainer" containerID="b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822"
Jul 22 04:18:41.660478 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:18:41.660343    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822\": container with ID starting with b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822 not found: ID does not exist" containerID="b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822"
Jul 22 04:18:41.660478 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.660383    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822"} err="failed to get container status \"b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822\": rpc error: code = NotFound desc = could not find container \"b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822\": container with ID starting with b067ce05565a2b835c674076e25ffe64c05ce6cb59bb1cdce9de752c5e3b9822 not found: ID does not exist"
Jul 22 04:18:41.670781 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.670741    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"]
Jul 22 04:18:41.676283 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.676254    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-dd1671-564bfdc448-szjxt"]
Jul 22 04:18:41.735337 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.735302    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-maas-api-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:18:41.735337 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.735340    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-openshift-service-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:18:41.735517 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:41.735353    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngnph\" (UniqueName: \"kubernetes.io/projected/abb471be-2b80-4a6a-97ab-1f7de76cc6f6-kube-api-access-ngnph\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:18:43.379147 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:43.379115    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abb471be-2b80-4a6a-97ab-1f7de76cc6f6" path="/var/lib/kubelet/pods/abb471be-2b80-4a6a-97ab-1f7de76cc6f6/volumes"
Jul 22 04:18:46.034260 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:46.034226    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:46.447390 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:46.447271    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:52.971504 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:52.971459    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:53.086361 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:53.086334    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:53.253748 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:53.253665    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:53.461445 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:53.461412    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:54.264371 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:54.264338    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:18:54.479899 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:18:54.479865    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:19:04.312586 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.312546    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"]
Jul 22 04:19:04.313093 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.312795    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v" podUID="45f61517-e76f-446d-9f56-a1a1406e8322" containerName="maas-api" containerID="cri-o://0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85" gracePeriod=30
Jul 22 04:19:04.361094 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.361070    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:19:04.555791 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.555771    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:19:04.635296 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.635228    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45f61517-e76f-446d-9f56-a1a1406e8322-maas-api-tls\") pod \"45f61517-e76f-446d-9f56-a1a1406e8322\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") "
Jul 22 04:19:04.635296 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.635267    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f61517-e76f-446d-9f56-a1a1406e8322-openshift-service-ca\") pod \"45f61517-e76f-446d-9f56-a1a1406e8322\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") "
Jul 22 04:19:04.635503 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.635407    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6q7hv\" (UniqueName: \"kubernetes.io/projected/45f61517-e76f-446d-9f56-a1a1406e8322-kube-api-access-6q7hv\") pod \"45f61517-e76f-446d-9f56-a1a1406e8322\" (UID: \"45f61517-e76f-446d-9f56-a1a1406e8322\") "
Jul 22 04:19:04.635620 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.635600    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45f61517-e76f-446d-9f56-a1a1406e8322-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "45f61517-e76f-446d-9f56-a1a1406e8322" (UID: "45f61517-e76f-446d-9f56-a1a1406e8322"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:19:04.635790 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.635773    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/45f61517-e76f-446d-9f56-a1a1406e8322-openshift-service-ca\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:19:04.637530 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.637505    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45f61517-e76f-446d-9f56-a1a1406e8322-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "45f61517-e76f-446d-9f56-a1a1406e8322" (UID: "45f61517-e76f-446d-9f56-a1a1406e8322"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:19:04.637628 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.637573    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45f61517-e76f-446d-9f56-a1a1406e8322-kube-api-access-6q7hv" (OuterVolumeSpecName: "kube-api-access-6q7hv") pod "45f61517-e76f-446d-9f56-a1a1406e8322" (UID: "45f61517-e76f-446d-9f56-a1a1406e8322"). InnerVolumeSpecName "kube-api-access-6q7hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:19:04.736483 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.736453    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q7hv\" (UniqueName: \"kubernetes.io/projected/45f61517-e76f-446d-9f56-a1a1406e8322-kube-api-access-6q7hv\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:19:04.736483 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.736478    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/45f61517-e76f-446d-9f56-a1a1406e8322-maas-api-tls\") on node \"ip-10-0-142-88.ec2.internal\" DevicePath \"\""
Jul 22 04:19:04.753553 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.753525    2569 generic.go:356] "Generic (PLEG): container finished" podID="45f61517-e76f-446d-9f56-a1a1406e8322" containerID="0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85" exitCode=0
Jul 22 04:19:04.753743 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.753563    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v" event={"ID":"45f61517-e76f-446d-9f56-a1a1406e8322","Type":"ContainerDied","Data":"0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85"}
Jul 22 04:19:04.753743 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.753588    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"
Jul 22 04:19:04.753743 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.753625    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v" event={"ID":"45f61517-e76f-446d-9f56-a1a1406e8322","Type":"ContainerDied","Data":"8992897e959c477dda215526bb129804d56a9cfe399342b328d61adcf1253fca"}
Jul 22 04:19:04.753743 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.753670    2569 scope.go:117] "RemoveContainer" containerID="0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85"
Jul 22 04:19:04.763043 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.763028    2569 scope.go:117] "RemoveContainer" containerID="0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85"
Jul 22 04:19:04.763301 ip-10-0-142-88 kubenswrapper[2569]: E0722 04:19:04.763279    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85\": container with ID starting with 0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85 not found: ID does not exist" containerID="0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85"
Jul 22 04:19:04.763371 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.763308    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85"} err="failed to get container status \"0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85\": rpc error: code = NotFound desc = could not find container \"0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85\": container with ID starting with 0c98f10d33fb290c73c5768c4d0e94fd03b7f14671aa08a88fc668309d736a85 not found: ID does not exist"
Jul 22 04:19:04.780573 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.780552    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"]
Jul 22 04:19:04.782366 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:04.782345    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-38610b-6dd466b6bd-6282v"]
Jul 22 04:19:05.378982 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:05.378949    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45f61517-e76f-446d-9f56-a1a1406e8322" path="/var/lib/kubelet/pods/45f61517-e76f-446d-9f56-a1a1406e8322/volumes"
Jul 22 04:19:08.732516 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:08.732465    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:19:09.887891 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:09.887832    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:19:11.886804 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:11.886765    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:19:11.987832 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:11.987809    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:19:15.110977 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:15.110943    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:19:15.211314 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:15.211289    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:19:15.383711 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:15.383596    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:19:15.621080 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:15.621044    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:19:16.053772 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:16.053746    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9588658-xfmt6_717a9764-22c0-4598-bb17-c196da15214b/authorino/0.log"
Jul 22 04:19:21.614585 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:21.614543    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-kbn64_c8bdc597-44a4-43d7-a5d2-b2fa7d81b687/manager/0.log"
Jul 22 04:19:21.725591 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:21.725557    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8cvnv_5671cfc0-5bf7-4654-876e-8335dac8f778/manager/0.log"
Jul 22 04:19:21.980365 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:21.980338    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rkj2h_c5086d01-4a12-4690-ba79-18d6d3573172/server/0.log"
Jul 22 04:19:22.099462 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:22.099415    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hgp9l_f9e07c01-5fbe-4d80-94a1-2771fb06b0fd/manager/0.log"
Jul 22 04:19:22.479800 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:22.479773    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fd47b996b-sfxjh_9a7a3c4a-26e5-46dc-b84c-1c00cba9b962/copy-manifests/0.log"
Jul 22 04:19:22.493073 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:22.493052    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fd47b996b-sfxjh_9a7a3c4a-26e5-46dc-b84c-1c00cba9b962/manager/0.log"
Jul 22 04:19:22.844041 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:22.843939    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5b77f8c7b9-jc9wv_f9d50ca4-2555-48c8-9fc5-daa4cb072ba6/maas-api/0.log"
Jul 22 04:19:23.291011 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:23.290986    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-t8r8v_ed0511b6-ff0c-4c38-8475-00a8e0c19bc2/postgres/0.log"
Jul 22 04:19:24.576128 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:24.576097    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9588658-xfmt6_717a9764-22c0-4598-bb17-c196da15214b/authorino/0.log"
Jul 22 04:19:24.694390 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:24.694363    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-994w8_2daa9b87-db14-4dda-b258-fb4c46cadb23/manager/0.log"
Jul 22 04:19:25.042028 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:25.042000    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-94cvl_70e7dbd3-3dbb-46cf-9d24-34996fefc9c4/registry-server/0.log"
Jul 22 04:19:25.165792 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:25.165766    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-p7g8w_9472990c-a646-4b57-82fd-400750c40993/manager/0.log"
Jul 22 04:19:25.410857 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:25.410793    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8pt54_6fbee01a-be34-4b5a-a5f4-99ec5809715e/manager/0.log"
Jul 22 04:19:26.016441 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:26.016412    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bd5997d8b-4lt5q_5460c5c2-bd2c-4093-94e0-5266fc561fca/kube-auth-proxy/0.log"
Jul 22 04:19:27.059982 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:27.059956    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-2vccv_7d570f62-c044-405e-9539-302c1c11843c/main/0.log"
Jul 22 04:19:27.298464 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:27.298431    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6njvg_7613d5ed-6580-455c-86f9-a39b92fb8ce9/main/0.log"
Jul 22 04:19:27.407439 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:27.407365    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-twmwb_e5dc61ab-9f1f-4de2-82bc-05e8cecf7914/main/0.log"
Jul 22 04:19:32.858388 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:32.858353    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:19:32.945230 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:32.945195    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log" limit=1024
Jul 22 04:19:35.833175 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:35.833141    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8tsf5_bb5c3237-38f9-4002-8191-c00c2918dc9a/global-pull-secret-syncer/0.log"
Jul 22 04:19:35.978223 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:35.978194    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p47hl_784a1926-484e-45c7-9559-6def8a0d6a49/konnectivity-agent/0.log"
Jul 22 04:19:36.129940 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:36.129866    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-88.ec2.internal_e36264e631cd609e30a4368a2627c6d6/haproxy/0.log"
Jul 22 04:19:40.963138 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:40.963105    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f9588658-xfmt6_717a9764-22c0-4598-bb17-c196da15214b/authorino/0.log"
Jul 22 04:19:40.991817 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:40.991798    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-994w8_2daa9b87-db14-4dda-b258-fb4c46cadb23/manager/0.log"
Jul 22 04:19:41.093901 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:41.093875    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-94cvl_70e7dbd3-3dbb-46cf-9d24-34996fefc9c4/registry-server/0.log"
Jul 22 04:19:41.285813 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:41.285720    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-p7g8w_9472990c-a646-4b57-82fd-400750c40993/manager/0.log"
Jul 22 04:19:41.393062 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:41.393033    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-8pt54_6fbee01a-be34-4b5a-a5f4-99ec5809715e/manager/0.log"
Jul 22 04:19:43.428333 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:43.428254    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-drd6x_462adc24-058d-4874-80a9-ce19d3273cb8/kube-state-metrics/0.log"
Jul 22 04:19:43.448096 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:43.448064    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-drd6x_462adc24-058d-4874-80a9-ce19d3273cb8/kube-rbac-proxy-main/0.log"
Jul 22 04:19:43.480452 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:43.480418    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-drd6x_462adc24-058d-4874-80a9-ce19d3273cb8/kube-rbac-proxy-self/0.log"
Jul 22 04:19:43.507502 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:43.507483    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6f98474868-w5kkg_47dafcd3-ccee-4898-9492-9f74d6fecd7c/metrics-server/0.log"
Jul 22 04:19:43.574495 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:43.574463    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b6fbf_db3a67a4-6a4e-4f60-82f4-5394cf4143fd/node-exporter/0.log"
Jul 22 04:19:43.598605 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:43.598585    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b6fbf_db3a67a4-6a4e-4f60-82f4-5394cf4143fd/kube-rbac-proxy/0.log"
Jul 22 04:19:43.620108 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:43.620074    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-b6fbf_db3a67a4-6a4e-4f60-82f4-5394cf4143fd/init-textfile/0.log"
Jul 22 04:19:44.220072 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:44.220048    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6557d747f9-xxjcg_0ea4abeb-e2a3-4092-bbb7-b90550c38d34/thanos-query/0.log"
Jul 22 04:19:44.262925 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:44.262898    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6557d747f9-xxjcg_0ea4abeb-e2a3-4092-bbb7-b90550c38d34/kube-rbac-proxy-web/0.log"
Jul 22 04:19:44.323053 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:44.323032    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6557d747f9-xxjcg_0ea4abeb-e2a3-4092-bbb7-b90550c38d34/kube-rbac-proxy/0.log"
Jul 22 04:19:44.351715 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:44.351693    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6557d747f9-xxjcg_0ea4abeb-e2a3-4092-bbb7-b90550c38d34/prom-label-proxy/0.log"
Jul 22 04:19:44.373229 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:44.373206    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6557d747f9-xxjcg_0ea4abeb-e2a3-4092-bbb7-b90550c38d34/kube-rbac-proxy-rules/0.log"
Jul 22 04:19:44.397432 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:44.397410    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6557d747f9-xxjcg_0ea4abeb-e2a3-4092-bbb7-b90550c38d34/kube-rbac-proxy-metrics/0.log"
Jul 22 04:19:46.483395 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.483361    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"]
Jul 22 04:19:46.483903 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.483749    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45f61517-e76f-446d-9f56-a1a1406e8322" containerName="maas-api"
Jul 22 04:19:46.483903 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.483765    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="45f61517-e76f-446d-9f56-a1a1406e8322" containerName="maas-api"
Jul 22 04:19:46.483903 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.483776    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5f0fec4-3769-4474-aa92-d052fb6a0786" containerName="main"
Jul 22 04:19:46.483903 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.483782    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5f0fec4-3769-4474-aa92-d052fb6a0786" containerName="main"
Jul 22 04:19:46.483903 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.483791    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abb471be-2b80-4a6a-97ab-1f7de76cc6f6" containerName="maas-api"
Jul 22 04:19:46.483903 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.483797    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="abb471be-2b80-4a6a-97ab-1f7de76cc6f6" containerName="maas-api"
Jul 22 04:19:46.483903 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.483882    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5f0fec4-3769-4474-aa92-d052fb6a0786" containerName="main"
Jul 22 04:19:46.483903 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.483898    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="abb471be-2b80-4a6a-97ab-1f7de76cc6f6" containerName="maas-api"
Jul 22 04:19:46.483903 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.483907    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="45f61517-e76f-446d-9f56-a1a1406e8322" containerName="maas-api"
Jul 22 04:19:46.488440 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.488423    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.491195 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.491175    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m4q6n\"/\"kube-root-ca.crt\""
Jul 22 04:19:46.492283 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.492264    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m4q6n\"/\"openshift-service-ca.crt\""
Jul 22 04:19:46.492376 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.492271    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m4q6n\"/\"default-dockercfg-hhvf6\""
Jul 22 04:19:46.499422 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.499402    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"]
Jul 22 04:19:46.559550 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.559530    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bffd29d-14f3-4529-9607-3ae2cb754122-sys\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.559706 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.559558    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6bffd29d-14f3-4529-9607-3ae2cb754122-proc\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.559706 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.559691    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6bffd29d-14f3-4529-9607-3ae2cb754122-podres\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.559824 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.559727    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6bffd29d-14f3-4529-9607-3ae2cb754122-lib-modules\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.559824 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.559780    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx9rd\" (UniqueName: \"kubernetes.io/projected/6bffd29d-14f3-4529-9607-3ae2cb754122-kube-api-access-zx9rd\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.660719 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.660688    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bffd29d-14f3-4529-9607-3ae2cb754122-sys\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.660841 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.660723    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6bffd29d-14f3-4529-9607-3ae2cb754122-proc\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.660841 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.660809    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6bffd29d-14f3-4529-9607-3ae2cb754122-podres\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.660841 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.660807    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6bffd29d-14f3-4529-9607-3ae2cb754122-sys\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.660947 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.660847    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6bffd29d-14f3-4529-9607-3ae2cb754122-proc\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.660947 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.660860    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6bffd29d-14f3-4529-9607-3ae2cb754122-lib-modules\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.660947 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.660894    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx9rd\" (UniqueName: \"kubernetes.io/projected/6bffd29d-14f3-4529-9607-3ae2cb754122-kube-api-access-zx9rd\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.660947 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.660920    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6bffd29d-14f3-4529-9607-3ae2cb754122-podres\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.661074 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.661006    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6bffd29d-14f3-4529-9607-3ae2cb754122-lib-modules\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.670883 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.670861    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx9rd\" (UniqueName: \"kubernetes.io/projected/6bffd29d-14f3-4529-9607-3ae2cb754122-kube-api-access-zx9rd\") pod \"perf-node-gather-daemonset-bdg98\" (UID: \"6bffd29d-14f3-4529-9607-3ae2cb754122\") " pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.798914 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.798838    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:46.935578 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.935549    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"]
Jul 22 04:19:46.937714 ip-10-0-142-88 kubenswrapper[2569]: W0722 04:19:46.937676    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6bffd29d_14f3_4529_9607_3ae2cb754122.slice/crio-64b749fbaa36b431bd15fcc2223bbb4ea4f80dc9ecba6a4b0b8a20934d1d30e8 WatchSource:0}: Error finding container 64b749fbaa36b431bd15fcc2223bbb4ea4f80dc9ecba6a4b0b8a20934d1d30e8: Status 404 returned error can't find the container with id 64b749fbaa36b431bd15fcc2223bbb4ea4f80dc9ecba6a4b0b8a20934d1d30e8
Jul 22 04:19:46.956494 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:46.956464    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98" event={"ID":"6bffd29d-14f3-4529-9607-3ae2cb754122","Type":"ContainerStarted","Data":"64b749fbaa36b431bd15fcc2223bbb4ea4f80dc9ecba6a4b0b8a20934d1d30e8"}
Jul 22 04:19:47.962043 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:47.962007    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98" event={"ID":"6bffd29d-14f3-4529-9607-3ae2cb754122","Type":"ContainerStarted","Data":"451b60f8db92e3afdc47c10d06256b6055f9c80c69195f2158f17765ef59cc56"}
Jul 22 04:19:47.962527 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:47.962134    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:47.978169 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:47.978129    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98" podStartSLOduration=1.978115858 podStartE2EDuration="1.978115858s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:19:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:19:47.977571575 +0000 UTC m=+2765.144806243" watchObservedRunningTime="2026-07-22 04:19:47.978115858 +0000 UTC m=+2765.145350531"
Jul 22 04:19:48.619022 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:48.618998    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vgdmh_53ee225b-818c-48db-aa81-291fdda1b6f7/dns/0.log"
Jul 22 04:19:48.640948 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:48.640925    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vgdmh_53ee225b-818c-48db-aa81-291fdda1b6f7/kube-rbac-proxy/0.log"
Jul 22 04:19:48.727536 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:48.727512    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l4m47_10efa3fa-bde2-477d-bbe0-7e534e9c9adb/dns-node-resolver/0.log"
Jul 22 04:19:49.289126 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:49.289098    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-74fd7fb9df-55cq7_9c32537a-cdbe-4ec0-810e-3441383c55ec/registry/0.log"
Jul 22 04:19:49.358876 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:49.358855    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8n7fw_b085ef6e-6417-412e-9734-573ade70877b/node-ca/0.log"
Jul 22 04:19:50.436622 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:50.436596    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bd5997d8b-4lt5q_5460c5c2-bd2c-4093-94e0-5266fc561fca/kube-auth-proxy/0.log"
Jul 22 04:19:51.362194 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:51.362145    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rd4n9_cebe7eab-75cb-4fad-9544-81af9507ace2/serve-healthcheck-canary/0.log"
Jul 22 04:19:51.929920 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:51.929865    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gplz9_b78266f5-b7d0-4637-8900-cef781106c52/kube-rbac-proxy/0.log"
Jul 22 04:19:51.952561 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:51.952541    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gplz9_b78266f5-b7d0-4637-8900-cef781106c52/exporter/0.log"
Jul 22 04:19:51.974634 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:51.974614    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gplz9_b78266f5-b7d0-4637-8900-cef781106c52/extractor/0.log"
Jul 22 04:19:53.976904 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:53.976881    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m4q6n/perf-node-gather-daemonset-bdg98"
Jul 22 04:19:54.166295 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:54.166263    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-kbn64_c8bdc597-44a4-43d7-a5d2-b2fa7d81b687/manager/0.log"
Jul 22 04:19:54.338821 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:54.338734    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8cvnv_5671cfc0-5bf7-4654-876e-8335dac8f778/manager/0.log"
Jul 22 04:19:54.464813 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:54.464786    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-rkj2h_c5086d01-4a12-4690-ba79-18d6d3573172/server/0.log"
Jul 22 04:19:54.528854 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:54.528814    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hgp9l_f9e07c01-5fbe-4d80-94a1-2771fb06b0fd/manager/0.log"
Jul 22 04:19:54.713177 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:54.713147    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fd47b996b-sfxjh_9a7a3c4a-26e5-46dc-b84c-1c00cba9b962/manager/0.log"
Jul 22 04:19:54.730127 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:54.730106    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5fd47b996b-sfxjh_9a7a3c4a-26e5-46dc-b84c-1c00cba9b962/copy-manifests/0.log"
Jul 22 04:19:56.174411 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:56.174386    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9p9l7_f3e32c65-0d5c-45f7-bd2e-46cc0d6102b5/openshift-lws-operator/0.log"
Jul 22 04:19:56.899778 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:56.899702    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bd5997d8b-4lt5q_5460c5c2-bd2c-4093-94e0-5266fc561fca/kube-auth-proxy/0.log"
Jul 22 04:19:58.430753 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:19:58.430683    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5bd5997d8b-4lt5q_5460c5c2-bd2c-4093-94e0-5266fc561fca/kube-auth-proxy/0.log"
Jul 22 04:20:02.712555 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:20:02.712524    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7dw9d_524d84af-a2bd-4e91-a863-26fef2bbb811/kube-multus/0.log"
Jul 22 04:20:03.054495 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:20:03.054420    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jd9tr_73518916-302e-4207-b0b7-1b0f02a64824/kube-multus-additional-cni-plugins/0.log"
Jul 22 04:20:03.076990 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:20:03.076966    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jd9tr_73518916-302e-4207-b0b7-1b0f02a64824/egress-router-binary-copy/0.log"
Jul 22 04:20:03.100919 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:20:03.100900    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jd9tr_73518916-302e-4207-b0b7-1b0f02a64824/cni-plugins/0.log"
Jul 22 04:20:03.121755 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:20:03.121738    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jd9tr_73518916-302e-4207-b0b7-1b0f02a64824/bond-cni-plugin/0.log"
Jul 22 04:20:03.142063 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:20:03.142045    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jd9tr_73518916-302e-4207-b0b7-1b0f02a64824/routeoverride-cni/0.log"
Jul 22 04:20:03.162072 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:20:03.162053    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jd9tr_73518916-302e-4207-b0b7-1b0f02a64824/whereabouts-cni-bincopy/0.log"
Jul 22 04:20:03.182591 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:20:03.182570    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-jd9tr_73518916-302e-4207-b0b7-1b0f02a64824/whereabouts-cni/0.log"
Jul 22 04:20:03.359664 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:20:03.359583    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xvhcc_8990e9a5-8145-4480-9127-d5c33c94f47b/network-metrics-daemon/0.log"
Jul 22 04:20:03.380200 ip-10-0-142-88 kubenswrapper[2569]: I0722 04:20:03.380178    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xvhcc_8990e9a5-8145-4480-9127-d5c33c94f47b/kube-rbac-proxy/0.log"