Jul 22 04:31:03.884770 ip-10-0-137-249 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 22 04:31:03.884784 ip-10-0-137-249 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 22 04:31:03.884793 ip-10-0-137-249 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 22 04:31:03.885122 ip-10-0-137-249 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 22 04:31:14.013856 ip-10-0-137-249 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 22 04:31:14.013875 ip-10-0-137-249 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 58e1f1fc23c94d8cb637eb192990e746 --
Jul 22 04:33:07.841481 ip-10-0-137-249 systemd[1]: Starting Kubernetes Kubelet...
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.202547    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208121    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208139    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208144    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208148    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208153    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208159    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208164    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:33:08.298513 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208168    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:33:08.272544 ip-10-0-137-249 systemd[1]: Started Kubernetes Kubelet.
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208172    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208176    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208180    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208184    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208189    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208193    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208196    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208199    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208201    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208220    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208224    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208227    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208230    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208233    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208236    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208238    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208241    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208243    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208246    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:33:08.300743 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208249    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208251    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208254    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208256    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208259    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208261    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208264    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208267    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208270    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208273    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208275    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208279    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208281    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208284    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208286    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208289    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208292    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208294    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208297    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:33:08.302047 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208300    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208302    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208306    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208308    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208312    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208314    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208320    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208326    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208330    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208333    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208336    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208339    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208342    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208345    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208348    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208352    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208355    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208357    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208360    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208363    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:33:08.303093 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208365    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208369    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208372    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208374    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208377    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208380    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208382    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208385    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208388    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208391    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208394    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208396    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208399    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208401    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208404    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208406    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208409    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208412    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208416    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:33:08.303999 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208420    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208424    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208427    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208430    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208432    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208435    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208437    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208440    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208443    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208446    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208449    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208451    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208453    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.208456    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209187    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209195    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209197    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209200    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209204    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:33:08.304739 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209220    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209223    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209226    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209229    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209232    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209234    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209237    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209240    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209242    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209245    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209248    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209251    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209256    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209259    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209261    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209264    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209266    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209269    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209272    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209274    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:33:08.305503 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209277    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209279    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209282    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209284    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209287    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209290    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209293    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209296    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209298    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209301    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209303    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209306    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209309    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209311    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209314    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209317    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209319    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209322    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209324    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:33:08.306110 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209328    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209330    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209333    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209335    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209338    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209342    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209345    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209348    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209351    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209353    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209356    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209359    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209362    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209364    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209367    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209370    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209374    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209377    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209379    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:33:08.306721 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209384    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209387    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209391    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209394    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209397    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209399    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209402    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209405    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209407    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209412    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209415    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209417    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209420    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209422    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209425    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209428    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209430    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209433    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209436    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:33:08.307391 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209439    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209443    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209447    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209450    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209453    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209456    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209459    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209462    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209464    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209467    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209472    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209474    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209477    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209480    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209482    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209485    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209487    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209914    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209929    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209932    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:33:08.308088 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209935    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209937    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209940    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209943    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209946    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209948    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209951    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209953    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209956    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209959    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209961    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209966    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209969    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209972    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209975    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209977    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209980    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209983    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209986    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209988    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:33:08.308676 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209991    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209993    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.209999    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210003    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210006    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210008    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210011    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210014    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210016    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210019    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210021    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210024    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210027    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210029    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210032    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210035    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210037    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210040    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210042    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:33:08.309269 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210045    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210048    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210050    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210053    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210057    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210060    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210063    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210066    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210068    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210071    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210073    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210076    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210079    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210081    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210083    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210087    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210090    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210092    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210096    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210099    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:33:08.309858 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210101    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210104    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210107    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210109    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210112    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210115    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210118    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210120    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210122    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210126    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210128    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210131    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210133    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210136    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210138    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210141    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210146    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210150    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210153    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:33:08.310510 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210155    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210159    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210162    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210164    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210167    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210169    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210172    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210175    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210179    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210181    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210184    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210187    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210189    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210192    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210194    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210197    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210199    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210202    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210304    2584 flags.go:64] FLAG: --address="0.0.0.0"
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210315    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210323    2584 flags.go:64] FLAG: --anonymous-auth="true"
Jul 22 04:33:08.311407 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210330    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210336    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210340    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210345    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210349    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210352    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210355    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210358    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210363    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210366    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210369    2584 flags.go:64] FLAG: --cgroup-root=""
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210372    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210375    2584 flags.go:64] FLAG: --client-ca-file=""
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210379    2584 flags.go:64] FLAG: --cloud-provider="external"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210382    2584 flags.go:64] FLAG: --cluster-dns="[]"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210388    2584 flags.go:64] FLAG: --cluster-domain=""
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210391    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210394    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210397    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210401    2584 flags.go:64] FLAG: --container-log-max-files="5"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210405    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210408    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210411    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 22 04:33:08.311948 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210414    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210418    2584 flags.go:64] FLAG: --contention-profiling="false"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210421    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210423    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210427    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210430    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210434    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210437    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210439    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210442    2584 flags.go:64] FLAG: --enable-load-reader="false"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210445    2584 flags.go:64] FLAG: --enable-server="true"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210448    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210452    2584 flags.go:64] FLAG: --event-burst="100"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210455    2584 flags.go:64] FLAG: --event-qps="50"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210458    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210460    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210463    2584 flags.go:64] FLAG: --eviction-hard=""
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210469    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210471    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210474    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210477    2584 flags.go:64] FLAG: --eviction-soft=""
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210480    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210483    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210486    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210490    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 22 04:33:08.312673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210493    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210495    2584 flags.go:64] FLAG: --fail-swap-on="true"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210498    2584 flags.go:64] FLAG: --feature-gates=""
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210503    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210506    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210509    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210512    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210516    2584 flags.go:64] FLAG: --healthz-port="10248"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210519    2584 flags.go:64] FLAG: --help="false"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210522    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-137-249.ec2.internal"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210525    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210527    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210530    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210534    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210537    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210540    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210543    2584 flags.go:64] FLAG: --image-service-endpoint=""
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210545    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210548    2584 flags.go:64] FLAG: --kube-api-burst="100"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210551    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210554    2584 flags.go:64] FLAG: --kube-api-qps="50"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210557    2584 flags.go:64] FLAG: --kube-reserved=""
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210560    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210562    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 22 04:33:08.313554 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210567    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210569    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210572    2584 flags.go:64] FLAG: --lock-file=""
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210575    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210578    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210581    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210586    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210589    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210592    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210595    2584 flags.go:64] FLAG: --logging-format="text"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210598    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210602    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210605    2584 flags.go:64] FLAG: --manifest-url=""
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210608    2584 flags.go:64] FLAG: --manifest-url-header=""
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210612    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210615    2584 flags.go:64] FLAG: --max-open-files="1000000"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210619    2584 flags.go:64] FLAG: --max-pods="110"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210622    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210625    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210627    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210631    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210633    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210636    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210639    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210646    2584 flags.go:64] FLAG: --node-status-max-images="50"
Jul 22 04:33:08.314283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210649    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210652    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210655    2584 flags.go:64] FLAG: --pod-cidr=""
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210658    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210664    2584 flags.go:64] FLAG: --pod-manifest-path=""
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210667    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210670    2584 flags.go:64] FLAG: --pods-per-core="0"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210673    2584 flags.go:64] FLAG: --port="10250"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210677    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210680    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07e1a7471c2259607"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210683    2584 flags.go:64] FLAG: --qos-reserved=""
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210686    2584 flags.go:64] FLAG: --read-only-port="10255"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210689    2584 flags.go:64] FLAG: --register-node="true"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210692    2584 flags.go:64] FLAG: --register-with-taints=""
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210695    2584 flags.go:64] FLAG: --registry-burst="10"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210699    2584 flags.go:64] FLAG: --registry-qps="5"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210702    2584 flags.go:64] FLAG: --reserved-cpus=""
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210705    2584 flags.go:64] FLAG: --reserved-memory=""
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210710    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210713    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210716    2584 flags.go:64] FLAG: --rotate-certificates="false"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210719    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210721    2584 flags.go:64] FLAG: --runonce="false"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210724    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210727    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 22 04:33:08.315288 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210730    2584 flags.go:64] FLAG: --seccomp-default="false"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210733    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210736    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210739    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210742    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210745    2584 flags.go:64] FLAG: --storage-driver-password="root"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210747    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210750    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210753    2584 flags.go:64] FLAG: --storage-driver-user="root"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210755    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210758    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210761    2584 flags.go:64] FLAG: --system-cgroups=""
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210764    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210769    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210772    2584 flags.go:64] FLAG: --tls-cert-file=""
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210776    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210780    2584 flags.go:64] FLAG: --tls-min-version=""
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210783    2584 flags.go:64] FLAG: --tls-private-key-file=""
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210786    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210789    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210792    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210795    2584 flags.go:64] FLAG: --v="2"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210798    2584 flags.go:64] FLAG: --version="false"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210804    2584 flags.go:64] FLAG: --vmodule=""
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210807    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 22 04:33:08.484196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.210812    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210939    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210943    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210947    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210950    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210952    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210955    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210957    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210960    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210963    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210965    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210968    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210971    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210973    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210976    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210978    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210982    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210986    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210989    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:33:08.510132 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210991    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210994    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.210996    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211001    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211004    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211007    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211009    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211012    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211014    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211017    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211020    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211022    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211027    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211032    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211035    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211038    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211041    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211044    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211047    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211050    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:33:08.510821 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211052    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211055    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211058    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211061    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211063    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211066    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211069    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211071    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211074    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211076    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211079    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211082    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211084    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211088    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211091    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211097    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211100    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211102    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211105    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:33:08.511443 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211108    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211111    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211113    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211116    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211118    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211121    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211126    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211128    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211131    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211134    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211136    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211139    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211142    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211145    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211147    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211150    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211152    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211155    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211157    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211160    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:33:08.511998 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211162    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211165    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211168    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211170    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211173    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211175    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211178    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211180    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211185    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211188    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211190    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211193    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211196    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211199    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211201    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211204    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211220    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211223    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211227    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211230    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:33:08.512573 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211233    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.211236    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.211770    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.218032    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.218049    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.218067    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.218073    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218136    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218142    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218146    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218149    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218152    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218154    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218157    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218160    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:33:08.513159 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218162    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218165    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218167    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218170    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218173    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218175    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218178    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218183    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218186    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218189    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218192    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218194    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218197    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218200    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218203    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218205    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218224    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218227    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218230    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218233    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:33:08.513605 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218236    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218239    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218242    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218245    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218247    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218250    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218252    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218255    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218257    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218260    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218263    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218265    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218268    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218270    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218273    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218275    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218278    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218280    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218283    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218287    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:33:08.514183 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218290    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218293    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218295    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218298    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218300    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218303    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218305    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218308    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218310    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218313    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218315    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218318    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218321    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218323    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218326    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218329    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218331    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218334    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218336    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218339    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:33:08.514738 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218341    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218344    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218346    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218349    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218351    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218354    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218356    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218360    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218363    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218366    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218370    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218375    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218378    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218381    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218384    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218386    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218389    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218392    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:33:08.515339 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218395    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218399    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218402    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218405    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218408    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218411    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218413    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218416    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218419    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218422    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218425    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218428    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218430    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.218436    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 04:33:08.515826 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218579    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218585    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218588    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218591    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218594    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218597    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218600    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218602    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218605    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218607    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218610    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218612    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218619    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218623    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218626    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218629    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218632    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218635    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 22 04:33:08.516270 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218638    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218641    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218644    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218646    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218650    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218652    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218655    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218657    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218660    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218662    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218666    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218668    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218671    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218673    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218676    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218678    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218681    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218683    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218686    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218690    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 22 04:33:08.516753 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218693    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218696    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218699    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218702    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218705    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218707    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218712    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218715    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218717    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218720    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218722    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218725    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218727    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218730    2584 feature_gate.go:328] unrecognized feature gate: Example2
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218732    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218735    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218738    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218740    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218743    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218745    2584 feature_gate.go:328] unrecognized feature gate: Example
Jul 22 04:33:08.517353 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218748    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218751    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218753    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218757    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218759    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218762    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218764    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218767    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218769    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218771    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218774    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218777    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218779    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218781    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218785    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218787    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218790    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218792    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218797    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218800    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 22 04:33:08.517902 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218803    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218805    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218808    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218810    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218813    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218815    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218818    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218820    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218823    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218825    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218828    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218830    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218833    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218835    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218838    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218840    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218844    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218846    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218849    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218851    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 22 04:33:08.518489 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:08.218855    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 22 04:33:08.519030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.218860    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 22 04:33:08.519030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.218967    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 22 04:33:08.519030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.220825    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 22 04:33:08.519030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.221902    2584 server.go:1019] "Starting client certificate rotation"
Jul 22 04:33:08.519030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.222012    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 04:33:08.519030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.222735    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 22 04:33:08.519030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.224769    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 04:33:08.519030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.225939    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 22 04:33:08.519030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.236988    2584 log.go:25] "Validated CRI v1 runtime API"
Jul 22 04:33:08.519030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.239168    2584 log.go:25] "Validated CRI v1 image API"
Jul 22 04:33:08.519030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.239969    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 22 04:33:08.519030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.243314    2584 fs.go:135] Filesystem UUIDs: map[1747d823-57d3-4ea9-b557-7149dbbe812b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c12f4fbb-084c-4668-a9a9-cd8c34f8e313:/dev/nvme0n1p3]
Jul 22 04:33:08.519516 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.243331    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 22 04:33:08.519589 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.249059    2584 manager.go:216] Machine: {Timestamp:2026-07-22 04:33:08.247839097 +0000 UTC m=+0.294407970 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098941 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec279e3f2ff88148977bf654027039e7 SystemUUID:ec279e3f-2ff8-8148-977b-f654027039e7 BootID:58e1f1fc-23c9-4d8c-b637-eb192990e746 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:af:69:ee:a7:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:af:69:ee:a7:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:b5:8a:18:1f:4c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 22 04:33:08.519589 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.249157    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 22 04:33:08.519589 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.249260    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 22 04:33:08.519589 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.251757    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 04:33:08.519589 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.252030    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 22 04:33:08.519589 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.252056    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-249.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 22 04:33:08.519589 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.252763    2584 topology_manager.go:138] "Creating topology manager with none policy"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.252784    2584 container_manager_linux.go:309] "Creating device plugin manager"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.252792    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.253405    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.254439    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.257866    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.257986    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.258013    2584 kubelet.go:486] "Attempting to sync node with API server"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.258030    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.258043    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.258052    2584 kubelet.go:398] "Adding apiserver pod source"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.258061    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.258416    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.258430    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.260762    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.262491    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.262519    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.263813    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.263826    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.263832    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.263838    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.263847    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.263854    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.263861    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.263866    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.263873    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.263878    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.263886    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.263891    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.265319    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.265329    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.266688    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.266693    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.268449    2584 server.go:1268] "Started kubelet"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.268531    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.268690    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.268697    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.274279    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.276481    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 22 04:33:08.519893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.276502    2584 server.go:310] "Adding debug handlers to kubelet server"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.279276    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-249.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.279286    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-249.ec2.internal.18c48274473af041  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-249.ec2.internal,UID:ip-10-0-137-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-249.ec2.internal,},FirstTimestamp:2026-07-22 04:33:08.268421185 +0000 UTC m=+0.314990058,LastTimestamp:2026-07-22 04:33:08.268421185 +0000 UTC m=+0.314990058,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-249.ec2.internal,}"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.281729    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.281735    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.281792    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.282195    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.282251    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.282263    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.282360    2584 reconstruct.go:97] "Volume reconstruction finished"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.282369    2584 reconciler.go:29] "Reconciler: start to sync state"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.282763    2584 factory.go:153] Registering CRI-O factory
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.282777    2584 factory.go:223] Registration of the crio container factory successfully
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.282825    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.282836    2584 factory.go:55] Registering systemd factory
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.282843    2584 factory.go:223] Registration of the systemd container factory successfully
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.282864    2584 factory.go:103] Registering Raw factory
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.282877    2584 manager.go:1196] Started watching for new ooms in manager
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.283348    2584 manager.go:349] Starting recovery of all containers
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.286044    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.286116    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.294985    2584 manager.go:354] Recovery completed
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.296337    2584 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.299161    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.300911    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.300937    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.300948    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.302658    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.302673    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.302721    2584 state_mem.go:36] "Initialized new in-memory state store"
Jul 22 04:33:08.652224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.303414    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:33:08.653195 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.303677    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-249.ec2.internal.18c48274492ae187  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-249.ec2.internal,UID:ip-10-0-137-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-249.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-249.ec2.internal,},FirstTimestamp:2026-07-22 04:33:08.300923271 +0000 UTC m=+0.347492143,LastTimestamp:2026-07-22 04:33:08.300923271 +0000 UTC m=+0.347492143,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-249.ec2.internal,}"
Jul 22 04:33:08.653195 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.304472    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:33:08.653195 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.304506    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:33:08.653195 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.304522    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:33:08.653195 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.310353    2584 policy_none.go:49] "None policy: Start"
Jul 22 04:33:08.653195 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.310367    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 22 04:33:08.653195 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.310378    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 22 04:33:08.653195 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.312282    2584 policy_none.go:47] "Start"
Jul 22 04:33:08.653195 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.313151    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-249.ec2.internal.18c48274492b2a87  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-249.ec2.internal,UID:ip-10-0-137-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-249.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-249.ec2.internal,},FirstTimestamp:2026-07-22 04:33:08.300941959 +0000 UTC m=+0.347510832,LastTimestamp:2026-07-22 04:33:08.300941959 +0000 UTC m=+0.347510832,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-249.ec2.internal,}"
Jul 22 04:33:08.653195 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.316168    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-249.ec2.internal.18c48274492b58a5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-249.ec2.internal,UID:ip-10-0-137-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-249.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-249.ec2.internal,},FirstTimestamp:2026-07-22 04:33:08.300953765 +0000 UTC m=+0.347522641,LastTimestamp:2026-07-22 04:33:08.300953765 +0000 UTC m=+0.347522641,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-249.ec2.internal,}"
Jul 22 04:33:08.653195 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.324365    2584 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-249.ec2.internal.18c48274492ae187\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-249.ec2.internal.18c48274492ae187  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-249.ec2.internal,UID:ip-10-0-137-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-249.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-249.ec2.internal,},FirstTimestamp:2026-07-22 04:33:08.300923271 +0000 UTC m=+0.347492143,LastTimestamp:2026-07-22 04:33:08.304489207 +0000 UTC m=+0.351058083,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-249.ec2.internal,}"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.336876    2584 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-249.ec2.internal.18c48274492b2a87\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-249.ec2.internal.18c48274492b2a87  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-249.ec2.internal,UID:ip-10-0-137-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-249.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-249.ec2.internal,},FirstTimestamp:2026-07-22 04:33:08.300941959 +0000 UTC m=+0.347510832,LastTimestamp:2026-07-22 04:33:08.304514427 +0000 UTC m=+0.351083300,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-249.ec2.internal,}"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.350088    2584 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-137-249.ec2.internal.18c48274492b58a5\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-249.ec2.internal.18c48274492b58a5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-249.ec2.internal,UID:ip-10-0-137-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-249.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-249.ec2.internal,},FirstTimestamp:2026-07-22 04:33:08.300953765 +0000 UTC m=+0.347522641,LastTimestamp:2026-07-22 04:33:08.304527409 +0000 UTC m=+0.351096283,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-249.ec2.internal,}"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.355811    2584 manager.go:337] "Starting Device Plugin manager"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.355846    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.355855    2584 server.go:87] "Starting device plugin registration server"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.356132    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.356142    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.356269    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.356341    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.356349    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.356840    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.356884    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.357599    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b8jvp"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.365529    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b8jvp"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.366241    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-249.ec2.internal.18c482744c9488a2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-249.ec2.internal,UID:ip-10-0-137-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-137-249.ec2.internal,},FirstTimestamp:2026-07-22 04:33:08.358178978 +0000 UTC m=+0.404747842,LastTimestamp:2026-07-22 04:33:08.358178978 +0000 UTC m=+0.404747842,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-249.ec2.internal,}"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.456687    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.457604    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:33:08.654397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.457637    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.457647    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.457673    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-249.ec2.internal"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.470129    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-249.ec2.internal"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.470151    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-249.ec2.internal\": node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.480018    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.481304    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.481336    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.481357    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.481395    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.483599    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.484188    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.582021    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"]
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.582107    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.584468    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.585588    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29a3b8849e7de9826bbe69d4f142303f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"29a3b8849e7de9826bbe69d4f142303f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.585640    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/29a3b8849e7de9826bbe69d4f142303f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"29a3b8849e7de9826bbe69d4f142303f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.587855    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.587882    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.587893    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.590344    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.590536    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.590562    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.591345    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.591373    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.591386    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.591740    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.591758    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.591767    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.593641    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.593665    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:33:08.654954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.594391    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:33:08.655783 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.594413    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:33:08.655783 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.594424    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:33:08.655783 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.608736    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-249.ec2.internal\" not found" node="ip-10-0-137-249.ec2.internal"
Jul 22 04:33:08.655783 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.614294    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-249.ec2.internal\" not found" node="ip-10-0-137-249.ec2.internal"
Jul 22 04:33:10.768008 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:08.685328    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:10.768008 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.686423    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29a3b8849e7de9826bbe69d4f142303f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"29a3b8849e7de9826bbe69d4f142303f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:10.768008 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.686448    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9eae42e7d66416d6ea3b4d6c66b2c30-config\") pod \"kube-apiserver-proxy-ip-10-0-137-249.ec2.internal\" (UID: \"f9eae42e7d66416d6ea3b4d6c66b2c30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:10.768008 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.686466    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/29a3b8849e7de9826bbe69d4f142303f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"29a3b8849e7de9826bbe69d4f142303f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:10.768008 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.686505    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/29a3b8849e7de9826bbe69d4f142303f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"29a3b8849e7de9826bbe69d4f142303f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:10.768008 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:08.686526    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29a3b8849e7de9826bbe69d4f142303f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal\" (UID: \"29a3b8849e7de9826bbe69d4f142303f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:10.775278 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:10.774735    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:10.829761 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:10.775853    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9eae42e7d66416d6ea3b4d6c66b2c30-config\") pod \"kube-apiserver-proxy-ip-10-0-137-249.ec2.internal\" (UID: \"f9eae42e7d66416d6ea3b4d6c66b2c30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:10.829761 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:10.775916    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/f9eae42e7d66416d6ea3b4d6c66b2c30-config\") pod \"kube-apiserver-proxy-ip-10-0-137-249.ec2.internal\" (UID: \"f9eae42e7d66416d6ea3b4d6c66b2c30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:10.888979 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:10.875145    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:11.081094 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:10.900388    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:11.081094 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:10.905649    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:11.081094 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:10.976246    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:11.081094 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:11.076656    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:11.351834 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.104914    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:33:11.351834 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:11.177397    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:11.351834 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.210541    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 22 04:33:11.351834 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.210676    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 04:33:11.351834 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.210697    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 22 04:33:11.351834 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:11.277635    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:11.351834 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.307496    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 22 04:33:11.351834 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.308738    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientMemory"
Jul 22 04:33:11.351834 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.308766    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasNoDiskPressure"
Jul 22 04:33:11.351834 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.308784    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeHasSufficientPID"
Jul 22 04:33:11.546546 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.359494    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 04:28:10 +0000 UTC" deadline="2028-04-16 14:22:49.536633562 +0000 UTC"
Jul 22 04:33:11.546546 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.359521    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15225h49m38.177115852s"
Jul 22 04:33:11.546546 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:11.377737    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-249.ec2.internal\" not found"
Jul 22 04:33:11.546546 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.451603    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:33:11.546546 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.471589    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:11.546546 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.482268    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 04:33:11.546546 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.483359    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal"
Jul 22 04:33:11.546546 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.491219    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 22 04:33:11.546546 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:11.535763    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a3b8849e7de9826bbe69d4f142303f.slice/crio-b392ccfa2cbb77752ff183220fe9ccd0ffccdfb16127cb0739eb1b9eefcfab13 WatchSource:0}: Error finding container b392ccfa2cbb77752ff183220fe9ccd0ffccdfb16127cb0739eb1b9eefcfab13: Status 404 returned error can't find the container with id b392ccfa2cbb77752ff183220fe9ccd0ffccdfb16127cb0739eb1b9eefcfab13
Jul 22 04:33:11.546546 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:11.538230    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9eae42e7d66416d6ea3b4d6c66b2c30.slice/crio-e61fc2f96c288853dd0cc4e208ae12a7dde97ba6ae845724f94c78af7c2adb8e WatchSource:0}: Error finding container e61fc2f96c288853dd0cc4e208ae12a7dde97ba6ae845724f94c78af7c2adb8e: Status 404 returned error can't find the container with id e61fc2f96c288853dd0cc4e208ae12a7dde97ba6ae845724f94c78af7c2adb8e
Jul 22 04:33:11.547726 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.547165    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:33:11.917854 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:11.769031    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:33:12.158376 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.145197    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:33:12.249840 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.248634    2584 apiserver.go:52] "Watching apiserver"
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.257166    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.259282    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-clv6p","openshift-multus/network-metrics-daemon-bvrr4","openshift-network-diagnostics/network-check-target-pbxk8","openshift-network-operator/iptables-alerter-njldw","kube-system/global-pull-secret-syncer-sglqd","kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj","openshift-cluster-node-tuning-operator/tuned-glmcg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-bq76r","kube-system/konnectivity-agent-2mglg","openshift-dns/node-resolver-j7gtj","openshift-image-registry/node-ca-878j5","openshift-multus/multus-additional-cni-plugins-h9h8p"]
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.261880    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.264288    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.264343    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cbz8r\""
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.264406    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.264479    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.264718    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-878j5"
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.267043    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w92rg\""
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.267255    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.267312    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.267353    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.267990    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.268058    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.270208    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-njldw"
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.270614    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.272789    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.273030    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.273054    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dj76d\""
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.273092    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.273250    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.273256    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 22 04:33:12.348851 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.281140    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.281910    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40557eca-82bd-4ffc-9164-f813551371c0-serviceca\") pod \"node-ca-878j5\" (UID: \"40557eca-82bd-4ffc-9164-f813551371c0\") " pod="openshift-image-registry/node-ca-878j5"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.281968    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bc8t\" (UniqueName: \"kubernetes.io/projected/40557eca-82bd-4ffc-9164-f813551371c0-kube-api-access-5bc8t\") pod \"node-ca-878j5\" (UID: \"40557eca-82bd-4ffc-9164-f813551371c0\") " pod="openshift-image-registry/node-ca-878j5"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282005    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-socket-dir\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282031    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-registration-dir\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282059    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-etc-selinux\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282105    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-sys-fs\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282145    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/577edbbc-caa1-4e06-bc1f-ea1536757ab3-iptables-alerter-script\") pod \"iptables-alerter-njldw\" (UID: \"577edbbc-caa1-4e06-bc1f-ea1536757ab3\") " pod="openshift-network-operator/iptables-alerter-njldw"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282176    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/577edbbc-caa1-4e06-bc1f-ea1536757ab3-host-slash\") pod \"iptables-alerter-njldw\" (UID: \"577edbbc-caa1-4e06-bc1f-ea1536757ab3\") " pod="openshift-network-operator/iptables-alerter-njldw"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282205    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5ab223e-0556-4987-88a3-828fe304d34d-kubelet-config\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282270    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5ab223e-0556-4987-88a3-828fe304d34d-dbus\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282324    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40557eca-82bd-4ffc-9164-f813551371c0-host\") pod \"node-ca-878j5\" (UID: \"40557eca-82bd-4ffc-9164-f813551371c0\") " pod="openshift-image-registry/node-ca-878j5"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgxgl\" (UniqueName: \"kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl\") pod \"network-check-target-pbxk8\" (UID: \"07924526-aed8-4def-85f1-3298f15b128a\") " pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:12.349992 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282399    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282428    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-device-dir\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282462    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6vbs\" (UniqueName: \"kubernetes.io/projected/e4485896-ebec-44bb-8968-c8bd66ba4496-kube-api-access-m6vbs\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282496    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k8vs\" (UniqueName: \"kubernetes.io/projected/577edbbc-caa1-4e06-bc1f-ea1536757ab3-kube-api-access-4k8vs\") pod \"iptables-alerter-njldw\" (UID: \"577edbbc-caa1-4e06-bc1f-ea1536757ab3\") " pod="openshift-network-operator/iptables-alerter-njldw"
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.282526    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.283651    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.283684    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.283841    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.283960    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.283975    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.284053    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.284662    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-75jxj\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.285962    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.286535    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.286807    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-czspn\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.286809    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.286852    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.288190    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.288373    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4kz8c\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.288542    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.288606    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.290671    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.293010    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.293285    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p287c\""
Jul 22 04:33:12.350587 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.293457    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.293661    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.293832    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.294291    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mglg"
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.294367    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.294741    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.296669    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7gtj"
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.297281    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.297332    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.297534    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-f99sg\""
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.299327    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.299688    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.299698    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q4mvr\""
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.305160    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9g8r"
Jul 22 04:33:12.351592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.312336    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-v9g8r"
Jul 22 04:33:12.372908 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.372803    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 22 04:33:12.387966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.387115    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40557eca-82bd-4ffc-9164-f813551371c0-serviceca\") pod \"node-ca-878j5\" (UID: \"40557eca-82bd-4ffc-9164-f813551371c0\") " pod="openshift-image-registry/node-ca-878j5"
Jul 22 04:33:12.387966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.387168    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/577edbbc-caa1-4e06-bc1f-ea1536757ab3-iptables-alerter-script\") pod \"iptables-alerter-njldw\" (UID: \"577edbbc-caa1-4e06-bc1f-ea1536757ab3\") " pod="openshift-network-operator/iptables-alerter-njldw"
Jul 22 04:33:12.387966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.387205    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-run-netns\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.387966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.387231    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-run-netns\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.387966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.387747    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/40557eca-82bd-4ffc-9164-f813551371c0-serviceca\") pod \"node-ca-878j5\" (UID: \"40557eca-82bd-4ffc-9164-f813551371c0\") " pod="openshift-image-registry/node-ca-878j5"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388305    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-var-lib-kubelet\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388352    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-lib-modules\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388382    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-tuned\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388413    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-run-ovn-kubernetes\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388444    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5bc6449a-edf4-4270-b1db-12524d4e34b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388469    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-os-release\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388497    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-multus-socket-dir-parent\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388530    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7rlw\" (UniqueName: \"kubernetes.io/projected/d6a93089-b6d0-4868-a3a4-0d7579905bbf-kube-api-access-n7rlw\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388565    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgxgl\" (UniqueName: \"kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl\") pod \"network-check-target-pbxk8\" (UID: \"07924526-aed8-4def-85f1-3298f15b128a\") " pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388591    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-slash\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388612    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-var-lib-cni-bin\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388638    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-var-lib-cni-multus\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.389239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388667    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6vbs\" (UniqueName: \"kubernetes.io/projected/e4485896-ebec-44bb-8968-c8bd66ba4496-kube-api-access-m6vbs\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388695    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388724    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-cni-netd\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388746    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/745f3211-0036-4c31-80ca-1513019ea800-agent-certs\") pod \"konnectivity-agent-2mglg\" (UID: \"745f3211-0036-4c31-80ca-1513019ea800\") " pod="kube-system/konnectivity-agent-2mglg"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388776    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-sysctl-d\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388803    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-sys\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388831    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-registration-dir\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388857    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5bc6449a-edf4-4270-b1db-12524d4e34b0-cnibin\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-sys-fs\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388910    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5ab223e-0556-4987-88a3-828fe304d34d-dbus\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388962    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bc6449a-edf4-4270-b1db-12524d4e34b0-system-cni-dir\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.388992    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5bc6449a-edf4-4270-b1db-12524d4e34b0-os-release\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.389019    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5bc6449a-edf4-4270-b1db-12524d4e34b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.389044    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:12.389877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.389071    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xqmv\" (UniqueName: \"kubernetes.io/projected/45a0a41b-c046-4856-93ea-9e9e97d052c1-kube-api-access-2xqmv\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.390692 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.389104    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-systemd-units\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.390692 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.389131    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-etc-openvswitch\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.390692 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.389162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/745f3211-0036-4c31-80ca-1513019ea800-konnectivity-ca\") pod \"konnectivity-agent-2mglg\" (UID: \"745f3211-0036-4c31-80ca-1513019ea800\") " pod="kube-system/konnectivity-agent-2mglg"
Jul 22 04:33:12.390692 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.389189    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-multus-cni-dir\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.389220    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k8vs\" (UniqueName: \"kubernetes.io/projected/577edbbc-caa1-4e06-bc1f-ea1536757ab3-kube-api-access-4k8vs\") pod \"iptables-alerter-njldw\" (UID: \"577edbbc-caa1-4e06-bc1f-ea1536757ab3\") " pod="openshift-network-operator/iptables-alerter-njldw"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391389    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-cni-binary-copy\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391426    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-multus-conf-dir\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391458    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-run-multus-certs\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391488    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-run\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391524    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-etc-selinux\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391549    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-run-systemd\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391579    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-var-lib-openvswitch\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391610    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-node-log\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391638    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-sysconfig\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391667    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-sysctl-conf\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391693    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-run-ovn\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391725    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqk2c\" (UniqueName: \"kubernetes.io/projected/5bc6449a-edf4-4270-b1db-12524d4e34b0-kube-api-access-sqk2c\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.394534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391754    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-system-cni-dir\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391785    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391816    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-systemd\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391846    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-host\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391874    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-kubelet\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391903    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-env-overrides\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.389441    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-registration-dir\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.389713    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.392117    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret podName:d5ab223e-0556-4987-88a3-828fe304d34d nodeName:}" failed. No retries permitted until 2026-07-22 04:33:12.892083492 +0000 UTC m=+2.949921047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret") pod "global-pull-secret-syncer-sglqd" (UID: "d5ab223e-0556-4987-88a3-828fe304d34d") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.389812    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-sys-fs\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.389779    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5ab223e-0556-4987-88a3-828fe304d34d-dbus\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391319    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/577edbbc-caa1-4e06-bc1f-ea1536757ab3-iptables-alerter-script\") pod \"iptables-alerter-njldw\" (UID: \"577edbbc-caa1-4e06-bc1f-ea1536757ab3\") " pod="openshift-network-operator/iptables-alerter-njldw"
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.392492    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-etc-selinux\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.392667    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.396261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.391934    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5bc6449a-edf4-4270-b1db-12524d4e34b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.392765    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9xzw\" (UniqueName: \"kubernetes.io/projected/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-kube-api-access-l9xzw\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.392810    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-var-lib-kubelet\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.392840    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-run-openvswitch\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.392870    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-ovnkube-config\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.392899    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-ovnkube-script-lib\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.392923    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd595fae-bda2-4a84-ae8c-e7b1cc3831f2-hosts-file\") pod \"node-resolver-j7gtj\" (UID: \"cd595fae-bda2-4a84-ae8c-e7b1cc3831f2\") " pod="openshift-dns/node-resolver-j7gtj"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.392971    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bc8t\" (UniqueName: \"kubernetes.io/projected/40557eca-82bd-4ffc-9164-f813551371c0-kube-api-access-5bc8t\") pod \"node-ca-878j5\" (UID: \"40557eca-82bd-4ffc-9164-f813551371c0\") " pod="openshift-image-registry/node-ca-878j5"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393003    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-socket-dir\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393036    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5ab223e-0556-4987-88a3-828fe304d34d-kubelet-config\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393063    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcvwd\" (UniqueName: \"kubernetes.io/projected/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-kube-api-access-rcvwd\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393092    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-cnibin\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393131    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-run-k8s-cni-cncf-io\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-hostroot\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.397414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393190    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/577edbbc-caa1-4e06-bc1f-ea1536757ab3-host-slash\") pod \"iptables-alerter-njldw\" (UID: \"577edbbc-caa1-4e06-bc1f-ea1536757ab3\") " pod="openshift-network-operator/iptables-alerter-njldw"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393216    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-modprobe-d\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393245    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-kubernetes\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393273    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-log-socket\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393302    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-cni-bin\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393331    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd595fae-bda2-4a84-ae8c-e7b1cc3831f2-tmp-dir\") pod \"node-resolver-j7gtj\" (UID: \"cd595fae-bda2-4a84-ae8c-e7b1cc3831f2\") " pod="openshift-dns/node-resolver-j7gtj"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393357    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-etc-kubernetes\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393388    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40557eca-82bd-4ffc-9164-f813551371c0-host\") pod \"node-ca-878j5\" (UID: \"40557eca-82bd-4ffc-9164-f813551371c0\") " pod="openshift-image-registry/node-ca-878j5"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393421    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-device-dir\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393451    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zbbg\" (UniqueName: \"kubernetes.io/projected/cd595fae-bda2-4a84-ae8c-e7b1cc3831f2-kube-api-access-6zbbg\") pod \"node-resolver-j7gtj\" (UID: \"cd595fae-bda2-4a84-ae8c-e7b1cc3831f2\") " pod="openshift-dns/node-resolver-j7gtj"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393476    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-multus-daemon-config\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393505    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45a0a41b-c046-4856-93ea-9e9e97d052c1-tmp\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393535    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393571    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-ovn-node-metrics-cert\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.398088 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.393600    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5bc6449a-edf4-4270-b1db-12524d4e34b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.398725 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.394091    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-socket-dir\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.398725 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.394159    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5ab223e-0556-4987-88a3-828fe304d34d-kubelet-config\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:12.398725 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.394274    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/577edbbc-caa1-4e06-bc1f-ea1536757ab3-host-slash\") pod \"iptables-alerter-njldw\" (UID: \"577edbbc-caa1-4e06-bc1f-ea1536757ab3\") " pod="openshift-network-operator/iptables-alerter-njldw"
Jul 22 04:33:12.398725 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.394394    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40557eca-82bd-4ffc-9164-f813551371c0-host\") pod \"node-ca-878j5\" (UID: \"40557eca-82bd-4ffc-9164-f813551371c0\") " pod="openshift-image-registry/node-ca-878j5"
Jul 22 04:33:12.398725 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.394452    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4485896-ebec-44bb-8968-c8bd66ba4496-device-dir\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.398725 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.395421    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:33:12.398725 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.395448    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:33:12.398725 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.395461    2584 projected.go:196] Error preparing data for projected volume kube-api-access-pgxgl for pod openshift-network-diagnostics/network-check-target-pbxk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:12.398725 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.395528    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl podName:07924526-aed8-4def-85f1-3298f15b128a nodeName:}" failed. No retries permitted until 2026-07-22 04:33:12.89551355 +0000 UTC m=+2.953351111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pgxgl" (UniqueName: "kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl") pod "network-check-target-pbxk8" (UID: "07924526-aed8-4def-85f1-3298f15b128a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:12.398725 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.394969    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 22 04:33:12.400526 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.400509    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6vbs\" (UniqueName: \"kubernetes.io/projected/e4485896-ebec-44bb-8968-c8bd66ba4496-kube-api-access-m6vbs\") pod \"aws-ebs-csi-driver-node-8hpnj\" (UID: \"e4485896-ebec-44bb-8968-c8bd66ba4496\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.402133 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.402072    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k8vs\" (UniqueName: \"kubernetes.io/projected/577edbbc-caa1-4e06-bc1f-ea1536757ab3-kube-api-access-4k8vs\") pod \"iptables-alerter-njldw\" (UID: \"577edbbc-caa1-4e06-bc1f-ea1536757ab3\") " pod="openshift-network-operator/iptables-alerter-njldw"
Jul 22 04:33:12.404911 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.404888    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bc8t\" (UniqueName: \"kubernetes.io/projected/40557eca-82bd-4ffc-9164-f813551371c0-kube-api-access-5bc8t\") pod \"node-ca-878j5\" (UID: \"40557eca-82bd-4ffc-9164-f813551371c0\") " pod="openshift-image-registry/node-ca-878j5"
Jul 22 04:33:12.474982 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.474918    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" event={"ID":"f9eae42e7d66416d6ea3b4d6c66b2c30","Type":"ContainerStarted","Data":"e61fc2f96c288853dd0cc4e208ae12a7dde97ba6ae845724f94c78af7c2adb8e"}
Jul 22 04:33:12.476328 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.476288    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" event={"ID":"29a3b8849e7de9826bbe69d4f142303f","Type":"ContainerStarted","Data":"b392ccfa2cbb77752ff183220fe9ccd0ffccdfb16127cb0739eb1b9eefcfab13"}
Jul 22 04:33:12.494721 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.494691    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45a0a41b-c046-4856-93ea-9e9e97d052c1-tmp\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.494878 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.494739    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.494878 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.494760    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-ovn-node-metrics-cert\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.494878 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.494814    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5bc6449a-edf4-4270-b1db-12524d4e34b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.494878 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.494839    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-run-netns\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.494878 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.494861    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-run-netns\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.494885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-var-lib-kubelet\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.494904    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-lib-modules\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.494923    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-tuned\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.494975    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-run-ovn-kubernetes\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495001    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5bc6449a-edf4-4270-b1db-12524d4e34b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495023    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-os-release\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495033    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-run-netns\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-multus-socket-dir-parent\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495072    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7rlw\" (UniqueName: \"kubernetes.io/projected/d6a93089-b6d0-4868-a3a4-0d7579905bbf-kube-api-access-n7rlw\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495099    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495109    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-slash\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495181    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-var-lib-cni-bin\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495206    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-var-lib-cni-multus\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.498966 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495264    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5bc6449a-edf4-4270-b1db-12524d4e34b0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495267    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-cni-netd\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495310    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-cni-netd\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495315    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/745f3211-0036-4c31-80ca-1513019ea800-agent-certs\") pod \"konnectivity-agent-2mglg\" (UID: \"745f3211-0036-4c31-80ca-1513019ea800\") " pod="kube-system/konnectivity-agent-2mglg"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495345    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-run-netns\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495344    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-sysctl-d\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495369    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-sys\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495385    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5bc6449a-edf4-4270-b1db-12524d4e34b0-cnibin\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495403    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bc6449a-edf4-4270-b1db-12524d4e34b0-system-cni-dir\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495449    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5bc6449a-edf4-4270-b1db-12524d4e34b0-os-release\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495466    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-sysctl-d\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495478    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5bc6449a-edf4-4270-b1db-12524d4e34b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495499    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495514    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xqmv\" (UniqueName: \"kubernetes.io/projected/45a0a41b-c046-4856-93ea-9e9e97d052c1-kube-api-access-2xqmv\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.499680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495530    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-systemd-units\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495559    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-etc-openvswitch\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495596    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/745f3211-0036-4c31-80ca-1513019ea800-konnectivity-ca\") pod \"konnectivity-agent-2mglg\" (UID: \"745f3211-0036-4c31-80ca-1513019ea800\") " pod="kube-system/konnectivity-agent-2mglg"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495626    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-multus-cni-dir\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495643    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-cni-binary-copy\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495658    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-multus-conf-dir\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495679    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-run-multus-certs\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495704    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-run\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-run-systemd\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495761    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-var-lib-openvswitch\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495779    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-node-log\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495800    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-sysconfig\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495823    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-sysctl-conf\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495889    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5bc6449a-edf4-4270-b1db-12524d4e34b0-os-release\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495918    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-run-ovn\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.500349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495966    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqk2c\" (UniqueName: \"kubernetes.io/projected/5bc6449a-edf4-4270-b1db-12524d4e34b0-kube-api-access-sqk2c\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495981    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-sysctl-conf\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.495995    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-system-cni-dir\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496030    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-multus-conf-dir\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496051    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-systemd\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496067    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-host\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496096    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-kubelet\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496118    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-env-overrides\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496136    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5bc6449a-edf4-4270-b1db-12524d4e34b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496167    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-lib-modules\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496171    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9xzw\" (UniqueName: \"kubernetes.io/projected/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-kube-api-access-l9xzw\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496208    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-var-lib-kubelet\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496233    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-run-openvswitch\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496259    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-ovnkube-config\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496285    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-ovnkube-script-lib\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.501046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496311    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd595fae-bda2-4a84-ae8c-e7b1cc3831f2-hosts-file\") pod \"node-resolver-j7gtj\" (UID: \"cd595fae-bda2-4a84-ae8c-e7b1cc3831f2\") " pod="openshift-dns/node-resolver-j7gtj"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496344    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcvwd\" (UniqueName: \"kubernetes.io/projected/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-kube-api-access-rcvwd\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496369    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-cnibin\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-run-k8s-cni-cncf-io\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496420    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-hostroot\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496432    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-run-multus-certs\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496447    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-modprobe-d\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496462    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-cni-binary-copy\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496474    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-run\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496473    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-kubernetes\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496508    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-log-socket\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496513    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-kubernetes\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496525    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-cni-bin\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496541    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd595fae-bda2-4a84-ae8c-e7b1cc3831f2-tmp-dir\") pod \"node-resolver-j7gtj\" (UID: \"cd595fae-bda2-4a84-ae8c-e7b1cc3831f2\") " pod="openshift-dns/node-resolver-j7gtj"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496049    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-system-cni-dir\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.501621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496637    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-slash\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496649    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-etc-kubernetes\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496675    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zbbg\" (UniqueName: \"kubernetes.io/projected/cd595fae-bda2-4a84-ae8c-e7b1cc3831f2-kube-api-access-6zbbg\") pod \"node-resolver-j7gtj\" (UID: \"cd595fae-bda2-4a84-ae8c-e7b1cc3831f2\") " pod="openshift-dns/node-resolver-j7gtj"
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496679    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-var-lib-cni-bin\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496691    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-multus-daemon-config\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496720    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-var-lib-cni-multus\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496763    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-sys\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496797    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5bc6449a-edf4-4270-b1db-12524d4e34b0-cnibin\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496839    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5bc6449a-edf4-4270-b1db-12524d4e34b0-system-cni-dir\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496873    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-run-ovn\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.496935    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5bc6449a-edf4-4270-b1db-12524d4e34b0-cni-binary-copy\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.497044    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.497109    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs podName:d6a93089-b6d0-4868-a3a4-0d7579905bbf nodeName:}" failed. No retries permitted until 2026-07-22 04:33:12.997093012 +0000 UTC m=+3.054930559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs") pod "network-metrics-daemon-bvrr4" (UID: "d6a93089-b6d0-4868-a3a4-0d7579905bbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497151    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-var-lib-kubelet\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.502267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497192    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-run-openvswitch\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497410    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd595fae-bda2-4a84-ae8c-e7b1cc3831f2-tmp-dir\") pod \"node-resolver-j7gtj\" (UID: \"cd595fae-bda2-4a84-ae8c-e7b1cc3831f2\") " pod="openshift-dns/node-resolver-j7gtj"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497502    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-sysconfig\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497502    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-cni-bin\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497558    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-systemd\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497595    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-hostroot\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497628    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-etc-openvswitch\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497597    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-systemd-units\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497646    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-os-release\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497664    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-run-k8s-cni-cncf-io\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497700    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-etc-kubernetes\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497751    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-ovnkube-config\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497787    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-multus-daemon-config\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497851    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-cnibin\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497968    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-modprobe-d\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.502955 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497564    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-log-socket\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498003    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-host-var-lib-kubelet\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498030    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-multus-cni-dir\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498044    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-kubelet\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498086    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45a0a41b-c046-4856-93ea-9e9e97d052c1-host\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498093    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5bc6449a-edf4-4270-b1db-12524d4e34b0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498133    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-node-log\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497559    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-host-run-ovn-kubernetes\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498212    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-ovn-node-metrics-cert\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498250    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-multus-socket-dir-parent\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498328    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-run-systemd\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498330    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-ovnkube-script-lib\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498364    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd595fae-bda2-4a84-ae8c-e7b1cc3831f2-hosts-file\") pod \"node-resolver-j7gtj\" (UID: \"cd595fae-bda2-4a84-ae8c-e7b1cc3831f2\") " pod="openshift-dns/node-resolver-j7gtj"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.497589    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-var-lib-openvswitch\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498615    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-env-overrides\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.503652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498627    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5bc6449a-edf4-4270-b1db-12524d4e34b0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.504345 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.498892    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/745f3211-0036-4c31-80ca-1513019ea800-konnectivity-ca\") pod \"konnectivity-agent-2mglg\" (UID: \"745f3211-0036-4c31-80ca-1513019ea800\") " pod="kube-system/konnectivity-agent-2mglg"
Jul 22 04:33:12.504345 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.500183    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45a0a41b-c046-4856-93ea-9e9e97d052c1-etc-tuned\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.504345 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.500560    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45a0a41b-c046-4856-93ea-9e9e97d052c1-tmp\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.504345 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.501078    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/745f3211-0036-4c31-80ca-1513019ea800-agent-certs\") pod \"konnectivity-agent-2mglg\" (UID: \"745f3211-0036-4c31-80ca-1513019ea800\") " pod="kube-system/konnectivity-agent-2mglg"
Jul 22 04:33:12.508680 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.508642    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9xzw\" (UniqueName: \"kubernetes.io/projected/9aa99ea5-9ae1-4f47-9de0-2428f924d68b-kube-api-access-l9xzw\") pod \"multus-clv6p\" (UID: \"9aa99ea5-9ae1-4f47-9de0-2428f924d68b\") " pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.510477 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.510435    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zbbg\" (UniqueName: \"kubernetes.io/projected/cd595fae-bda2-4a84-ae8c-e7b1cc3831f2-kube-api-access-6zbbg\") pod \"node-resolver-j7gtj\" (UID: \"cd595fae-bda2-4a84-ae8c-e7b1cc3831f2\") " pod="openshift-dns/node-resolver-j7gtj"
Jul 22 04:33:12.510574 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.510513    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7rlw\" (UniqueName: \"kubernetes.io/projected/d6a93089-b6d0-4868-a3a4-0d7579905bbf-kube-api-access-n7rlw\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:12.510574 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.510520    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcvwd\" (UniqueName: \"kubernetes.io/projected/e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9-kube-api-access-rcvwd\") pod \"ovnkube-node-bq76r\" (UID: \"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9\") " pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.511552 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.511504    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqk2c\" (UniqueName: \"kubernetes.io/projected/5bc6449a-edf4-4270-b1db-12524d4e34b0-kube-api-access-sqk2c\") pod \"multus-additional-cni-plugins-h9h8p\" (UID: \"5bc6449a-edf4-4270-b1db-12524d4e34b0\") " pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.512308 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.512266    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xqmv\" (UniqueName: \"kubernetes.io/projected/45a0a41b-c046-4856-93ea-9e9e97d052c1-kube-api-access-2xqmv\") pod \"tuned-glmcg\" (UID: \"45a0a41b-c046-4856-93ea-9e9e97d052c1\") " pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.584320 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.584290    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj"
Jul 22 04:33:12.595347 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.595320    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-878j5"
Jul 22 04:33:12.604974 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.604913    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-njldw"
Jul 22 04:33:12.612542 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.612524    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h9h8p"
Jul 22 04:33:12.619042 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.619017    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-glmcg"
Jul 22 04:33:12.626601 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.626585    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-clv6p"
Jul 22 04:33:12.640319 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.640302    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:12.646961 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.646929    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2mglg"
Jul 22 04:33:12.652512 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.652492    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7gtj"
Jul 22 04:33:12.899410 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.899329    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:12.899410 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:12.899391    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgxgl\" (UniqueName: \"kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl\") pod \"network-check-target-pbxk8\" (UID: \"07924526-aed8-4def-85f1-3298f15b128a\") " pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:12.899571 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.899491    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:12.899571 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.899503    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:33:12.899571 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.899517    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:33:12.899571 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.899526    2584 projected.go:196] Error preparing data for projected volume kube-api-access-pgxgl for pod openshift-network-diagnostics/network-check-target-pbxk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:12.899571 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.899562    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret podName:d5ab223e-0556-4987-88a3-828fe304d34d nodeName:}" failed. No retries permitted until 2026-07-22 04:33:13.899540313 +0000 UTC m=+3.957377853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret") pod "global-pull-secret-syncer-sglqd" (UID: "d5ab223e-0556-4987-88a3-828fe304d34d") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:12.899726 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:12.899578    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl podName:07924526-aed8-4def-85f1-3298f15b128a nodeName:}" failed. No retries permitted until 2026-07-22 04:33:13.89957148 +0000 UTC m=+3.957409019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pgxgl" (UniqueName: "kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl") pod "network-check-target-pbxk8" (UID: "07924526-aed8-4def-85f1-3298f15b128a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:13.000317 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:13.000277    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:13.000508 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:13.000453    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:13.000570 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:13.000529    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs podName:d6a93089-b6d0-4868-a3a4-0d7579905bbf nodeName:}" failed. No retries permitted until 2026-07-22 04:33:14.000509561 +0000 UTC m=+4.058347128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs") pod "network-metrics-daemon-bvrr4" (UID: "d6a93089-b6d0-4868-a3a4-0d7579905bbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:13.316435 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:13.316349    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 04:28:12 +0000 UTC" deadline="2028-04-26 17:39:50.96708408 +0000 UTC"
Jul 22 04:33:13.316435 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:13.316375    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15469h6m37.650712874s"
Jul 22 04:33:13.471181 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:13.471147    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:13.471700 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:13.471256    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:13.548186 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:13.547907    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577edbbc_caa1_4e06_bc1f_ea1536757ab3.slice/crio-1955e70a7e43b7df75cc521b74621b61c59abfdd64cdcbe786bd5c3cad8d8eb3 WatchSource:0}: Error finding container 1955e70a7e43b7df75cc521b74621b61c59abfdd64cdcbe786bd5c3cad8d8eb3: Status 404 returned error can't find the container with id 1955e70a7e43b7df75cc521b74621b61c59abfdd64cdcbe786bd5c3cad8d8eb3
Jul 22 04:33:13.551706 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:13.551651    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd595fae_bda2_4a84_ae8c_e7b1cc3831f2.slice/crio-6c12cef278cb42638faae97e3e3e5550ea0b1448985e643914da5562f2fde76b WatchSource:0}: Error finding container 6c12cef278cb42638faae97e3e3e5550ea0b1448985e643914da5562f2fde76b: Status 404 returned error can't find the container with id 6c12cef278cb42638faae97e3e3e5550ea0b1448985e643914da5562f2fde76b
Jul 22 04:33:13.552479 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:13.552457    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40557eca_82bd_4ffc_9164_f813551371c0.slice/crio-4786af5c3c889cc53ba800c4489faf6a529e5220ec93c50f0f5f547bb8029fa8 WatchSource:0}: Error finding container 4786af5c3c889cc53ba800c4489faf6a529e5220ec93c50f0f5f547bb8029fa8: Status 404 returned error can't find the container with id 4786af5c3c889cc53ba800c4489faf6a529e5220ec93c50f0f5f547bb8029fa8
Jul 22 04:33:13.553556 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:13.553383    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc6449a_edf4_4270_b1db_12524d4e34b0.slice/crio-e3572a93e6daa9ed3a22c01c6ee54ef3a344d5d620c1ce5bbd776cb5477033f2 WatchSource:0}: Error finding container e3572a93e6daa9ed3a22c01c6ee54ef3a344d5d620c1ce5bbd776cb5477033f2: Status 404 returned error can't find the container with id e3572a93e6daa9ed3a22c01c6ee54ef3a344d5d620c1ce5bbd776cb5477033f2
Jul 22 04:33:13.554610 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:13.554582    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aa99ea5_9ae1_4f47_9de0_2428f924d68b.slice/crio-ab8b327108f8bb09913da7fa2d2a559d15d5533154c78b4e43fc9f220ca0858e WatchSource:0}: Error finding container ab8b327108f8bb09913da7fa2d2a559d15d5533154c78b4e43fc9f220ca0858e: Status 404 returned error can't find the container with id ab8b327108f8bb09913da7fa2d2a559d15d5533154c78b4e43fc9f220ca0858e
Jul 22 04:33:13.555895 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:13.555486    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4485896_ebec_44bb_8968_c8bd66ba4496.slice/crio-10a263aaf34b760bbbff8364d02c893dae3a6a2270b09a2908cfc430d93a00b1 WatchSource:0}: Error finding container 10a263aaf34b760bbbff8364d02c893dae3a6a2270b09a2908cfc430d93a00b1: Status 404 returned error can't find the container with id 10a263aaf34b760bbbff8364d02c893dae3a6a2270b09a2908cfc430d93a00b1
Jul 22 04:33:13.557357 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:13.556265    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45a0a41b_c046_4856_93ea_9e9e97d052c1.slice/crio-22f50d1c1491084591edaae37ef6531086cdf0b995d811d382f8e57cf2f4879f WatchSource:0}: Error finding container 22f50d1c1491084591edaae37ef6531086cdf0b995d811d382f8e57cf2f4879f: Status 404 returned error can't find the container with id 22f50d1c1491084591edaae37ef6531086cdf0b995d811d382f8e57cf2f4879f
Jul 22 04:33:13.557475 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:13.557368    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod745f3211_0036_4c31_80ca_1513019ea800.slice/crio-bd4b87fd50ae6f3b34db36669e8f63f02adb8abd75fa34a9c2bf99efb930c9a6 WatchSource:0}: Error finding container bd4b87fd50ae6f3b34db36669e8f63f02adb8abd75fa34a9c2bf99efb930c9a6: Status 404 returned error can't find the container with id bd4b87fd50ae6f3b34db36669e8f63f02adb8abd75fa34a9c2bf99efb930c9a6
Jul 22 04:33:13.559958 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:13.559926    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ca7799_efc9_4b5e_bfa9_2b01703dcdd9.slice/crio-62d12e9aa3df9837fd63b7300d223f90228bfa4daecb89c31aef159eb2139794 WatchSource:0}: Error finding container 62d12e9aa3df9837fd63b7300d223f90228bfa4daecb89c31aef159eb2139794: Status 404 returned error can't find the container with id 62d12e9aa3df9837fd63b7300d223f90228bfa4daecb89c31aef159eb2139794
Jul 22 04:33:13.762457 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:13.762295    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 22 04:33:13.907081 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:13.906978    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgxgl\" (UniqueName: \"kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl\") pod \"network-check-target-pbxk8\" (UID: \"07924526-aed8-4def-85f1-3298f15b128a\") " pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:13.907081 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:13.907022    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:13.907289 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:13.907146    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:13.907289 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:13.907172    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:33:13.907289 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:13.907195    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:33:13.907289 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:13.907207    2584 projected.go:196] Error preparing data for projected volume kube-api-access-pgxgl for pod openshift-network-diagnostics/network-check-target-pbxk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:13.907289 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:13.907252    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret podName:d5ab223e-0556-4987-88a3-828fe304d34d nodeName:}" failed. No retries permitted until 2026-07-22 04:33:15.907196512 +0000 UTC m=+5.965034052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret") pod "global-pull-secret-syncer-sglqd" (UID: "d5ab223e-0556-4987-88a3-828fe304d34d") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:13.907289 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:13.907270    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl podName:07924526-aed8-4def-85f1-3298f15b128a nodeName:}" failed. No retries permitted until 2026-07-22 04:33:15.907260861 +0000 UTC m=+5.965098405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pgxgl" (UniqueName: "kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl") pod "network-check-target-pbxk8" (UID: "07924526-aed8-4def-85f1-3298f15b128a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:14.008740 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.008213    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:14.008740 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:14.008351    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:14.008740 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:14.008411    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs podName:d6a93089-b6d0-4868-a3a4-0d7579905bbf nodeName:}" failed. No retries permitted until 2026-07-22 04:33:16.008393392 +0000 UTC m=+6.066230934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs") pod "network-metrics-daemon-bvrr4" (UID: "d6a93089-b6d0-4868-a3a4-0d7579905bbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:14.317314 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.317172    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 04:28:12 +0000 UTC" deadline="2028-01-06 12:24:48.44189328 +0000 UTC"
Jul 22 04:33:14.317314 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.317234    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12799h51m34.124663399s"
Jul 22 04:33:14.472531 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.472055    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:14.472531 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:14.472179    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:14.473558 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.473394    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:14.473558 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:14.473518    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:14.504442 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.504331    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9h8p" event={"ID":"5bc6449a-edf4-4270-b1db-12524d4e34b0","Type":"ContainerStarted","Data":"e3572a93e6daa9ed3a22c01c6ee54ef3a344d5d620c1ce5bbd776cb5477033f2"}
Jul 22 04:33:14.520058 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.519900    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-njldw" event={"ID":"577edbbc-caa1-4e06-bc1f-ea1536757ab3","Type":"ContainerStarted","Data":"1955e70a7e43b7df75cc521b74621b61c59abfdd64cdcbe786bd5c3cad8d8eb3"}
Jul 22 04:33:14.536003 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.535395    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" event={"ID":"f9eae42e7d66416d6ea3b4d6c66b2c30","Type":"ContainerStarted","Data":"312072bc8c0769d34fd6b45cab6951f564249ccdea04df3c511c0b1ed4672108"}
Jul 22 04:33:14.551933 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.551877    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-249.ec2.internal" podStartSLOduration=3.55185768 podStartE2EDuration="3.55185768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:14.55079549 +0000 UTC m=+4.608633055" watchObservedRunningTime="2026-07-22 04:33:14.55185768 +0000 UTC m=+4.609695242"
Jul 22 04:33:14.555906 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.555875    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-glmcg" event={"ID":"45a0a41b-c046-4856-93ea-9e9e97d052c1","Type":"ContainerStarted","Data":"22f50d1c1491084591edaae37ef6531086cdf0b995d811d382f8e57cf2f4879f"}
Jul 22 04:33:14.562185 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.562096    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj" event={"ID":"e4485896-ebec-44bb-8968-c8bd66ba4496","Type":"ContainerStarted","Data":"10a263aaf34b760bbbff8364d02c893dae3a6a2270b09a2908cfc430d93a00b1"}
Jul 22 04:33:14.572364 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.572240    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-clv6p" event={"ID":"9aa99ea5-9ae1-4f47-9de0-2428f924d68b","Type":"ContainerStarted","Data":"ab8b327108f8bb09913da7fa2d2a559d15d5533154c78b4e43fc9f220ca0858e"}
Jul 22 04:33:14.574191 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.574082    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-878j5" event={"ID":"40557eca-82bd-4ffc-9164-f813551371c0","Type":"ContainerStarted","Data":"4786af5c3c889cc53ba800c4489faf6a529e5220ec93c50f0f5f547bb8029fa8"}
Jul 22 04:33:14.576493 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.576426    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7gtj" event={"ID":"cd595fae-bda2-4a84-ae8c-e7b1cc3831f2","Type":"ContainerStarted","Data":"6c12cef278cb42638faae97e3e3e5550ea0b1448985e643914da5562f2fde76b"}
Jul 22 04:33:14.581152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.580360    2584 generic.go:356] "Generic (PLEG): container finished" podID="29a3b8849e7de9826bbe69d4f142303f" containerID="b92423527ee73b4b68ea991a1a30c296d6ad9612233e593f5d2a3f7ce92afbaf" exitCode=0
Jul 22 04:33:14.581152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.580456    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" event={"ID":"29a3b8849e7de9826bbe69d4f142303f","Type":"ContainerDied","Data":"b92423527ee73b4b68ea991a1a30c296d6ad9612233e593f5d2a3f7ce92afbaf"}
Jul 22 04:33:14.589298 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.589211    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r" event={"ID":"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9","Type":"ContainerStarted","Data":"62d12e9aa3df9837fd63b7300d223f90228bfa4daecb89c31aef159eb2139794"}
Jul 22 04:33:14.591793 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:14.591731    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mglg" event={"ID":"745f3211-0036-4c31-80ca-1513019ea800","Type":"ContainerStarted","Data":"bd4b87fd50ae6f3b34db36669e8f63f02adb8abd75fa34a9c2bf99efb930c9a6"}
Jul 22 04:33:15.471719 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:15.471244    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:15.471719 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:15.471368    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:15.614091 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:15.614011    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" event={"ID":"29a3b8849e7de9826bbe69d4f142303f","Type":"ContainerStarted","Data":"a3454e704eda9dcd88b085d7032542dc970369d4291afbe9c31446dd34deeebe"}
Jul 22 04:33:15.929614 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:15.929525    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgxgl\" (UniqueName: \"kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl\") pod \"network-check-target-pbxk8\" (UID: \"07924526-aed8-4def-85f1-3298f15b128a\") " pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:15.929614 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:15.929577    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:15.929865 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:15.929739    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:15.929865 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:15.929800    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret podName:d5ab223e-0556-4987-88a3-828fe304d34d nodeName:}" failed. No retries permitted until 2026-07-22 04:33:19.929781499 +0000 UTC m=+9.987619037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret") pod "global-pull-secret-syncer-sglqd" (UID: "d5ab223e-0556-4987-88a3-828fe304d34d") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:15.930227 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:15.930209    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:33:15.930310 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:15.930233    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:33:15.930310 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:15.930247    2584 projected.go:196] Error preparing data for projected volume kube-api-access-pgxgl for pod openshift-network-diagnostics/network-check-target-pbxk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:15.930310 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:15.930292    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl podName:07924526-aed8-4def-85f1-3298f15b128a nodeName:}" failed. No retries permitted until 2026-07-22 04:33:19.930277778 +0000 UTC m=+9.988115334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pgxgl" (UniqueName: "kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl") pod "network-check-target-pbxk8" (UID: "07924526-aed8-4def-85f1-3298f15b128a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:16.030815 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:16.030744    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:16.031026 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:16.030892    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:16.031026 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:16.030975    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs podName:d6a93089-b6d0-4868-a3a4-0d7579905bbf nodeName:}" failed. No retries permitted until 2026-07-22 04:33:20.030954903 +0000 UTC m=+10.088792457 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs") pod "network-metrics-daemon-bvrr4" (UID: "d6a93089-b6d0-4868-a3a4-0d7579905bbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:16.484016 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:16.483503    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:16.484016 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:16.483503    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:16.484016 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:16.483651    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:16.484016 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:16.483702    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:17.470985 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:17.470951    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:17.471434 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:17.471086    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:18.474624 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:18.474595    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:18.475067 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:18.474739    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:18.475067 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:18.474808    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:18.475067 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:18.474932    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:19.471178 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:19.471144    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:19.471379 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:19.471267    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:19.966806 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:19.966720    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgxgl\" (UniqueName: \"kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl\") pod \"network-check-target-pbxk8\" (UID: \"07924526-aed8-4def-85f1-3298f15b128a\") " pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:19.966806 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:19.966771    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:19.967316 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:19.966933    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:19.967316 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:19.967011    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret podName:d5ab223e-0556-4987-88a3-828fe304d34d nodeName:}" failed. No retries permitted until 2026-07-22 04:33:27.966992213 +0000 UTC m=+18.024829754 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret") pod "global-pull-secret-syncer-sglqd" (UID: "d5ab223e-0556-4987-88a3-828fe304d34d") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:19.967441 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:19.967426    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:33:19.967493 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:19.967445    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:33:19.967493 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:19.967457    2584 projected.go:196] Error preparing data for projected volume kube-api-access-pgxgl for pod openshift-network-diagnostics/network-check-target-pbxk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:19.967588 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:19.967504    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl podName:07924526-aed8-4def-85f1-3298f15b128a nodeName:}" failed. No retries permitted until 2026-07-22 04:33:27.967489157 +0000 UTC m=+18.025326699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pgxgl" (UniqueName: "kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl") pod "network-check-target-pbxk8" (UID: "07924526-aed8-4def-85f1-3298f15b128a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:20.068219 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:20.068168    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:20.068385 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:20.068323    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:20.068425 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:20.068391    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs podName:d6a93089-b6d0-4868-a3a4-0d7579905bbf nodeName:}" failed. No retries permitted until 2026-07-22 04:33:28.068370564 +0000 UTC m=+18.126208106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs") pod "network-metrics-daemon-bvrr4" (UID: "d6a93089-b6d0-4868-a3a4-0d7579905bbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:20.471929 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:20.471482    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:20.471929 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:20.471603    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:20.471929 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:20.471727    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:20.471929 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:20.471830    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:21.470456 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:21.470335    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:21.470888 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:21.470468    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:22.470540 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:22.470504    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:22.471019 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:22.470644    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:22.471097 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:22.471049    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:22.471192 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:22.471156    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:23.470738 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:23.470703    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:23.471187 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:23.470838    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:24.470847 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:24.470810    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:24.471317 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:24.470819    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:24.471317 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:24.470966    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:24.471317 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:24.471060    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:25.471230 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:25.471198    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:25.471693 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:25.471311    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:26.470928 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:26.470894    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:26.471103 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:26.470900    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:26.471103 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:26.471021    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:26.471103 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:26.471095    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:27.471124 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:27.471090    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:27.471566 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:27.471220    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:28.029853 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:28.029813    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgxgl\" (UniqueName: \"kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl\") pod \"network-check-target-pbxk8\" (UID: \"07924526-aed8-4def-85f1-3298f15b128a\") " pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:28.029853 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:28.029859    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:28.030096 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:28.029984    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:28.030096 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:28.030034    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:33:28.030096 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:28.030051    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret podName:d5ab223e-0556-4987-88a3-828fe304d34d nodeName:}" failed. No retries permitted until 2026-07-22 04:33:44.030033766 +0000 UTC m=+34.087871305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret") pod "global-pull-secret-syncer-sglqd" (UID: "d5ab223e-0556-4987-88a3-828fe304d34d") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:28.030096 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:28.030061    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:33:28.030096 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:28.030073    2584 projected.go:196] Error preparing data for projected volume kube-api-access-pgxgl for pod openshift-network-diagnostics/network-check-target-pbxk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:28.030338 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:28.030112    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl podName:07924526-aed8-4def-85f1-3298f15b128a nodeName:}" failed. No retries permitted until 2026-07-22 04:33:44.030100429 +0000 UTC m=+34.087937969 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pgxgl" (UniqueName: "kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl") pod "network-check-target-pbxk8" (UID: "07924526-aed8-4def-85f1-3298f15b128a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:28.131027 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:28.130989    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:28.131172 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:28.131107    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:28.131172 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:28.131165    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs podName:d6a93089-b6d0-4868-a3a4-0d7579905bbf nodeName:}" failed. No retries permitted until 2026-07-22 04:33:44.131148668 +0000 UTC m=+34.188986210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs") pod "network-metrics-daemon-bvrr4" (UID: "d6a93089-b6d0-4868-a3a4-0d7579905bbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:28.471150 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:28.471073    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:28.471563 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:28.471207    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:28.471563 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:28.471275    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:28.471563 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:28.471396    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:29.470594 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:29.470558    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:29.470752 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:29.470690    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:30.472008 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:30.471958    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:30.472458 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:30.472054    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:30.472458 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:30.472081    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:30.472458 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:30.472181    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:31.471130 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:31.471098    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:31.471319 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:31.471224    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:32.471608 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.471304    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:32.472253 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.471371    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:32.472253 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:32.471700    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:32.472253 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:32.471758    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:32.650408 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.650377    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-878j5" event={"ID":"40557eca-82bd-4ffc-9164-f813551371c0","Type":"ContainerStarted","Data":"e523967366100c6bcdd1d5e3f24d4712cc6fc3e8036aa9f9684f0539a752bfa0"}
Jul 22 04:33:32.653558 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.653528    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7gtj" event={"ID":"cd595fae-bda2-4a84-ae8c-e7b1cc3831f2","Type":"ContainerStarted","Data":"cee1434626716d8416079cfb513674003f76e2bc63838779472eb0260c67238c"}
Jul 22 04:33:32.657091 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.657067    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r" event={"ID":"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9","Type":"ContainerStarted","Data":"238f30ffad5cfb64d1c06f76f2669049682ba3aef67637388022b05ae8458272"}
Jul 22 04:33:32.657202 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.657138    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r" event={"ID":"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9","Type":"ContainerStarted","Data":"85174b344d642e2387d044ed2d8a94e9e298b78cdfc0d4a0747c887bd75dbf52"}
Jul 22 04:33:32.657202 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.657187    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r" event={"ID":"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9","Type":"ContainerStarted","Data":"930b7a3d80200a429a82a91ce236f95b2c36c9af53c39e3736bc09b8f6b3bd69"}
Jul 22 04:33:32.657309 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.657236    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r" event={"ID":"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9","Type":"ContainerStarted","Data":"eb760b9d85dc8bfd591ac1ba7c72135ee0044012f553b8b385ab536d6de1ea7b"}
Jul 22 04:33:32.657309 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.657284    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r" event={"ID":"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9","Type":"ContainerStarted","Data":"0eaa3603284196b32c0c57c1a2623f13b425ec4537e1a1d23785e249db1c68e7"}
Jul 22 04:33:32.658585 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.658555    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2mglg" event={"ID":"745f3211-0036-4c31-80ca-1513019ea800","Type":"ContainerStarted","Data":"c5e21fd166e9ee6316b03915b0c3d5af1234969d04fe87039eb7c524cc202d52"}
Jul 22 04:33:32.660218 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.660194    2584 generic.go:356] "Generic (PLEG): container finished" podID="5bc6449a-edf4-4270-b1db-12524d4e34b0" containerID="f7b05b37b46837e3be6839ee457c9c08fbeb8e75c6e9845348e1c3da4ac91663" exitCode=0
Jul 22 04:33:32.660331 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.660273    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9h8p" event={"ID":"5bc6449a-edf4-4270-b1db-12524d4e34b0","Type":"ContainerDied","Data":"f7b05b37b46837e3be6839ee457c9c08fbeb8e75c6e9845348e1c3da4ac91663"}
Jul 22 04:33:32.662213 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.662191    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-glmcg" event={"ID":"45a0a41b-c046-4856-93ea-9e9e97d052c1","Type":"ContainerStarted","Data":"c98d63dd69787d8cefe2bfcfbe15d3ea063f1f187e4afd2875a6fdeb01373a8e"}
Jul 22 04:33:32.664131 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.664097    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj" event={"ID":"e4485896-ebec-44bb-8968-c8bd66ba4496","Type":"ContainerStarted","Data":"56b11ae2f32ab6cddf2adeea77d97f75a6d115bae561a07c4e64475952da9f8d"}
Jul 22 04:33:32.665438 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.665396    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-249.ec2.internal" podStartSLOduration=21.665380578 podStartE2EDuration="21.665380578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:33:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:15.631149495 +0000 UTC m=+5.688987059" watchObservedRunningTime="2026-07-22 04:33:32.665380578 +0000 UTC m=+22.723218140"
Jul 22 04:33:32.666349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.666323    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-clv6p" event={"ID":"9aa99ea5-9ae1-4f47-9de0-2428f924d68b","Type":"ContainerStarted","Data":"db32a13eaf225dced10a13df8d66500c3bb88be60fc3f8f284f1994de9e25c96"}
Jul 22 04:33:32.692740 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.692692    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-878j5" podStartSLOduration=4.243228488 podStartE2EDuration="22.692678744s" totalImagesPullingTime="18.449450256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:32.665046236 +0000 UTC m=+22.722883797" watchObservedRunningTime="2026-07-22 04:33:32.692678744 +0000 UTC m=+22.750516304"
Jul 22 04:33:32.708485 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.708449    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-glmcg" podStartSLOduration=4.238245247 podStartE2EDuration="22.708436651s" totalImagesPullingTime="18.470191404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:32.708085342 +0000 UTC m=+22.765922904" watchObservedRunningTime="2026-07-22 04:33:32.708436651 +0000 UTC m=+22.766274211"
Jul 22 04:33:32.721899 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.721853    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2mglg" podStartSLOduration=8.669330393 podStartE2EDuration="22.721835166s" totalImagesPullingTime="14.052504773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:32.72158024 +0000 UTC m=+22.779417801" watchObservedRunningTime="2026-07-22 04:33:32.721835166 +0000 UTC m=+22.779672926"
Jul 22 04:33:32.735706 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.735660    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j7gtj" podStartSLOduration=4.284590201 podStartE2EDuration="22.735642511s" totalImagesPullingTime="18.45105231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:32.735335114 +0000 UTC m=+22.793172693" watchObservedRunningTime="2026-07-22 04:33:32.735642511 +0000 UTC m=+22.793480073"
Jul 22 04:33:32.753751 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.753707    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-clv6p" podStartSLOduration=4.253918122 podStartE2EDuration="22.753694865s" totalImagesPullingTime="18.499776743s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:32.753390118 +0000 UTC m=+22.811227698" watchObservedRunningTime="2026-07-22 04:33:32.753694865 +0000 UTC m=+22.811532405"
Jul 22 04:33:32.977313 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.977243    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2mglg"
Jul 22 04:33:32.977708 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:32.977692    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2mglg"
Jul 22 04:33:33.398341 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:33.398315    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 22 04:33:33.470428 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:33.470385    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:33.470600 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:33.470529    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:33.672389 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:33.672312    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r" event={"ID":"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9","Type":"ContainerStarted","Data":"846b68ea56b193ef533cee7008b9df522ae0678dbdacb6fed8c08092aefa5086"}
Jul 22 04:33:33.673902 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:33.673874    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-njldw" event={"ID":"577edbbc-caa1-4e06-bc1f-ea1536757ab3","Type":"ContainerStarted","Data":"58f7b5bc9a72cb7c3ce4693b8dc2ae3112d8759f8e7169c77a6e69aec4ba5366"}
Jul 22 04:33:33.675909 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:33.675881    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj" event={"ID":"e4485896-ebec-44bb-8968-c8bd66ba4496","Type":"ContainerStarted","Data":"8a2b879c678f40ce4e01cc4326a298a49571ecb19aadf99cc994b4665cc697ea"}
Jul 22 04:33:33.676601 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:33.676581    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2mglg"
Jul 22 04:33:33.676737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:33.676639    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2mglg"
Jul 22 04:33:33.699760 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:33.699699    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-njldw" podStartSLOduration=5.246260381 podStartE2EDuration="23.699681113s" totalImagesPullingTime="18.453420732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:33.687374712 +0000 UTC m=+23.745212273" watchObservedRunningTime="2026-07-22 04:33:33.699681113 +0000 UTC m=+23.757518675"
Jul 22 04:33:34.355632 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:34.355535    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T04:33:33.398338622Z","UUID":"59fd1ed2-b136-4675-a9a8-1ccdaa920e1c","Handler":null,"Name":"","Endpoint":""}
Jul 22 04:33:34.357046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:34.357027    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 22 04:33:34.357160 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:34.357063    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 22 04:33:34.472325 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:34.472293    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:34.472472 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:34.472293    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:34.472472 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:34.472426    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:34.472570 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:34.472506    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:34.679862 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:34.679770    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj" event={"ID":"e4485896-ebec-44bb-8968-c8bd66ba4496","Type":"ContainerStarted","Data":"71858c0cee87e5ef28ff70940dfa21f3f89e6d8c69f859bd8579cabe28484612"}
Jul 22 04:33:34.697375 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:34.697332    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8hpnj" podStartSLOduration=4.133518005 podStartE2EDuration="24.697316497s" totalImagesPullingTime="20.563798492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:33:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:34.696548061 +0000 UTC m=+24.754385635" watchObservedRunningTime="2026-07-22 04:33:34.697316497 +0000 UTC m=+24.755154057"
Jul 22 04:33:35.471001 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:35.470768    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:35.471187 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:35.471095    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:35.686149 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:35.686101    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r" event={"ID":"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9","Type":"ContainerStarted","Data":"3770a3b4e5a4e2646743d074a05660de45962201f8be00621ac1ac0ff62df50d"}
Jul 22 04:33:36.470511 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:36.470475    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:36.470738 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:36.470600    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:36.470738 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:36.470642    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:36.470855 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:36.470733    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:37.471177 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:37.471007    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:37.471810 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:37.471256    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:37.699125 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:37.699059    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r" event={"ID":"e4ca7799-efc9-4b5e-bfa9-2b01703dcdd9","Type":"ContainerStarted","Data":"f0e92eca9cf1bbefb172a381a6bf44c02ccf93827dadb8b4b784dc0cf9df7271"}
Jul 22 04:33:37.699597 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:37.699330    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:37.699597 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:37.699394    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:37.701094 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:37.701068    2584 generic.go:356] "Generic (PLEG): container finished" podID="5bc6449a-edf4-4270-b1db-12524d4e34b0" containerID="b5ddbbc4930b9bd98f6ad665998242de096effeffdc50dc6bbb64544ab7022a2" exitCode=0
Jul 22 04:33:37.701217 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:37.701121    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9h8p" event={"ID":"5bc6449a-edf4-4270-b1db-12524d4e34b0","Type":"ContainerDied","Data":"b5ddbbc4930b9bd98f6ad665998242de096effeffdc50dc6bbb64544ab7022a2"}
Jul 22 04:33:37.715857 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:37.715839    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:37.726224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:37.726160    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r" podStartSLOduration=9.218787561 podStartE2EDuration="27.726146849s" totalImagesPullingTime="18.507359288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:37.726076011 +0000 UTC m=+27.783913572" watchObservedRunningTime="2026-07-22 04:33:37.726146849 +0000 UTC m=+27.783984409"
Jul 22 04:33:38.470317 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:38.470285    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:38.470515 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:38.470298    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:38.470515 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:38.470415    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:38.470515 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:38.470492    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:38.705771 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:38.705737    2584 generic.go:356] "Generic (PLEG): container finished" podID="5bc6449a-edf4-4270-b1db-12524d4e34b0" containerID="75eedd62d0299fed4a6dbd0aa309c7cfeb51b49637b6cea61f0fc35e26af5c35" exitCode=0
Jul 22 04:33:38.706304 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:38.705861    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9h8p" event={"ID":"5bc6449a-edf4-4270-b1db-12524d4e34b0","Type":"ContainerDied","Data":"75eedd62d0299fed4a6dbd0aa309c7cfeb51b49637b6cea61f0fc35e26af5c35"}
Jul 22 04:33:38.706621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:38.706468    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:38.724719 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:38.724689    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:33:38.978521 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:38.978442    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sglqd"]
Jul 22 04:33:38.978722 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:38.978564    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:38.978722 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:38.978644    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:38.981422 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:38.981391    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pbxk8"]
Jul 22 04:33:38.981551 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:38.981502    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:38.981628 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:38.981606    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:38.982125 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:38.982102    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bvrr4"]
Jul 22 04:33:38.982247 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:38.982200    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:38.982310 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:38.982276    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:40.471643 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:40.471612    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:40.472084 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:40.472051    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:40.472147 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:40.472133    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:40.474520 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:40.472271    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:40.474520 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:40.472281    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:40.474520 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:40.472413    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:40.712842 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:40.712810    2584 generic.go:356] "Generic (PLEG): container finished" podID="5bc6449a-edf4-4270-b1db-12524d4e34b0" containerID="3d29b727592b54628bd639b6c8c19bd58b52d4139ba8c5c35be3052bbf59fd02" exitCode=0
Jul 22 04:33:40.713041 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:40.712871    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9h8p" event={"ID":"5bc6449a-edf4-4270-b1db-12524d4e34b0","Type":"ContainerDied","Data":"3d29b727592b54628bd639b6c8c19bd58b52d4139ba8c5c35be3052bbf59fd02"}
Jul 22 04:33:42.470537 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:42.470501    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:42.470537 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:42.470521    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:42.471346 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:42.470638    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:42.471346 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:42.470808    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:42.471346 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:42.470691    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:42.471346 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:42.470927    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:43.752576 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:43.752538    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:43.828794 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:43.828749    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:43.929280 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:43.929239    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:44.052753 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.052666    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgxgl\" (UniqueName: \"kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl\") pod \"network-check-target-pbxk8\" (UID: \"07924526-aed8-4def-85f1-3298f15b128a\") " pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:44.052753 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.052714    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:44.053004 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:44.052860    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 22 04:33:44.053004 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:44.052869    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:44.053004 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:44.052890    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 22 04:33:44.053004 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:44.052906    2584 projected.go:196] Error preparing data for projected volume kube-api-access-pgxgl for pod openshift-network-diagnostics/network-check-target-pbxk8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:44.053004 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:44.052931    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret podName:d5ab223e-0556-4987-88a3-828fe304d34d nodeName:}" failed. No retries permitted until 2026-07-22 04:34:16.05291646 +0000 UTC m=+66.110753999 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret") pod "global-pull-secret-syncer-sglqd" (UID: "d5ab223e-0556-4987-88a3-828fe304d34d") : object "kube-system"/"original-pull-secret" not registered
Jul 22 04:33:44.053004 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:44.052972    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl podName:07924526-aed8-4def-85f1-3298f15b128a nodeName:}" failed. No retries permitted until 2026-07-22 04:34:16.0529559 +0000 UTC m=+66.110793443 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pgxgl" (UniqueName: "kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl") pod "network-check-target-pbxk8" (UID: "07924526-aed8-4def-85f1-3298f15b128a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 22 04:33:44.153649 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.153607    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:44.153843 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:44.153760    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:44.153843 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:44.153829    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs podName:d6a93089-b6d0-4868-a3a4-0d7579905bbf nodeName:}" failed. No retries permitted until 2026-07-22 04:34:16.153813976 +0000 UTC m=+66.211651516 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs") pod "network-metrics-daemon-bvrr4" (UID: "d6a93089-b6d0-4868-a3a4-0d7579905bbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 22 04:33:44.471352 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.471258    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:44.471352 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.471309    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:44.471582 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:44.471390    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sglqd" podUID="d5ab223e-0556-4987-88a3-828fe304d34d"
Jul 22 04:33:44.471582 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:44.471484    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bvrr4" podUID="d6a93089-b6d0-4868-a3a4-0d7579905bbf"
Jul 22 04:33:44.471582 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.471523    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:44.471725 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:44.471609    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pbxk8" podUID="07924526-aed8-4def-85f1-3298f15b128a"
Jul 22 04:33:44.693328 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.693292    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:44.730199 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.730127    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-249.ec2.internal" event="NodeReady"
Jul 22 04:33:44.730353 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.730276    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 22 04:33:44.744888 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.744863    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:44.775212 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.775186    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bphsr"]
Jul 22 04:33:44.790521 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.790496    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b6rrs"]
Jul 22 04:33:44.790667 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.790615    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bphsr"
Jul 22 04:33:44.792888 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.792828    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 22 04:33:44.793085 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.792924    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 22 04:33:44.793085 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.792966    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 22 04:33:44.793085 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.793070    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pmc57\""
Jul 22 04:33:44.804440 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.804409    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bphsr"]
Jul 22 04:33:44.804440 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.804444    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b6rrs"]
Jul 22 04:33:44.804580 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.804549    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:44.806777 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.806762    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hhmhx\""
Jul 22 04:33:44.806863 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.806832    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 22 04:33:44.806935 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.806919    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 22 04:33:44.959128 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.959097    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-tmp-dir\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:44.959267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.959140    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:44.959267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.959162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbwvb\" (UniqueName: \"kubernetes.io/projected/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-kube-api-access-fbwvb\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:44.959352 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.959285    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-config-volume\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:44.959352 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.959316    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c-cert\") pod \"ingress-canary-bphsr\" (UID: \"78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c\") " pod="openshift-ingress-canary/ingress-canary-bphsr"
Jul 22 04:33:44.959421 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:44.959351    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ttzm\" (UniqueName: \"kubernetes.io/projected/78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c-kube-api-access-8ttzm\") pod \"ingress-canary-bphsr\" (UID: \"78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c\") " pod="openshift-ingress-canary/ingress-canary-bphsr"
Jul 22 04:33:45.060463 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.060384    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:45.060463 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.060423    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbwvb\" (UniqueName: \"kubernetes.io/projected/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-kube-api-access-fbwvb\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:45.060676 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.060478    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-config-volume\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:45.060676 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.060511    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c-cert\") pod \"ingress-canary-bphsr\" (UID: \"78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c\") " pod="openshift-ingress-canary/ingress-canary-bphsr"
Jul 22 04:33:45.060676 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.060543    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ttzm\" (UniqueName: \"kubernetes.io/projected/78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c-kube-api-access-8ttzm\") pod \"ingress-canary-bphsr\" (UID: \"78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c\") " pod="openshift-ingress-canary/ingress-canary-bphsr"
Jul 22 04:33:45.060676 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.060576    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-tmp-dir\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:45.060676 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:45.060542    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:33:45.060923 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:45.060707    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls podName:f471f155-a6e9-4c51-bfa3-b9b382aea7ee nodeName:}" failed. No retries permitted until 2026-07-22 04:33:45.560685355 +0000 UTC m=+35.618522912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls") pod "dns-default-b6rrs" (UID: "f471f155-a6e9-4c51-bfa3-b9b382aea7ee") : secret "dns-default-metrics-tls" not found
Jul 22 04:33:45.060923 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.060900    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-tmp-dir\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:45.061095 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.061076    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-config-volume\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:45.064567 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.064549    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c-cert\") pod \"ingress-canary-bphsr\" (UID: \"78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c\") " pod="openshift-ingress-canary/ingress-canary-bphsr"
Jul 22 04:33:45.069054 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.069023    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ttzm\" (UniqueName: \"kubernetes.io/projected/78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c-kube-api-access-8ttzm\") pod \"ingress-canary-bphsr\" (UID: \"78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c\") " pod="openshift-ingress-canary/ingress-canary-bphsr"
Jul 22 04:33:45.069246 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.069228    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbwvb\" (UniqueName: \"kubernetes.io/projected/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-kube-api-access-fbwvb\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:45.100246 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.100217    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bphsr"
Jul 22 04:33:45.284730 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.284502    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bphsr"]
Jul 22 04:33:45.289865 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:45.289839    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78c38dbf_a6d5_4a0c_8c9c_ff78a7e5935c.slice/crio-402afad32d60472b7051d8d225ef15786ff4875046a3db99df38d5ffaedddfcb WatchSource:0}: Error finding container 402afad32d60472b7051d8d225ef15786ff4875046a3db99df38d5ffaedddfcb: Status 404 returned error can't find the container with id 402afad32d60472b7051d8d225ef15786ff4875046a3db99df38d5ffaedddfcb
Jul 22 04:33:45.564123 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.564088    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:45.564285 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:45.564196    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:33:45.564285 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:45.564248    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls podName:f471f155-a6e9-4c51-bfa3-b9b382aea7ee nodeName:}" failed. No retries permitted until 2026-07-22 04:33:46.564235534 +0000 UTC m=+36.622073072 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls") pod "dns-default-b6rrs" (UID: "f471f155-a6e9-4c51-bfa3-b9b382aea7ee") : secret "dns-default-metrics-tls" not found
Jul 22 04:33:45.724857 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.724772    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bphsr" event={"ID":"78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c","Type":"ContainerStarted","Data":"402afad32d60472b7051d8d225ef15786ff4875046a3db99df38d5ffaedddfcb"}
Jul 22 04:33:45.727139 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.727116    2584 generic.go:356] "Generic (PLEG): container finished" podID="5bc6449a-edf4-4270-b1db-12524d4e34b0" containerID="84b0b2459684b7e2de369b83508ceaccd34e8df2d2ad7b2d509c24842484a5df" exitCode=0
Jul 22 04:33:45.727244 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:45.727154    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9h8p" event={"ID":"5bc6449a-edf4-4270-b1db-12524d4e34b0","Type":"ContainerDied","Data":"84b0b2459684b7e2de369b83508ceaccd34e8df2d2ad7b2d509c24842484a5df"}
Jul 22 04:33:46.474541 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:46.474511    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:33:46.474932 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:46.474547    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:33:46.474932 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:46.474680    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:33:46.477186 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:46.477164    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 04:33:46.477186 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:46.477183    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ljtjg\""
Jul 22 04:33:46.477348 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:46.477182    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 04:33:46.478122 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:46.478100    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j88w2\""
Jul 22 04:33:46.478122 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:46.478109    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 04:33:46.478279 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:46.478203    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 04:33:46.573338 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:46.573306    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:46.573529 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:46.573484    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:33:46.573593 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:46.573552    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls podName:f471f155-a6e9-4c51-bfa3-b9b382aea7ee nodeName:}" failed. No retries permitted until 2026-07-22 04:33:48.573536253 +0000 UTC m=+38.631373792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls") pod "dns-default-b6rrs" (UID: "f471f155-a6e9-4c51-bfa3-b9b382aea7ee") : secret "dns-default-metrics-tls" not found
Jul 22 04:33:46.733112 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:46.733028    2584 generic.go:356] "Generic (PLEG): container finished" podID="5bc6449a-edf4-4270-b1db-12524d4e34b0" containerID="95f0dc95e531eb6faeefbf624ff4c21583dde622b1ddf5ae3b582f0d9fcef8c6" exitCode=0
Jul 22 04:33:46.733112 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:46.733088    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9h8p" event={"ID":"5bc6449a-edf4-4270-b1db-12524d4e34b0","Type":"ContainerDied","Data":"95f0dc95e531eb6faeefbf624ff4c21583dde622b1ddf5ae3b582f0d9fcef8c6"}
Jul 22 04:33:47.736591 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:47.736386    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bphsr" event={"ID":"78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c","Type":"ContainerStarted","Data":"f81cd75d59dd57310dd89054bebd49b69def048ed989b4fd6464f51b0ff8190f"}
Jul 22 04:33:47.739621 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:47.739594    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h9h8p" event={"ID":"5bc6449a-edf4-4270-b1db-12524d4e34b0","Type":"ContainerStarted","Data":"228af6309dba2e72ebf48d154a166774174639a8f2563f23e362208c9bc46a84"}
Jul 22 04:33:47.751568 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:47.751528    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bphsr" podStartSLOduration=1.649886304 podStartE2EDuration="3.751513471s" totalImagesPullingTime="2.101627167s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:47.750079531 +0000 UTC m=+37.807917112" watchObservedRunningTime="2026-07-22 04:33:47.751513471 +0000 UTC m=+37.809351032"
Jul 22 04:33:47.772522 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:47.772465    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h9h8p" podStartSLOduration=8.562145064 podStartE2EDuration="37.772446539s" totalImagesPullingTime="29.210301475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:33:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:47.771650043 +0000 UTC m=+37.829487619" watchObservedRunningTime="2026-07-22 04:33:47.772446539 +0000 UTC m=+37.830284101"
Jul 22 04:33:47.893026 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:47.892998    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:47.948169 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:47.948133    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:48.009711 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:48.009642    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:48.587428 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:48.587381    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:48.587568 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:48.587498    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:33:48.587568 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:48.587552    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls podName:f471f155-a6e9-4c51-bfa3-b9b382aea7ee nodeName:}" failed. No retries permitted until 2026-07-22 04:33:52.587538381 +0000 UTC m=+42.645375920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls") pod "dns-default-b6rrs" (UID: "f471f155-a6e9-4c51-bfa3-b9b382aea7ee") : secret "dns-default-metrics-tls" not found
Jul 22 04:33:49.231950 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:49.231906    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:49.372293 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:49.372261    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:49.425446 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:49.425413    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:50.780176 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.780138    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hkxzs"]
Jul 22 04:33:50.784001 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.783983    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:50.786385 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.786356    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 22 04:33:50.786688 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.786666    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 22 04:33:50.786823 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.786805    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 22 04:33:50.787729 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.787714    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 22 04:33:50.787835 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.787738    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tc9bh\""
Jul 22 04:33:50.792161 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.792140    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hkxzs"]
Jul 22 04:33:50.813558 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.813536    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:50.874454 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.874426    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6289t"]
Jul 22 04:33:50.878916 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.878893    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6289t"
Jul 22 04:33:50.882046 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.882024    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mc642\""
Jul 22 04:33:50.883152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.883135    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 22 04:33:50.883454 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.883437    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 22 04:33:50.890055 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.890034    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6289t"]
Jul 22 04:33:50.902641 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.902621    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/add770d3-98cf-45c1-a252-78d22865312b-crio-socket\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:50.902729 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.902686    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zp4b\" (UniqueName: \"kubernetes.io/projected/add770d3-98cf-45c1-a252-78d22865312b-kube-api-access-5zp4b\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:50.902729 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.902717    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/add770d3-98cf-45c1-a252-78d22865312b-data-volume\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:50.902806 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.902740    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/add770d3-98cf-45c1-a252-78d22865312b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:50.902806 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.902762    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:50.921844 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.921819    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:50.980676 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:50.980645    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:51.003064 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.003041    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/add770d3-98cf-45c1-a252-78d22865312b-crio-socket\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:51.003159 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.003084    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg687\" (UniqueName: \"kubernetes.io/projected/b61cc049-b532-4bc2-9d8c-d238b5a087b6-kube-api-access-lg687\") pod \"migrator-7cc9c7ffd7-6289t\" (UID: \"b61cc049-b532-4bc2-9d8c-d238b5a087b6\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6289t"
Jul 22 04:33:51.003159 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.003144    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zp4b\" (UniqueName: \"kubernetes.io/projected/add770d3-98cf-45c1-a252-78d22865312b-kube-api-access-5zp4b\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:51.003267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.003204    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/add770d3-98cf-45c1-a252-78d22865312b-data-volume\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:51.003267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.003241    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/add770d3-98cf-45c1-a252-78d22865312b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:51.003267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.003260    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/add770d3-98cf-45c1-a252-78d22865312b-crio-socket\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:51.003404 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.003268    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:51.003404 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:51.003325    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:33:51.003404 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:51.003358    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:33:51.003534 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:51.003449    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls podName:add770d3-98cf-45c1-a252-78d22865312b nodeName:}" failed. No retries permitted until 2026-07-22 04:33:51.503426257 +0000 UTC m=+41.561263799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkxzs" (UID: "add770d3-98cf-45c1-a252-78d22865312b") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:33:51.003534 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:51.003475    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/add770d3-98cf-45c1-a252-78d22865312b-kube-rbac-proxy-cm podName:add770d3-98cf-45c1-a252-78d22865312b nodeName:}" failed. No retries permitted until 2026-07-22 04:33:51.503457548 +0000 UTC m=+41.561295123 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/add770d3-98cf-45c1-a252-78d22865312b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hkxzs" (UID: "add770d3-98cf-45c1-a252-78d22865312b") : configmap "kube-rbac-proxy" not found
Jul 22 04:33:51.003611 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.003538    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/add770d3-98cf-45c1-a252-78d22865312b-data-volume\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:51.013605 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.013586    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zp4b\" (UniqueName: \"kubernetes.io/projected/add770d3-98cf-45c1-a252-78d22865312b-kube-api-access-5zp4b\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:51.077216 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.077126    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:51.104290 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.104258    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg687\" (UniqueName: \"kubernetes.io/projected/b61cc049-b532-4bc2-9d8c-d238b5a087b6-kube-api-access-lg687\") pod \"migrator-7cc9c7ffd7-6289t\" (UID: \"b61cc049-b532-4bc2-9d8c-d238b5a087b6\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6289t"
Jul 22 04:33:51.112110 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.112084    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg687\" (UniqueName: \"kubernetes.io/projected/b61cc049-b532-4bc2-9d8c-d238b5a087b6-kube-api-access-lg687\") pod \"migrator-7cc9c7ffd7-6289t\" (UID: \"b61cc049-b532-4bc2-9d8c-d238b5a087b6\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6289t"
Jul 22 04:33:51.187651 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.187613    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6289t"
Jul 22 04:33:51.227250 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.227209    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:51.309043 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.309014    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6289t"]
Jul 22 04:33:51.312319 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:51.312290    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb61cc049_b532_4bc2_9d8c_d238b5a087b6.slice/crio-2c45ca5c1a22f731577d67655e6997338f93e98afb1398714337a065925dbf22 WatchSource:0}: Error finding container 2c45ca5c1a22f731577d67655e6997338f93e98afb1398714337a065925dbf22: Status 404 returned error can't find the container with id 2c45ca5c1a22f731577d67655e6997338f93e98afb1398714337a065925dbf22
Jul 22 04:33:51.312319 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.312300    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:51.367704 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.367601    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:51.493246 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.493195    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:51.508318 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.508288    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/add770d3-98cf-45c1-a252-78d22865312b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:51.508436 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.508326    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:51.508436 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:51.508407    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:33:51.508536 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:51.508441    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:33:51.508536 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:51.508467    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/add770d3-98cf-45c1-a252-78d22865312b-kube-rbac-proxy-cm podName:add770d3-98cf-45c1-a252-78d22865312b nodeName:}" failed. No retries permitted until 2026-07-22 04:33:52.508451262 +0000 UTC m=+42.566288803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/add770d3-98cf-45c1-a252-78d22865312b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hkxzs" (UID: "add770d3-98cf-45c1-a252-78d22865312b") : configmap "kube-rbac-proxy" not found
Jul 22 04:33:51.508536 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:51.508498    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls podName:add770d3-98cf-45c1-a252-78d22865312b nodeName:}" failed. No retries permitted until 2026-07-22 04:33:52.508492294 +0000 UTC m=+42.566329833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkxzs" (UID: "add770d3-98cf-45c1-a252-78d22865312b") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:33:51.592842 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.592810    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:51.749022 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:51.748991    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6289t" event={"ID":"b61cc049-b532-4bc2-9d8c-d238b5a087b6","Type":"ContainerStarted","Data":"2c45ca5c1a22f731577d67655e6997338f93e98afb1398714337a065925dbf22"}
Jul 22 04:33:52.516525 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:52.516493    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/add770d3-98cf-45c1-a252-78d22865312b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:52.516858 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:52.516529    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:52.516858 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:52.516610    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 22 04:33:52.516858 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:52.516678    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/add770d3-98cf-45c1-a252-78d22865312b-kube-rbac-proxy-cm podName:add770d3-98cf-45c1-a252-78d22865312b nodeName:}" failed. No retries permitted until 2026-07-22 04:33:54.516661711 +0000 UTC m=+44.574499250 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/add770d3-98cf-45c1-a252-78d22865312b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hkxzs" (UID: "add770d3-98cf-45c1-a252-78d22865312b") : configmap "kube-rbac-proxy" not found
Jul 22 04:33:52.516858 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:52.516682    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:33:52.516858 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:52.516725    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls podName:add770d3-98cf-45c1-a252-78d22865312b nodeName:}" failed. No retries permitted until 2026-07-22 04:33:54.516713948 +0000 UTC m=+44.574551487 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkxzs" (UID: "add770d3-98cf-45c1-a252-78d22865312b") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:33:52.617571 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:52.617533    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:33:52.617738 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:52.617685    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 22 04:33:52.617784 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:52.617750    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls podName:f471f155-a6e9-4c51-bfa3-b9b382aea7ee nodeName:}" failed. No retries permitted until 2026-07-22 04:34:00.617736264 +0000 UTC m=+50.675573806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls") pod "dns-default-b6rrs" (UID: "f471f155-a6e9-4c51-bfa3-b9b382aea7ee") : secret "dns-default-metrics-tls" not found
Jul 22 04:33:52.775278 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:52.775215    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7gtj_cd595fae-bda2-4a84-ae8c-e7b1cc3831f2/dns-node-resolver/0.log"
Jul 22 04:33:53.092827 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.092802    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-nbzd8"]
Jul 22 04:33:53.118286 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.118266    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-nbzd8"]
Jul 22 04:33:53.118393 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.118350    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-nbzd8"
Jul 22 04:33:53.121004 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.120971    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 22 04:33:53.121117 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.121068    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 22 04:33:53.122055 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.122038    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 22 04:33:53.122170 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.122073    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 22 04:33:53.122170 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.122105    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-kjlxv\""
Jul 22 04:33:53.122907 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.122888    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:53.222535 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.222502    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls84h\" (UniqueName: \"kubernetes.io/projected/2d065881-42a0-4d0e-9708-737876db587f-kube-api-access-ls84h\") pod \"service-ca-58598695f7-nbzd8\" (UID: \"2d065881-42a0-4d0e-9708-737876db587f\") " pod="openshift-service-ca/service-ca-58598695f7-nbzd8"
Jul 22 04:33:53.222656 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.222602    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2d065881-42a0-4d0e-9708-737876db587f-signing-key\") pod \"service-ca-58598695f7-nbzd8\" (UID: \"2d065881-42a0-4d0e-9708-737876db587f\") " pod="openshift-service-ca/service-ca-58598695f7-nbzd8"
Jul 22 04:33:53.222656 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.222626    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2d065881-42a0-4d0e-9708-737876db587f-signing-cabundle\") pod \"service-ca-58598695f7-nbzd8\" (UID: \"2d065881-42a0-4d0e-9708-737876db587f\") " pod="openshift-service-ca/service-ca-58598695f7-nbzd8"
Jul 22 04:33:53.222769 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.222754    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:53.323175 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.323104    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls84h\" (UniqueName: \"kubernetes.io/projected/2d065881-42a0-4d0e-9708-737876db587f-kube-api-access-ls84h\") pod \"service-ca-58598695f7-nbzd8\" (UID: \"2d065881-42a0-4d0e-9708-737876db587f\") " pod="openshift-service-ca/service-ca-58598695f7-nbzd8"
Jul 22 04:33:53.323175 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.323142    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2d065881-42a0-4d0e-9708-737876db587f-signing-key\") pod \"service-ca-58598695f7-nbzd8\" (UID: \"2d065881-42a0-4d0e-9708-737876db587f\") " pod="openshift-service-ca/service-ca-58598695f7-nbzd8"
Jul 22 04:33:53.323175 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.323161    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2d065881-42a0-4d0e-9708-737876db587f-signing-cabundle\") pod \"service-ca-58598695f7-nbzd8\" (UID: \"2d065881-42a0-4d0e-9708-737876db587f\") " pod="openshift-service-ca/service-ca-58598695f7-nbzd8"
Jul 22 04:33:53.323726 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.323708    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2d065881-42a0-4d0e-9708-737876db587f-signing-cabundle\") pod \"service-ca-58598695f7-nbzd8\" (UID: \"2d065881-42a0-4d0e-9708-737876db587f\") " pod="openshift-service-ca/service-ca-58598695f7-nbzd8"
Jul 22 04:33:53.325529 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.325507    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2d065881-42a0-4d0e-9708-737876db587f-signing-key\") pod \"service-ca-58598695f7-nbzd8\" (UID: \"2d065881-42a0-4d0e-9708-737876db587f\") " pod="openshift-service-ca/service-ca-58598695f7-nbzd8"
Jul 22 04:33:53.331090 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.331073    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls84h\" (UniqueName: \"kubernetes.io/projected/2d065881-42a0-4d0e-9708-737876db587f-kube-api-access-ls84h\") pod \"service-ca-58598695f7-nbzd8\" (UID: \"2d065881-42a0-4d0e-9708-737876db587f\") " pod="openshift-service-ca/service-ca-58598695f7-nbzd8"
Jul 22 04:33:53.426822 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.426789    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-nbzd8"
Jul 22 04:33:53.561033 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.561004    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-nbzd8"]
Jul 22 04:33:53.564055 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:33:53.564020    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d065881_42a0_4d0e_9708_737876db587f.slice/crio-dab1598b95c132fcbcc38bf51aaf08ad8369c660fad6e991b43b7d54024ad4a0 WatchSource:0}: Error finding container dab1598b95c132fcbcc38bf51aaf08ad8369c660fad6e991b43b7d54024ad4a0: Status 404 returned error can't find the container with id dab1598b95c132fcbcc38bf51aaf08ad8369c660fad6e991b43b7d54024ad4a0
Jul 22 04:33:53.574904 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.574860    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-878j5_40557eca-82bd-4ffc-9164-f813551371c0/node-ca/0.log"
Jul 22 04:33:53.755635 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.755598    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6289t" event={"ID":"b61cc049-b532-4bc2-9d8c-d238b5a087b6","Type":"ContainerStarted","Data":"d979092374ebb32ee42855e30d83e2533e885e6904021a7c7c722b7296799394"}
Jul 22 04:33:53.755810 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.755659    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6289t" event={"ID":"b61cc049-b532-4bc2-9d8c-d238b5a087b6","Type":"ContainerStarted","Data":"16dab83e4620833aa525249c3964677cc30df5d333dafa1f187c4b98cfeb9e7e"}
Jul 22 04:33:53.756639 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.756615    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-nbzd8" event={"ID":"2d065881-42a0-4d0e-9708-737876db587f","Type":"ContainerStarted","Data":"dab1598b95c132fcbcc38bf51aaf08ad8369c660fad6e991b43b7d54024ad4a0"}
Jul 22 04:33:53.775759 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.773696    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-6289t" podStartSLOduration=2.198485923 podStartE2EDuration="3.773670254s" totalImagesPullingTime="1.575184331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:53.773040981 +0000 UTC m=+43.830878548" watchObservedRunningTime="2026-07-22 04:33:53.773670254 +0000 UTC m=+43.831507816"
Jul 22 04:33:53.940381 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:53.940305    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:54.531906 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:54.531872    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/add770d3-98cf-45c1-a252-78d22865312b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:54.532101 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:54.531989    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:54.532211 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:54.532181    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:33:54.532331 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:54.532273    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls podName:add770d3-98cf-45c1-a252-78d22865312b nodeName:}" failed. No retries permitted until 2026-07-22 04:33:58.532250038 +0000 UTC m=+48.590087579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkxzs" (UID: "add770d3-98cf-45c1-a252-78d22865312b") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:33:54.532509 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:54.532483    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/add770d3-98cf-45c1-a252-78d22865312b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:54.573812 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:54.573772    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bphsr_78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c/serve-healthcheck-canary/0.log"
Jul 22 04:33:54.627515 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:54.627478    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:56.765015 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:56.764973    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-nbzd8" event={"ID":"2d065881-42a0-4d0e-9708-737876db587f","Type":"ContainerStarted","Data":"4baaa52d0d0dd5bda5d0ac7aeacb9f0a22ceb4e7c5fb267abdaeb8b71c5aa7a0"}
Jul 22 04:33:56.780042 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:56.779992    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-nbzd8" podStartSLOduration=1.286261031 podStartE2EDuration="3.77997696s" totalImagesPullingTime="2.493715929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:33:56.779621494 +0000 UTC m=+46.837459081" watchObservedRunningTime="2026-07-22 04:33:56.77997696 +0000 UTC m=+46.837814521"
Jul 22 04:33:56.958630 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:56.958573    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:57.014978 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:57.014927    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:57.140588 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:57.140501    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:57.241258 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:57.241223    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:57.343101 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:57.343061    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:57.445135 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:57.445024    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:57.549414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:57.549382    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:57.658588 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:57.658561    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:58.561434 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:58.561401    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:33:58.561830 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:58.561539    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 22 04:33:58.561830 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:33:58.561603    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls podName:add770d3-98cf-45c1-a252-78d22865312b nodeName:}" failed. No retries permitted until 2026-07-22 04:34:06.561587085 +0000 UTC m=+56.619424624 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hkxzs" (UID: "add770d3-98cf-45c1-a252-78d22865312b") : secret "insights-runtime-extractor-tls" not found
Jul 22 04:33:58.856913 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:58.856822    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:59.056478 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:59.056443    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:59.256330 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:59.256298    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:59.459989 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:59.459936    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:59.657827 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:59.657731    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:59.711525 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:59.711495    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:33:59.759086 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:33:59.759044    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:00.231330 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:00.231301    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:00.567398 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:00.567281    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:00.667870 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:00.667835    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:00.677041 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:00.677015    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:34:00.679273 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:00.679250    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f471f155-a6e9-4c51-bfa3-b9b382aea7ee-metrics-tls\") pod \"dns-default-b6rrs\" (UID: \"f471f155-a6e9-4c51-bfa3-b9b382aea7ee\") " pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:34:00.712335 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:00.712306    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:34:00.843711 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:00.843632    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b6rrs"]
Jul 22 04:34:00.847249 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:34:00.847219    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf471f155_a6e9_4c51_bfa3_b9b382aea7ee.slice/crio-d737e202ae2e9938e34e80cc2ba5e5e91f2c7659f15e9f227497700536d1d7b5 WatchSource:0}: Error finding container d737e202ae2e9938e34e80cc2ba5e5e91f2c7659f15e9f227497700536d1d7b5: Status 404 returned error can't find the container with id d737e202ae2e9938e34e80cc2ba5e5e91f2c7659f15e9f227497700536d1d7b5
Jul 22 04:34:00.870951 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:00.870923    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:01.079681 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:01.079645    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:01.253166 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:01.253118    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:01.456006 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:01.455968    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:01.517578 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:01.517465    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:01.652002 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:01.651937    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:01.780141 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:01.780059    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6rrs" event={"ID":"f471f155-a6e9-4c51-bfa3-b9b382aea7ee","Type":"ContainerStarted","Data":"d737e202ae2e9938e34e80cc2ba5e5e91f2c7659f15e9f227497700536d1d7b5"}
Jul 22 04:34:02.258898 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:02.258858    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:02.357455 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:02.357419    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:02.459447 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:02.459395    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:02.512937 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:02.512861    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:03.252039 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:03.251999    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:03.651462 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:03.651429    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:03.791990 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:03.791879    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6rrs" event={"ID":"f471f155-a6e9-4c51-bfa3-b9b382aea7ee","Type":"ContainerStarted","Data":"5a8020ae571a521eb360f2e4bf5d0d9964ab8bc4ffeb7ee476e2996e0410fac0"}
Jul 22 04:34:03.791990 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:03.791979    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b6rrs" event={"ID":"f471f155-a6e9-4c51-bfa3-b9b382aea7ee","Type":"ContainerStarted","Data":"86958f027383b21324376735251d932dc542e5be60f69c024883d6a276d99248"}
Jul 22 04:34:03.792317 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:03.792013    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:34:03.807702 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:03.807649    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b6rrs" podStartSLOduration=17.402167521 podStartE2EDuration="19.807634493s" totalImagesPullingTime="2.405466972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:03.806828587 +0000 UTC m=+53.864666174" watchObservedRunningTime="2026-07-22 04:34:03.807634493 +0000 UTC m=+53.865472079"
Jul 22 04:34:03.853630 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:03.853596    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:04.055250 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:04.055165    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:04.258713 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:04.258680    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:04.456292 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:04.456207    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:05.456058 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:05.456020    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:05.855115 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:05.855080    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:06.061393 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:06.061362    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:06.252050 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:06.252021    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:06.627100 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:06.627022    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:34:06.629158 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:06.629137    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/add770d3-98cf-45c1-a252-78d22865312b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hkxzs\" (UID: \"add770d3-98cf-45c1-a252-78d22865312b\") " pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:34:06.650762 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:06.650732    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:06.693690 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:06.693660    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hkxzs"
Jul 22 04:34:06.843572 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:06.843542    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hkxzs"]
Jul 22 04:34:06.846911 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:34:06.846885    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadd770d3_98cf_45c1_a252_78d22865312b.slice/crio-c935de2d11fc33823777d91fac71297b63df770210c7b8260edc0b7d50990519 WatchSource:0}: Error finding container c935de2d11fc33823777d91fac71297b63df770210c7b8260edc0b7d50990519: Status 404 returned error can't find the container with id c935de2d11fc33823777d91fac71297b63df770210c7b8260edc0b7d50990519
Jul 22 04:34:07.256529 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:07.256501    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:07.450577 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:07.450538    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:07.653371 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:07.653280    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:07.808127 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:07.808087    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hkxzs" event={"ID":"add770d3-98cf-45c1-a252-78d22865312b","Type":"ContainerStarted","Data":"c935de2d11fc33823777d91fac71297b63df770210c7b8260edc0b7d50990519"}
Jul 22 04:34:10.724395 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:10.724367    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bq76r"
Jul 22 04:34:12.828844 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:12.828803    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hkxzs" event={"ID":"add770d3-98cf-45c1-a252-78d22865312b","Type":"ContainerStarted","Data":"5f8c4573bd662f811710aa462f70dbab5d83124e745f5772b512d3d8114eaa44"}
Jul 22 04:34:13.800214 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:13.800181    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b6rrs"
Jul 22 04:34:14.692624 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:14.692587    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:14.747231 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:14.747195    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:15.065274 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.065239    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"]
Jul 22 04:34:15.072850 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.072824    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.075475 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.075419    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 22 04:34:15.075475 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.075466    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 22 04:34:15.075676 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.075504    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 22 04:34:15.076762 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.076542    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 22 04:34:15.076762 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.076570    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 22 04:34:15.076762 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.076655    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 22 04:34:15.076762 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.076655    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 22 04:34:15.081623 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.081601    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"]
Jul 22 04:34:15.125291 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.125262    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:15.201036 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.200992    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/69f370df-7b58-43b1-8f4f-c74d37c74601-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.201212 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.201050    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f370df-7b58-43b1-8f4f-c74d37c74601-additional-service-ca\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.201212 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.201127    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/69f370df-7b58-43b1-8f4f-c74d37c74601-hub\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.201212 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.201184    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk24n\" (UniqueName: \"kubernetes.io/projected/69f370df-7b58-43b1-8f4f-c74d37c74601-kube-api-access-wk24n\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.201384 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.201294    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/69f370df-7b58-43b1-8f4f-c74d37c74601-ca\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.201384 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.201342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/69f370df-7b58-43b1-8f4f-c74d37c74601-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.220209 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.220175    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:15.302065 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.302037    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk24n\" (UniqueName: \"kubernetes.io/projected/69f370df-7b58-43b1-8f4f-c74d37c74601-kube-api-access-wk24n\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.302199 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.302110    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/69f370df-7b58-43b1-8f4f-c74d37c74601-ca\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.302199 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.302146    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/69f370df-7b58-43b1-8f4f-c74d37c74601-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.302199 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.302185    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/69f370df-7b58-43b1-8f4f-c74d37c74601-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.302350 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.302209    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f370df-7b58-43b1-8f4f-c74d37c74601-additional-service-ca\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.302350 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.302237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/69f370df-7b58-43b1-8f4f-c74d37c74601-hub\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.302964 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.302924    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/69f370df-7b58-43b1-8f4f-c74d37c74601-additional-service-ca\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.304625 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.304479    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/69f370df-7b58-43b1-8f4f-c74d37c74601-ca\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.304750 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.304672    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/69f370df-7b58-43b1-8f4f-c74d37c74601-hub\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.304750 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.304720    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/69f370df-7b58-43b1-8f4f-c74d37c74601-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.304889 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.304872    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/69f370df-7b58-43b1-8f4f-c74d37c74601-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.311336 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.311315    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk24n\" (UniqueName: \"kubernetes.io/projected/69f370df-7b58-43b1-8f4f-c74d37c74601-kube-api-access-wk24n\") pod \"cluster-proxy-proxy-agent-dd665c9c8-v7zcj\" (UID: \"69f370df-7b58-43b1-8f4f-c74d37c74601\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.319689 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.319624    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:15.393217 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.393188    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"
Jul 22 04:34:15.516137 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.516108    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj"]
Jul 22 04:34:15.520321 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:34:15.520195    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69f370df_7b58_43b1_8f4f_c74d37c74601.slice/crio-73d631692ce190579ea32984920d266eeb28f4947b7c8b437d31108e1653ddef WatchSource:0}: Error finding container 73d631692ce190579ea32984920d266eeb28f4947b7c8b437d31108e1653ddef: Status 404 returned error can't find the container with id 73d631692ce190579ea32984920d266eeb28f4947b7c8b437d31108e1653ddef
Jul 22 04:34:15.841192 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.841157    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hkxzs" event={"ID":"add770d3-98cf-45c1-a252-78d22865312b","Type":"ContainerStarted","Data":"860f54caf0c69663b4323787fce045e04b7cd1727d660d17a642727ceb3d1e18"}
Jul 22 04:34:15.842439 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:15.842414    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj" event={"ID":"69f370df-7b58-43b1-8f4f-c74d37c74601","Type":"ContainerStarted","Data":"73d631692ce190579ea32984920d266eeb28f4947b7c8b437d31108e1653ddef"}
Jul 22 04:34:16.112040 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.111955    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgxgl\" (UniqueName: \"kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl\") pod \"network-check-target-pbxk8\" (UID: \"07924526-aed8-4def-85f1-3298f15b128a\") " pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:34:16.112040 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.112003    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:34:16.114792 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.114764    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 22 04:34:16.114915 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.114765    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 22 04:34:16.124911 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.124885    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 22 04:34:16.125286 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.125268    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5ab223e-0556-4987-88a3-828fe304d34d-original-pull-secret\") pod \"global-pull-secret-syncer-sglqd\" (UID: \"d5ab223e-0556-4987-88a3-828fe304d34d\") " pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:34:16.136440 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.136416    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgxgl\" (UniqueName: \"kubernetes.io/projected/07924526-aed8-4def-85f1-3298f15b128a-kube-api-access-pgxgl\") pod \"network-check-target-pbxk8\" (UID: \"07924526-aed8-4def-85f1-3298f15b128a\") " pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:34:16.187416 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.187253    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sglqd"
Jul 22 04:34:16.201775 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.201514    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j88w2\""
Jul 22 04:34:16.210425 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.209880    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:34:16.212599 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.212508    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:34:16.215149 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.214968    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 22 04:34:16.225886 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.225835    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d6a93089-b6d0-4868-a3a4-0d7579905bbf-metrics-certs\") pod \"network-metrics-daemon-bvrr4\" (UID: \"d6a93089-b6d0-4868-a3a4-0d7579905bbf\") " pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:34:16.356559 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.356480    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sglqd"]
Jul 22 04:34:16.362234 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:34:16.361903    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5ab223e_0556_4987_88a3_828fe304d34d.slice/crio-2b0fd903b7289655d6c09c4f051944cd5d98d910cdc669f3da3e98d4083e58ec WatchSource:0}: Error finding container 2b0fd903b7289655d6c09c4f051944cd5d98d910cdc669f3da3e98d4083e58ec: Status 404 returned error can't find the container with id 2b0fd903b7289655d6c09c4f051944cd5d98d910cdc669f3da3e98d4083e58ec
Jul 22 04:34:16.378895 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.378861    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pbxk8"]
Jul 22 04:34:16.383543 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:34:16.383508    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07924526_aed8_4def_85f1_3298f15b128a.slice/crio-23328d8776070bb00bfec6d50898ab18f469ad449129b1e39d5c078ce4354c61 WatchSource:0}: Error finding container 23328d8776070bb00bfec6d50898ab18f469ad449129b1e39d5c078ce4354c61: Status 404 returned error can't find the container with id 23328d8776070bb00bfec6d50898ab18f469ad449129b1e39d5c078ce4354c61
Jul 22 04:34:16.495553 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.495344    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ljtjg\""
Jul 22 04:34:16.503986 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.503709    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bvrr4"
Jul 22 04:34:16.668109 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.667978    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bvrr4"]
Jul 22 04:34:16.671696 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:34:16.671624    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a93089_b6d0_4868_a3a4_0d7579905bbf.slice/crio-3b752fcfb3f0b0d1701c5823f587fb78f599aed9eb229b9f5f66b907b5b40dd2 WatchSource:0}: Error finding container 3b752fcfb3f0b0d1701c5823f587fb78f599aed9eb229b9f5f66b907b5b40dd2: Status 404 returned error can't find the container with id 3b752fcfb3f0b0d1701c5823f587fb78f599aed9eb229b9f5f66b907b5b40dd2
Jul 22 04:34:16.848866 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.848772    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pbxk8" event={"ID":"07924526-aed8-4def-85f1-3298f15b128a","Type":"ContainerStarted","Data":"23328d8776070bb00bfec6d50898ab18f469ad449129b1e39d5c078ce4354c61"}
Jul 22 04:34:16.851082 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.850921    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bvrr4" event={"ID":"d6a93089-b6d0-4868-a3a4-0d7579905bbf","Type":"ContainerStarted","Data":"3b752fcfb3f0b0d1701c5823f587fb78f599aed9eb229b9f5f66b907b5b40dd2"}
Jul 22 04:34:16.852779 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:16.852726    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sglqd" event={"ID":"d5ab223e-0556-4987-88a3-828fe304d34d","Type":"ContainerStarted","Data":"2b0fd903b7289655d6c09c4f051944cd5d98d910cdc669f3da3e98d4083e58ec"}
Jul 22 04:34:19.103617 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:19.103585    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:19.188820 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:19.188747    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:19.270573 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:19.270523    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:19.455695 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:19.455605    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:19.556074 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:19.556041    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:19.800960 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:19.800911    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:19.903997 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:19.903963    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:20.082064 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:20.081985    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:21.034153 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:21.034117    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:21.443374 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:21.443289    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:21.499176 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:21.499141    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:22.175641 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:22.175600    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:22.225026 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:22.224977    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:24.106899 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.106858    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:24.161692 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.161655    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:24.884693 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.884651    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bvrr4" event={"ID":"d6a93089-b6d0-4868-a3a4-0d7579905bbf","Type":"ContainerStarted","Data":"99ef2afbcec6fa5fa561758a1d09e0276ef0baf8a32e384a7f321c780fe2161b"}
Jul 22 04:34:24.884872 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.884750    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bvrr4" event={"ID":"d6a93089-b6d0-4868-a3a4-0d7579905bbf","Type":"ContainerStarted","Data":"a457a42e1d0bddc348e6235d1293c91fa352ba12725f465960a14c0b70df50e8"}
Jul 22 04:34:24.886553 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.886524    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hkxzs" event={"ID":"add770d3-98cf-45c1-a252-78d22865312b","Type":"ContainerStarted","Data":"acfac4b376b54a070dbecbcc47398d2aa92ba7829321f110983168a3873d64a0"}
Jul 22 04:34:24.888461 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.888436    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj" event={"ID":"69f370df-7b58-43b1-8f4f-c74d37c74601","Type":"ContainerStarted","Data":"e000958b85dd6756384724b0c37ed9ede7f418dc10a5978effc5db076eddefee"}
Jul 22 04:34:24.888584 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.888471    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj" event={"ID":"69f370df-7b58-43b1-8f4f-c74d37c74601","Type":"ContainerStarted","Data":"a526863ec0c115e2ba22b72fe45ab37dc4c4971a72482cfccbe87772787c3daa"}
Jul 22 04:34:24.888584 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.888483    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj" event={"ID":"69f370df-7b58-43b1-8f4f-c74d37c74601","Type":"ContainerStarted","Data":"ba4810cb4db8c89cfa31fffcb8f6f08cf0fb4e7c98fb1402f4f5658322eb5058"}
Jul 22 04:34:24.889870 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.889850    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sglqd" event={"ID":"d5ab223e-0556-4987-88a3-828fe304d34d","Type":"ContainerStarted","Data":"a84a3962b7bf9ceac319da5df189bbaee09e81689e473a12a011392aeb50032d"}
Jul 22 04:34:24.891133 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.891110    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pbxk8" event={"ID":"07924526-aed8-4def-85f1-3298f15b128a","Type":"ContainerStarted","Data":"8102fd5404a6ddce6c88c9f2410e1337732d204b545260503531446f789e48ca"}
Jul 22 04:34:24.891258 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.891241    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:34:24.900466 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.900400    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bvrr4" podStartSLOduration=67.132322418 podStartE2EDuration="1m14.900382749s" totalImagesPullingTime="7.768060331s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:24.899552004 +0000 UTC m=+74.957389582" watchObservedRunningTime="2026-07-22 04:34:24.900382749 +0000 UTC m=+74.958220310"
Jul 22 04:34:24.913518 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.913437    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pbxk8" podStartSLOduration=66.853653011 podStartE2EDuration="1m14.913418661s" totalImagesPullingTime="8.05976565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:24.912991131 +0000 UTC m=+74.970828712" watchObservedRunningTime="2026-07-22 04:34:24.913418661 +0000 UTC m=+74.971256223"
Jul 22 04:34:24.929026 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.928985    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sglqd" podStartSLOduration=66.837435905 podStartE2EDuration="1m14.928971738s" totalImagesPullingTime="8.091535833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:24.928223778 +0000 UTC m=+74.986061338" watchObservedRunningTime="2026-07-22 04:34:24.928971738 +0000 UTC m=+74.986809276"
Jul 22 04:34:24.947604 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.947551    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hkxzs" podStartSLOduration=17.47779924 podStartE2EDuration="34.947534335s" totalImagesPullingTime="17.469735095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 04:33:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:24.947143839 +0000 UTC m=+75.004981611" watchObservedRunningTime="2026-07-22 04:34:24.947534335 +0000 UTC m=+75.005371896"
Jul 22 04:34:24.964627 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.964574    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-dd665c9c8-v7zcj" podStartSLOduration=1.026434579 podStartE2EDuration="9.964558041s" totalImagesPullingTime="8.938123462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:24.964010002 +0000 UTC m=+75.021847564" watchObservedRunningTime="2026-07-22 04:34:24.964558041 +0000 UTC m=+75.022395601"
Jul 22 04:34:24.982427 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:24.982399    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:25.080920 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:25.080873    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:25.129685 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:25.129656    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:26.304380 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:26.304344    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:26.377180 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:26.377148    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:26.465556 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:26.465523    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:28.327202 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:28.327169    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:29.690529 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:29.690495    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:29.791029 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:29.790993    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:30.467162 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.467117    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:30.566182 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.566152    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:30.694813 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.694785    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:30.745276 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.745197    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vfzcq"]
Jul 22 04:34:30.749577 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.749549    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.752034 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.752015    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zm9xl\""
Jul 22 04:34:30.752214 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.752195    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 22 04:34:30.753328 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.753306    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 22 04:34:30.753445 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.753326    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 22 04:34:30.753445 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.753313    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 22 04:34:30.753557 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.753448    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 22 04:34:30.753557 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.753491    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 22 04:34:30.791083 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.791051    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:30.825156 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.825124    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd97a2d7-d049-481c-9cfc-8779c86815b9-root\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.825156 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.825158    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-textfile\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.825355 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.825183    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd97a2d7-d049-481c-9cfc-8779c86815b9-sys\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.825355 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.825207    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd97a2d7-d049-481c-9cfc-8779c86815b9-metrics-client-ca\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.825355 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.825261    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nfcg\" (UniqueName: \"kubernetes.io/projected/fd97a2d7-d049-481c-9cfc-8779c86815b9-kube-api-access-7nfcg\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.825503 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.825340    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.825503 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.825401    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-tls\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.825503 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.825489    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.825646 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.825536    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-wtmp\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.894401 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.894363    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:30.926363 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.926332    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-tls\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.926531 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.926373    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.926531 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.926404    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-wtmp\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.926531 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.926433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd97a2d7-d049-481c-9cfc-8779c86815b9-root\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.926531 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.926489    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fd97a2d7-d049-481c-9cfc-8779c86815b9-root\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.926531 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.926526    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-textfile\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.926790 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.926559    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd97a2d7-d049-481c-9cfc-8779c86815b9-sys\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.926790 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.926578    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd97a2d7-d049-481c-9cfc-8779c86815b9-metrics-client-ca\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.926790 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.926601    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nfcg\" (UniqueName: \"kubernetes.io/projected/fd97a2d7-d049-481c-9cfc-8779c86815b9-kube-api-access-7nfcg\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.926790 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.926716    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.927166 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.927140    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-textfile\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.927319 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.927181    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-accelerators-collector-config\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.927426 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.927404    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd97a2d7-d049-481c-9cfc-8779c86815b9-metrics-client-ca\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.927543 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.927512    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd97a2d7-d049-481c-9cfc-8779c86815b9-sys\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.927617 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.927576    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-wtmp\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.929048 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.929028    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.929218 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.929196    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fd97a2d7-d049-481c-9cfc-8779c86815b9-node-exporter-tls\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:30.934609 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:30.934583    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nfcg\" (UniqueName: \"kubernetes.io/projected/fd97a2d7-d049-481c-9cfc-8779c86815b9-kube-api-access-7nfcg\") pod \"node-exporter-vfzcq\" (UID: \"fd97a2d7-d049-481c-9cfc-8779c86815b9\") " pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:31.029671 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:31.029587    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:31.059769 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:31.059724    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vfzcq"
Jul 22 04:34:31.070301 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:34:31.070274    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd97a2d7_d049_481c_9cfc_8779c86815b9.slice/crio-b7318f6a82f96634193b1d349c9e3a37d6a4665ff4022df340abc92d0fb000b7 WatchSource:0}: Error finding container b7318f6a82f96634193b1d349c9e3a37d6a4665ff4022df340abc92d0fb000b7: Status 404 returned error can't find the container with id b7318f6a82f96634193b1d349c9e3a37d6a4665ff4022df340abc92d0fb000b7
Jul 22 04:34:31.133009 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:31.132976    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:31.233384 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:31.233349    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:31.337157 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:31.337074    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:31.430874 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:31.430843    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:31.678569 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:31.678486    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:31.761763 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:31.761718    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:31.878885 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:31.878852    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:31.917434 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:31.917394    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vfzcq" event={"ID":"fd97a2d7-d049-481c-9cfc-8779c86815b9","Type":"ContainerStarted","Data":"b7318f6a82f96634193b1d349c9e3a37d6a4665ff4022df340abc92d0fb000b7"}
Jul 22 04:34:32.922500 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:32.922390    2584 generic.go:356] "Generic (PLEG): container finished" podID="fd97a2d7-d049-481c-9cfc-8779c86815b9" containerID="f2ea069c5cf684d7b644882fa514791e7cc4dfdea9904ae9ccb50ac38e8c9b25" exitCode=0
Jul 22 04:34:32.922500 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:32.922443    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vfzcq" event={"ID":"fd97a2d7-d049-481c-9cfc-8779c86815b9","Type":"ContainerDied","Data":"f2ea069c5cf684d7b644882fa514791e7cc4dfdea9904ae9ccb50ac38e8c9b25"}
Jul 22 04:34:33.660954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:33.660906    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:33.756976 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:33.756930    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:33.928412 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:33.928321    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vfzcq" event={"ID":"fd97a2d7-d049-481c-9cfc-8779c86815b9","Type":"ContainerStarted","Data":"bc0100cce0cb3fad2305c67e0debf3c5b048aac16e5604466ca71782a8c6c50d"}
Jul 22 04:34:33.928412 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:33.928386    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vfzcq" event={"ID":"fd97a2d7-d049-481c-9cfc-8779c86815b9","Type":"ContainerStarted","Data":"b168ef9613ff78d03138742c721b7cdb74fbb771c12f79be2aa83987818206ca"}
Jul 22 04:34:33.932563 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:33.932537    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:33.946712 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:33.946662    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vfzcq" podStartSLOduration=3.017355874 podStartE2EDuration="3.946646508s" totalImagesPullingTime="867.137909ms" totalInitContainerRuntime="62.152725ms" isStatefulPod=true podCreationTimestamp="2026-07-22 04:34:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:33.945774139 +0000 UTC m=+84.003611716" watchObservedRunningTime="2026-07-22 04:34:33.946646508 +0000 UTC m=+84.004484060"
Jul 22 04:34:34.178096 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:34.178063    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:34.476521 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:34.476488    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:34.527914 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:34.527872    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:35.222098 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.222064    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-55ff5b7b-5wrzj"]
Jul 22 04:34:35.225164 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.225149    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.227751 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.227731    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 22 04:34:35.229214 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.229193    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 22 04:34:35.229309 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.229245    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 22 04:34:35.229309 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.229194    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8jq1mm0peqhp\""
Jul 22 04:34:35.229387 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.229336    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 22 04:34:35.229532 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.229518    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xl2zz\""
Jul 22 04:34:35.234971 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.234934    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55ff5b7b-5wrzj"]
Jul 22 04:34:35.363033 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.363003    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d196a821-f064-419a-9521-8bab54ff3810-client-ca-bundle\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.363194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.363043    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d196a821-f064-419a-9521-8bab54ff3810-audit-log\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.363194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.363120    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d196a821-f064-419a-9521-8bab54ff3810-secret-metrics-server-client-certs\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.363194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.363146    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d196a821-f064-419a-9521-8bab54ff3810-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.363194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.363170    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gcb8\" (UniqueName: \"kubernetes.io/projected/d196a821-f064-419a-9521-8bab54ff3810-kube-api-access-9gcb8\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.363322 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.363215    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d196a821-f064-419a-9521-8bab54ff3810-metrics-server-audit-profiles\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.363322 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.363240    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d196a821-f064-419a-9521-8bab54ff3810-secret-metrics-server-tls\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.463770 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.463739    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d196a821-f064-419a-9521-8bab54ff3810-secret-metrics-server-tls\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.463978 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.463781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d196a821-f064-419a-9521-8bab54ff3810-client-ca-bundle\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.463978 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.463818    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d196a821-f064-419a-9521-8bab54ff3810-audit-log\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.463978 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.463852    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d196a821-f064-419a-9521-8bab54ff3810-secret-metrics-server-client-certs\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.463978 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.463873    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d196a821-f064-419a-9521-8bab54ff3810-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.463978 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.463897    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gcb8\" (UniqueName: \"kubernetes.io/projected/d196a821-f064-419a-9521-8bab54ff3810-kube-api-access-9gcb8\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.463978 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.463923    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d196a821-f064-419a-9521-8bab54ff3810-metrics-server-audit-profiles\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.464309 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.464288    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/d196a821-f064-419a-9521-8bab54ff3810-audit-log\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.464706 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.464682    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d196a821-f064-419a-9521-8bab54ff3810-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.465015 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.464992    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/d196a821-f064-419a-9521-8bab54ff3810-metrics-server-audit-profiles\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.466375 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.466347    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/d196a821-f064-419a-9521-8bab54ff3810-secret-metrics-server-client-certs\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.466526 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.466502    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/d196a821-f064-419a-9521-8bab54ff3810-secret-metrics-server-tls\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.466569 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.466544    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d196a821-f064-419a-9521-8bab54ff3810-client-ca-bundle\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.470916 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.470896    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gcb8\" (UniqueName: \"kubernetes.io/projected/d196a821-f064-419a-9521-8bab54ff3810-kube-api-access-9gcb8\") pod \"metrics-server-55ff5b7b-5wrzj\" (UID: \"d196a821-f064-419a-9521-8bab54ff3810\") " pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.493721 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.493618    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:35.534109 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.534061    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:35.656567 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.656537    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-55ff5b7b-5wrzj"]
Jul 22 04:34:35.659270 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.659247    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:35.659748 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:34:35.659724    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd196a821_f064_419a_9521_8bab54ff3810.slice/crio-0416e5cb0cff1aef4ab03b3dfd99eaff5ebbf2e249408c1131d3f6a27989d4c0 WatchSource:0}: Error finding container 0416e5cb0cff1aef4ab03b3dfd99eaff5ebbf2e249408c1131d3f6a27989d4c0: Status 404 returned error can't find the container with id 0416e5cb0cff1aef4ab03b3dfd99eaff5ebbf2e249408c1131d3f6a27989d4c0
Jul 22 04:34:35.938490 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:35.938403    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj" event={"ID":"d196a821-f064-419a-9521-8bab54ff3810","Type":"ContainerStarted","Data":"0416e5cb0cff1aef4ab03b3dfd99eaff5ebbf2e249408c1131d3f6a27989d4c0"}
Jul 22 04:34:36.923055 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.923017    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:36.928399 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.928372    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:34:36.932569 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.932547    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:36.935323 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.935069    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 04:34:36.935323 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.935162    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 04:34:36.935323 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.935306    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 04:34:36.935525 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.935482    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 04:34:36.935525 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.935507    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 04:34:36.935611 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.935595    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 04:34:36.935742 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.935725    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 04:34:36.936505 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.936484    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 04:34:36.936921 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.936895    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 04:34:36.937106 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.937091    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ncnbd\""
Jul 22 04:34:36.937183 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.937134    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 04:34:36.937183 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.937148    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ft9ei5n2qeun5\""
Jul 22 04:34:36.937265 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.937252    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 04:34:36.937867 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.937684    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 04:34:36.937867 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.937773    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 04:34:36.938890 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.938730    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 04:34:36.948807 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:36.948785    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:34:37.074074 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074040    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074074 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074079    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074310 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074103    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-config\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074310 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074156    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074310 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074197    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074310 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074239    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074310 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074275    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-web-config\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074310 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074303    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4ngx\" (UniqueName: \"kubernetes.io/projected/68178177-6805-4859-9867-5ab008907934-kube-api-access-v4ngx\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074493 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074344    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074493 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074367    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074493 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074415    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074493 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074436    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074493 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074458    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68178177-6805-4859-9867-5ab008907934-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074493 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074475    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68178177-6805-4859-9867-5ab008907934-config-out\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074493 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074490    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074741 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074522    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074741 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074542    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074741 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074559    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074741 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074573    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.074741 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.074597    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175367 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175311    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175472 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175363    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175472 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-config\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175472 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175418    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175472 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175440    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175472 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175464    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175788 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175499    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-web-config\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175788 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175526    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4ngx\" (UniqueName: \"kubernetes.io/projected/68178177-6805-4859-9867-5ab008907934-kube-api-access-v4ngx\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175788 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175555    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175788 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175585    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175788 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175617    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175788 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175639    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175788 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175665    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68178177-6805-4859-9867-5ab008907934-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175788 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175690    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68178177-6805-4859-9867-5ab008907934-config-out\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175788 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175732    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.175788 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175773    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.176283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175797    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.176283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175840    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.176283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175868    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.176283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175900    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.176283 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.175956    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.176529 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.176407    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.176529 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.176486    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.177252 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.177225    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.178010 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.177987    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.178722 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.178696    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.179206 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.179181    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.179636 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.179612    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.179886 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.179862    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.180085 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.180063    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.180290 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.180267    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-web-config\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.180425 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.180403    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-config\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.181109 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.181062    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68178177-6805-4859-9867-5ab008907934-config-out\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.181357 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.181318    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.181446 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.181370    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.182159 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.182137    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.183053 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.183006    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.183149 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.183053    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68178177-6805-4859-9867-5ab008907934-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.183243 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.183222    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.184597 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.184574    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4ngx\" (UniqueName: \"kubernetes.io/projected/68178177-6805-4859-9867-5ab008907934-kube-api-access-v4ngx\") pod \"prometheus-k8s-0\" (UID: \"68178177-6805-4859-9867-5ab008907934\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.244579 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.244539    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:37.400249 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.400214    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:34:37.403404 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:34:37.403374    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68178177_6805_4859_9867_5ab008907934.slice/crio-c7548e14123142b6a4d8e5d2e5053f5daf2f7d112f2a2224de64f73670f5c2b3 WatchSource:0}: Error finding container c7548e14123142b6a4d8e5d2e5053f5daf2f7d112f2a2224de64f73670f5c2b3: Status 404 returned error can't find the container with id c7548e14123142b6a4d8e5d2e5053f5daf2f7d112f2a2224de64f73670f5c2b3
Jul 22 04:34:37.948455 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.948413    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj" event={"ID":"d196a821-f064-419a-9521-8bab54ff3810","Type":"ContainerStarted","Data":"e054350d40d8032dfd91069aeb634ecc4d37ae37dc7ccc6e0a942c1f5d2b3e87"}
Jul 22 04:34:37.949835 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.949805    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerStarted","Data":"c7548e14123142b6a4d8e5d2e5053f5daf2f7d112f2a2224de64f73670f5c2b3"}
Jul 22 04:34:37.965880 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:37.965783    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj" podStartSLOduration=1.516561486 podStartE2EDuration="2.965727986s" totalImagesPullingTime="1.4491665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:37.963383313 +0000 UTC m=+88.021220875" watchObservedRunningTime="2026-07-22 04:34:37.965727986 +0000 UTC m=+88.023565548"
Jul 22 04:34:38.461069 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:38.461037    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:38.954712 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:38.954677    2584 generic.go:356] "Generic (PLEG): container finished" podID="68178177-6805-4859-9867-5ab008907934" containerID="b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659" exitCode=0
Jul 22 04:34:38.955193 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:38.954772    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerDied","Data":"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"}
Jul 22 04:34:40.831312 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:40.831278    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:40.932763 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:40.932721    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:42.973642 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:42.973601    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerStarted","Data":"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"}
Jul 22 04:34:42.974052 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:42.973690    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerStarted","Data":"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"}
Jul 22 04:34:44.119032 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:44.118992    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:44.220726 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:44.220683    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:44.690933 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:44.690902    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:44.792770 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:44.792732    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:44.986661 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:44.986627    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerStarted","Data":"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"}
Jul 22 04:34:44.986836 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:44.986687    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerStarted","Data":"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"}
Jul 22 04:34:44.986836 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:44.986714    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerStarted","Data":"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"}
Jul 22 04:34:44.986836 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:44.986738    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerStarted","Data":"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"}
Jul 22 04:34:45.014161 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:45.014101    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.657512056 podStartE2EDuration="9.014086362s" totalImagesPullingTime="6.336646623s" totalInitContainerRuntime="19.927683ms" isStatefulPod=false podCreationTimestamp="2026-07-22 04:34:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:34:45.013058314 +0000 UTC m=+95.070895892" watchObservedRunningTime="2026-07-22 04:34:45.014086362 +0000 UTC m=+95.071923958"
Jul 22 04:34:46.008664 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:46.008634    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:46.110000 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:46.109965    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:46.163104 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:46.163074    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:46.302991 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:46.302892    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:46.676804 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:46.676712    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:47.129517 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:47.129489    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:47.230840 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:47.230806    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:47.245604 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:47.245579    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:34:47.331218 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:47.331185    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:47.377931 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:47.377899    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:47.484529 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:47.484505    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:47.683103 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:47.683071    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:47.783850 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:47.783776    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:47.931562 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:47.931530    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:49.506633 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:49.506599    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:51.839723 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:51.839691    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:51.940095 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:51.940060    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:52.040824 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:52.040792    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:34:55.534586 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:55.534545    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:55.534999 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:55.534608    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:34:55.898707 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:34:55.898630    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pbxk8"
Jul 22 04:35:03.113954 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:03.113919    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:03.215141 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:03.215109    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:07.305488 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:07.305453    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:07.354912 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:07.354878    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:14.693432 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:14.693396    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:14.748953 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:14.748924    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:15.539333 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:15.539298    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:35:15.543175 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:15.543150    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-55ff5b7b-5wrzj"
Jul 22 04:35:16.112093 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:16.112058    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:16.161008 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:16.160975    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:29.692048 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:29.692016    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:29.792812 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:29.792776    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:37.244788 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:37.244742    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:37.263704 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:37.263673    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:38.185888 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:38.185858    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:46.805805 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:46.805770    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:46.859492 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:46.859462    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:53.452777 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:53.452738    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:53.553708 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:53.553678    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:55.276185 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.276151    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:35:55.276574 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.276423    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68178177-6805-4859-9867-5ab008907934" containerName="prometheus" containerID="cri-o://fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93" gracePeriod=600
Jul 22 04:35:55.276574 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.276445    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68178177-6805-4859-9867-5ab008907934" containerName="kube-rbac-proxy" containerID="cri-o://f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d" gracePeriod=600
Jul 22 04:35:55.276574 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.276463    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68178177-6805-4859-9867-5ab008907934" containerName="thanos-sidecar" containerID="cri-o://6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac" gracePeriod=600
Jul 22 04:35:55.276574 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.276499    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68178177-6805-4859-9867-5ab008907934" containerName="config-reloader" containerID="cri-o://8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5" gracePeriod=600
Jul 22 04:35:55.276574 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.276519    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68178177-6805-4859-9867-5ab008907934" containerName="kube-rbac-proxy-thanos" containerID="cri-o://33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e" gracePeriod=600
Jul 22 04:35:55.276574 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.276500    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="68178177-6805-4859-9867-5ab008907934" containerName="kube-rbac-proxy-web" containerID="cri-o://34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e" gracePeriod=600
Jul 22 04:35:55.519765 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.519742    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:55.687447 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687345    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-db\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.687447 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687384    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-tls\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.687447 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687404    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-config\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.687447 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687431    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-metrics-client-ca\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.687758 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687469    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-kubelet-serving-ca-bundle\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.687758 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687498    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.687758 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687536    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-kube-rbac-proxy\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.687758 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687566    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-2\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.687758 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687593    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.687758 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687638    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-1\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.687758 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687672    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4ngx\" (UniqueName: \"kubernetes.io/projected/68178177-6805-4859-9867-5ab008907934-kube-api-access-v4ngx\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.687758 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687698    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-thanos-prometheus-http-client-file\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.687758 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687725    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-grpc-tls\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.688215 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687791    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-web-config\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.688215 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687805    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:35:55.688215 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687818    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68178177-6805-4859-9867-5ab008907934-tls-assets\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.688215 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687902    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-0\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.688215 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.687937    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:35:55.688722 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.688652    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:35:55.688830 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.688796    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:35:55.688894 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.688857    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-trusted-ca-bundle\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.688971 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.688895    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-metrics-client-certs\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.688971 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.688924    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68178177-6805-4859-9867-5ab008907934-config-out\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.689086 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.688970    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-serving-certs-ca-bundle\") pod \"68178177-6805-4859-9867-5ab008907934\" (UID: \"68178177-6805-4859-9867-5ab008907934\") "
Jul 22 04:35:55.689359 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.689332    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:35:55.689836 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.689534    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.689836 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.689550    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:35:55.689836 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.689571    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.689836 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.689588    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-db\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.689836 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.689602    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-metrics-client-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.689836 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.689618    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.689836 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.689794    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:35:55.690314 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.690059    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:35:55.690704 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.690645    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68178177-6805-4859-9867-5ab008907934-kube-api-access-v4ngx" (OuterVolumeSpecName: "kube-api-access-v4ngx") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "kube-api-access-v4ngx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:35:55.690857 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.690764    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:35:55.691201 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.691175    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68178177-6805-4859-9867-5ab008907934-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:35:55.691431 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.691389    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:35:55.691759 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.691601    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-config" (OuterVolumeSpecName: "config") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:35:55.691759 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.691723    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:35:55.691934 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.691761    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:35:55.692016 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.692001    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68178177-6805-4859-9867-5ab008907934-config-out" (OuterVolumeSpecName: "config-out") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 04:35:55.692499 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.692465    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:35:55.693054 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.693034    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:35:55.693291 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.693271    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:35:55.701667 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.701647    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-web-config" (OuterVolumeSpecName: "web-config") pod "68178177-6805-4859-9867-5ab008907934" (UID: "68178177-6805-4859-9867-5ab008907934"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:35:55.790346 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790308    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790346 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790342    2584 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-kube-rbac-proxy\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790346 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790354    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790549 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790363    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790549 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790373    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4ngx\" (UniqueName: \"kubernetes.io/projected/68178177-6805-4859-9867-5ab008907934-kube-api-access-v4ngx\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790549 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790381    2584 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790549 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790391    2584 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-grpc-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790549 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790399    2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-web-config\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790549 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790406    2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/68178177-6805-4859-9867-5ab008907934-tls-assets\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790549 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790414    2584 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790549 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790422    2584 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-metrics-client-certs\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790549 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790429    2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/68178177-6805-4859-9867-5ab008907934-config-out\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790549 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790438    2584 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68178177-6805-4859-9867-5ab008907934-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790549 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790446    2584 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:55.790549 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:55.790454    2584 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/68178177-6805-4859-9867-5ab008907934-config\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:35:56.233738 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.233706    2584 generic.go:356] "Generic (PLEG): container finished" podID="68178177-6805-4859-9867-5ab008907934" containerID="33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e" exitCode=0
Jul 22 04:35:56.233738 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.233729    2584 generic.go:356] "Generic (PLEG): container finished" podID="68178177-6805-4859-9867-5ab008907934" containerID="f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d" exitCode=0
Jul 22 04:35:56.233738 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.233735    2584 generic.go:356] "Generic (PLEG): container finished" podID="68178177-6805-4859-9867-5ab008907934" containerID="34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e" exitCode=0
Jul 22 04:35:56.233738 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.233740    2584 generic.go:356] "Generic (PLEG): container finished" podID="68178177-6805-4859-9867-5ab008907934" containerID="6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac" exitCode=0
Jul 22 04:35:56.233738 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.233745    2584 generic.go:356] "Generic (PLEG): container finished" podID="68178177-6805-4859-9867-5ab008907934" containerID="8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5" exitCode=0
Jul 22 04:35:56.233738 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.233750    2584 generic.go:356] "Generic (PLEG): container finished" podID="68178177-6805-4859-9867-5ab008907934" containerID="fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93" exitCode=0
Jul 22 04:35:56.234194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.233781    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.234194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.233787    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerDied","Data":"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"}
Jul 22 04:35:56.234194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.233877    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerDied","Data":"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"}
Jul 22 04:35:56.234194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.233919    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerDied","Data":"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"}
Jul 22 04:35:56.234194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.233961    2584 scope.go:117] "RemoveContainer" containerID="33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"
Jul 22 04:35:56.234194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.233980    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerDied","Data":"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"}
Jul 22 04:35:56.234194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.234032    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerDied","Data":"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"}
Jul 22 04:35:56.234194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.234073    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerDied","Data":"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"}
Jul 22 04:35:56.234194 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.234112    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"68178177-6805-4859-9867-5ab008907934","Type":"ContainerDied","Data":"c7548e14123142b6a4d8e5d2e5053f5daf2f7d112f2a2224de64f73670f5c2b3"}
Jul 22 04:35:56.242308 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.242292    2584 scope.go:117] "RemoveContainer" containerID="f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"
Jul 22 04:35:56.253104 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.253084    2584 scope.go:117] "RemoveContainer" containerID="34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"
Jul 22 04:35:56.259664 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.259644    2584 scope.go:117] "RemoveContainer" containerID="6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"
Jul 22 04:35:56.260983 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.260933    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:35:56.266349 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.266327    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:35:56.267357 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.267335    2584 scope.go:117] "RemoveContainer" containerID="8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"
Jul 22 04:35:56.273658 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.273643    2584 scope.go:117] "RemoveContainer" containerID="fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"
Jul 22 04:35:56.280208 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.280086    2584 scope.go:117] "RemoveContainer" containerID="b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"
Jul 22 04:35:56.286410 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.286392    2584 scope.go:117] "RemoveContainer" containerID="33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"
Jul 22 04:35:56.286707 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:35:56.286684    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": container with ID starting with 33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e not found: ID does not exist" containerID="33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"
Jul 22 04:35:56.286763 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.286717    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"} err="failed to get container status \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": rpc error: code = NotFound desc = could not find container \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": container with ID starting with 33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e not found: ID does not exist"
Jul 22 04:35:56.286763 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.286756    2584 scope.go:117] "RemoveContainer" containerID="f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"
Jul 22 04:35:56.287014 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:35:56.286989    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": container with ID starting with f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d not found: ID does not exist" containerID="f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"
Jul 22 04:35:56.287114 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.287015    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"} err="failed to get container status \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": rpc error: code = NotFound desc = could not find container \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": container with ID starting with f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d not found: ID does not exist"
Jul 22 04:35:56.287114 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.287031    2584 scope.go:117] "RemoveContainer" containerID="34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"
Jul 22 04:35:56.287294 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:35:56.287277    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": container with ID starting with 34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e not found: ID does not exist" containerID="34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"
Jul 22 04:35:56.287352 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.287298    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"} err="failed to get container status \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": rpc error: code = NotFound desc = could not find container \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": container with ID starting with 34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e not found: ID does not exist"
Jul 22 04:35:56.287352 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.287320    2584 scope.go:117] "RemoveContainer" containerID="6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"
Jul 22 04:35:56.287511 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:35:56.287494    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": container with ID starting with 6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac not found: ID does not exist" containerID="6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"
Jul 22 04:35:56.287562 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.287514    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"} err="failed to get container status \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": rpc error: code = NotFound desc = could not find container \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": container with ID starting with 6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac not found: ID does not exist"
Jul 22 04:35:56.287562 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.287528    2584 scope.go:117] "RemoveContainer" containerID="8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"
Jul 22 04:35:56.287746 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:35:56.287728    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": container with ID starting with 8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5 not found: ID does not exist" containerID="8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"
Jul 22 04:35:56.287804 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.287749    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"} err="failed to get container status \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": rpc error: code = NotFound desc = could not find container \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": container with ID starting with 8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5 not found: ID does not exist"
Jul 22 04:35:56.287804 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.287761    2584 scope.go:117] "RemoveContainer" containerID="fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"
Jul 22 04:35:56.287976 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:35:56.287960    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": container with ID starting with fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93 not found: ID does not exist" containerID="fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"
Jul 22 04:35:56.288026 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.287978    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"} err="failed to get container status \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": rpc error: code = NotFound desc = could not find container \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": container with ID starting with fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93 not found: ID does not exist"
Jul 22 04:35:56.288026 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.287990    2584 scope.go:117] "RemoveContainer" containerID="b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"
Jul 22 04:35:56.288460 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:35:56.288185    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": container with ID starting with b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659 not found: ID does not exist" containerID="b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"
Jul 22 04:35:56.288460 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.288198    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"} err="failed to get container status \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": rpc error: code = NotFound desc = could not find container \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": container with ID starting with b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659 not found: ID does not exist"
Jul 22 04:35:56.288460 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.288208    2584 scope.go:117] "RemoveContainer" containerID="33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"
Jul 22 04:35:56.288460 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.288396    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"} err="failed to get container status \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": rpc error: code = NotFound desc = could not find container \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": container with ID starting with 33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e not found: ID does not exist"
Jul 22 04:35:56.288460 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.288408    2584 scope.go:117] "RemoveContainer" containerID="f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"
Jul 22 04:35:56.288795 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.288620    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"} err="failed to get container status \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": rpc error: code = NotFound desc = could not find container \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": container with ID starting with f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d not found: ID does not exist"
Jul 22 04:35:56.288795 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.288636    2584 scope.go:117] "RemoveContainer" containerID="34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"
Jul 22 04:35:56.289059 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.288812    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"} err="failed to get container status \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": rpc error: code = NotFound desc = could not find container \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": container with ID starting with 34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e not found: ID does not exist"
Jul 22 04:35:56.289059 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.288829    2584 scope.go:117] "RemoveContainer" containerID="6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"
Jul 22 04:35:56.289822 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.289036    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"} err="failed to get container status \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": rpc error: code = NotFound desc = could not find container \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": container with ID starting with 6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac not found: ID does not exist"
Jul 22 04:35:56.289822 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.289080    2584 scope.go:117] "RemoveContainer" containerID="8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"
Jul 22 04:35:56.290248 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.290095    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"} err="failed to get container status \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": rpc error: code = NotFound desc = could not find container \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": container with ID starting with 8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5 not found: ID does not exist"
Jul 22 04:35:56.290248 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.290116    2584 scope.go:117] "RemoveContainer" containerID="fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"
Jul 22 04:35:56.290556 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.290439    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"} err="failed to get container status \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": rpc error: code = NotFound desc = could not find container \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": container with ID starting with fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93 not found: ID does not exist"
Jul 22 04:35:56.290556 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.290465    2584 scope.go:117] "RemoveContainer" containerID="b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"
Jul 22 04:35:56.290858 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.290728    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"} err="failed to get container status \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": rpc error: code = NotFound desc = could not find container \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": container with ID starting with b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659 not found: ID does not exist"
Jul 22 04:35:56.290858 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.290764    2584 scope.go:117] "RemoveContainer" containerID="33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"
Jul 22 04:35:56.291115 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291022    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"} err="failed to get container status \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": rpc error: code = NotFound desc = could not find container \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": container with ID starting with 33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e not found: ID does not exist"
Jul 22 04:35:56.291115 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291044    2584 scope.go:117] "RemoveContainer" containerID="f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"
Jul 22 04:35:56.291289 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291189    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:35:56.291413 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291326    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"} err="failed to get container status \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": rpc error: code = NotFound desc = could not find container \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": container with ID starting with f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d not found: ID does not exist"
Jul 22 04:35:56.291413 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291344    2584 scope.go:117] "RemoveContainer" containerID="34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"
Jul 22 04:35:56.291591 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291559    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68178177-6805-4859-9867-5ab008907934" containerName="init-config-reloader"
Jul 22 04:35:56.291591 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291576    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68178177-6805-4859-9867-5ab008907934" containerName="init-config-reloader"
Jul 22 04:35:56.291591 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291578    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"} err="failed to get container status \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": rpc error: code = NotFound desc = could not find container \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": container with ID starting with 34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e not found: ID does not exist"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291598    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68178177-6805-4859-9867-5ab008907934" containerName="config-reloader"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291601    2584 scope.go:117] "RemoveContainer" containerID="6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291608    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68178177-6805-4859-9867-5ab008907934" containerName="config-reloader"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291618    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68178177-6805-4859-9867-5ab008907934" containerName="kube-rbac-proxy"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291628    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68178177-6805-4859-9867-5ab008907934" containerName="kube-rbac-proxy"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291636    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68178177-6805-4859-9867-5ab008907934" containerName="kube-rbac-proxy-thanos"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291645    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68178177-6805-4859-9867-5ab008907934" containerName="kube-rbac-proxy-thanos"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291660    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68178177-6805-4859-9867-5ab008907934" containerName="thanos-sidecar"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291669    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68178177-6805-4859-9867-5ab008907934" containerName="thanos-sidecar"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291685    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68178177-6805-4859-9867-5ab008907934" containerName="prometheus"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291693    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68178177-6805-4859-9867-5ab008907934" containerName="prometheus"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291702    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68178177-6805-4859-9867-5ab008907934" containerName="kube-rbac-proxy-web"
Jul 22 04:35:56.291737 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291711    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="68178177-6805-4859-9867-5ab008907934" containerName="kube-rbac-proxy-web"
Jul 22 04:35:56.292358 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291768    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="68178177-6805-4859-9867-5ab008907934" containerName="kube-rbac-proxy-web"
Jul 22 04:35:56.292358 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291779    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="68178177-6805-4859-9867-5ab008907934" containerName="kube-rbac-proxy"
Jul 22 04:35:56.292358 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291789    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="68178177-6805-4859-9867-5ab008907934" containerName="config-reloader"
Jul 22 04:35:56.292358 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291797    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="68178177-6805-4859-9867-5ab008907934" containerName="thanos-sidecar"
Jul 22 04:35:56.292358 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291808    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="68178177-6805-4859-9867-5ab008907934" containerName="prometheus"
Jul 22 04:35:56.292358 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291816    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="68178177-6805-4859-9867-5ab008907934" containerName="kube-rbac-proxy-thanos"
Jul 22 04:35:56.292358 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291840    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"} err="failed to get container status \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": rpc error: code = NotFound desc = could not find container \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": container with ID starting with 6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac not found: ID does not exist"
Jul 22 04:35:56.292358 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.291856    2584 scope.go:117] "RemoveContainer" containerID="8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"
Jul 22 04:35:56.292358 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.292198    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"} err="failed to get container status \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": rpc error: code = NotFound desc = could not find container \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": container with ID starting with 8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5 not found: ID does not exist"
Jul 22 04:35:56.292358 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.292221    2584 scope.go:117] "RemoveContainer" containerID="fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"
Jul 22 04:35:56.292831 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.292477    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"} err="failed to get container status \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": rpc error: code = NotFound desc = could not find container \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": container with ID starting with fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93 not found: ID does not exist"
Jul 22 04:35:56.292831 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.292494    2584 scope.go:117] "RemoveContainer" containerID="b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"
Jul 22 04:35:56.292831 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.292759    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"} err="failed to get container status \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": rpc error: code = NotFound desc = could not find container \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": container with ID starting with b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659 not found: ID does not exist"
Jul 22 04:35:56.292831 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.292781    2584 scope.go:117] "RemoveContainer" containerID="33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"
Jul 22 04:35:56.293175 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.293147    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"} err="failed to get container status \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": rpc error: code = NotFound desc = could not find container \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": container with ID starting with 33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e not found: ID does not exist"
Jul 22 04:35:56.293284 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.293177    2584 scope.go:117] "RemoveContainer" containerID="f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"
Jul 22 04:35:56.293469 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.293448    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"} err="failed to get container status \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": rpc error: code = NotFound desc = could not find container \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": container with ID starting with f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d not found: ID does not exist"
Jul 22 04:35:56.293469 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.293468    2584 scope.go:117] "RemoveContainer" containerID="34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"
Jul 22 04:35:56.293760 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.293736    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"} err="failed to get container status \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": rpc error: code = NotFound desc = could not find container \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": container with ID starting with 34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e not found: ID does not exist"
Jul 22 04:35:56.293835 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.293761    2584 scope.go:117] "RemoveContainer" containerID="6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"
Jul 22 04:35:56.294169 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.294150    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"} err="failed to get container status \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": rpc error: code = NotFound desc = could not find container \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": container with ID starting with 6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac not found: ID does not exist"
Jul 22 04:35:56.294169 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.294168    2584 scope.go:117] "RemoveContainer" containerID="8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"
Jul 22 04:35:56.294463 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.294440    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"} err="failed to get container status \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": rpc error: code = NotFound desc = could not find container \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": container with ID starting with 8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5 not found: ID does not exist"
Jul 22 04:35:56.294531 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.294465    2584 scope.go:117] "RemoveContainer" containerID="fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"
Jul 22 04:35:56.294700 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.294683    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"} err="failed to get container status \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": rpc error: code = NotFound desc = could not find container \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": container with ID starting with fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93 not found: ID does not exist"
Jul 22 04:35:56.294760 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.294701    2584 scope.go:117] "RemoveContainer" containerID="b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"
Jul 22 04:35:56.294978 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.294934    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"} err="failed to get container status \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": rpc error: code = NotFound desc = could not find container \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": container with ID starting with b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659 not found: ID does not exist"
Jul 22 04:35:56.295064 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.294979    2584 scope.go:117] "RemoveContainer" containerID="33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"
Jul 22 04:35:56.295204 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.295182    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"} err="failed to get container status \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": rpc error: code = NotFound desc = could not find container \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": container with ID starting with 33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e not found: ID does not exist"
Jul 22 04:35:56.295204 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.295202    2584 scope.go:117] "RemoveContainer" containerID="f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"
Jul 22 04:35:56.295458 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.295436    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"} err="failed to get container status \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": rpc error: code = NotFound desc = could not find container \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": container with ID starting with f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d not found: ID does not exist"
Jul 22 04:35:56.295518 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.295461    2584 scope.go:117] "RemoveContainer" containerID="34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"
Jul 22 04:35:56.295604 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.295581    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.296101 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.295688    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"} err="failed to get container status \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": rpc error: code = NotFound desc = could not find container \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": container with ID starting with 34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e not found: ID does not exist"
Jul 22 04:35:56.296101 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.295710    2584 scope.go:117] "RemoveContainer" containerID="6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"
Jul 22 04:35:56.296246 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.296220    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"} err="failed to get container status \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": rpc error: code = NotFound desc = could not find container \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": container with ID starting with 6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac not found: ID does not exist"
Jul 22 04:35:56.296246 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.296239    2584 scope.go:117] "RemoveContainer" containerID="8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"
Jul 22 04:35:56.296538 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.296512    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"} err="failed to get container status \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": rpc error: code = NotFound desc = could not find container \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": container with ID starting with 8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5 not found: ID does not exist"
Jul 22 04:35:56.296612 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.296540    2584 scope.go:117] "RemoveContainer" containerID="fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"
Jul 22 04:35:56.296790 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.296764    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"} err="failed to get container status \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": rpc error: code = NotFound desc = could not find container \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": container with ID starting with fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93 not found: ID does not exist"
Jul 22 04:35:56.296846 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.296791    2584 scope.go:117] "RemoveContainer" containerID="b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"
Jul 22 04:35:56.297032 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.297013    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"} err="failed to get container status \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": rpc error: code = NotFound desc = could not find container \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": container with ID starting with b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659 not found: ID does not exist"
Jul 22 04:35:56.297122 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.297039    2584 scope.go:117] "RemoveContainer" containerID="33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"
Jul 22 04:35:56.297274 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.297256    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e"} err="failed to get container status \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": rpc error: code = NotFound desc = could not find container \"33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e\": container with ID starting with 33217d1a9748d4181b4ceeba8f7d10bc583f0a90d8aa12ee4fc3157cabd3751e not found: ID does not exist"
Jul 22 04:35:56.297274 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.297274    2584 scope.go:117] "RemoveContainer" containerID="f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"
Jul 22 04:35:56.297510 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.297488    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d"} err="failed to get container status \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": rpc error: code = NotFound desc = could not find container \"f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d\": container with ID starting with f55921e4d40877ee1bc193b59ae4243a436d77ee8b6a958c5d6b0c019755183d not found: ID does not exist"
Jul 22 04:35:56.297556 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.297514    2584 scope.go:117] "RemoveContainer" containerID="34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"
Jul 22 04:35:56.297765 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.297743    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e"} err="failed to get container status \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": rpc error: code = NotFound desc = could not find container \"34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e\": container with ID starting with 34fdf4320de777cc1d6cbd949a80e44afd4c95651b88139c92a23c40db7ffc3e not found: ID does not exist"
Jul 22 04:35:56.297819 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.297768    2584 scope.go:117] "RemoveContainer" containerID="6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"
Jul 22 04:35:56.298045 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.298022    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac"} err="failed to get container status \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": rpc error: code = NotFound desc = could not find container \"6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac\": container with ID starting with 6c40fbe1d8e83c36fb5f98bf0a7cc419a38b39938ca5a35c67323870226169ac not found: ID does not exist"
Jul 22 04:35:56.298045 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.298044    2584 scope.go:117] "RemoveContainer" containerID="8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"
Jul 22 04:35:56.298245 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.298229    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 22 04:35:56.298301 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.298264    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 22 04:35:56.298354 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.298294    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5"} err="failed to get container status \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": rpc error: code = NotFound desc = could not find container \"8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5\": container with ID starting with 8aa9d840684e05ac0c49b5c77bc8265594d69b9aebc6dc9ac8d7b52dca8787e5 not found: ID does not exist"
Jul 22 04:35:56.298411 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.298350    2584 scope.go:117] "RemoveContainer" containerID="fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"
Jul 22 04:35:56.298556 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.298534    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ncnbd\""
Jul 22 04:35:56.298634 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.298589    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93"} err="failed to get container status \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": rpc error: code = NotFound desc = could not find container \"fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93\": container with ID starting with fc2e6413d9d6ff3d00ab1c2167d80698b6acfc5120bdf0a4b3e70b14f3cd2b93 not found: ID does not exist"
Jul 22 04:35:56.298634 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.298612    2584 scope.go:117] "RemoveContainer" containerID="b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"
Jul 22 04:35:56.298877 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.298859    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 22 04:35:56.298999 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.298895    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659"} err="failed to get container status \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": rpc error: code = NotFound desc = could not find container \"b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659\": container with ID starting with b283f2d657e5db2be11d55ae66c4b032d9299e22d45b0bdecabb3b3347f98659 not found: ID does not exist"
Jul 22 04:35:56.299079 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.299049    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 22 04:35:56.299138 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.299128    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 22 04:35:56.299195 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.299184    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 22 04:35:56.299249 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.299202    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 22 04:35:56.299343 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.299327    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-ft9ei5n2qeun5\""
Jul 22 04:35:56.299397 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.299370    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 22 04:35:56.299797 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.299778    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 22 04:35:56.299921 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.299808    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 22 04:35:56.299921 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.299897    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 22 04:35:56.300167 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.300061    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 22 04:35:56.301672 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.301654    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 22 04:35:56.303936 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.303918    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 22 04:35:56.310887 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.310868    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:35:56.394490 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394447    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx85n\" (UniqueName: \"kubernetes.io/projected/1b2a682d-272f-4870-92f2-4079ef692531-kube-api-access-lx85n\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394490 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394490    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394660 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394513    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394660 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394530    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394660 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394573    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b2a682d-272f-4870-92f2-4079ef692531-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394660 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394586    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394660 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394608    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394660 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394623    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-config\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394660 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394638    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394660 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394654    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394914 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394675    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394914 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394753    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394914 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394797    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394914 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394829    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394914 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394848    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394914 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394866    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.394914 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394904    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.395144 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394920    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-web-config\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.395144 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394959    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b2a682d-272f-4870-92f2-4079ef692531-config-out\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.395144 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.394982    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.475174 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.475133    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68178177-6805-4859-9867-5ab008907934" path="/var/lib/kubelet/pods/68178177-6805-4859-9867-5ab008907934/volumes"
Jul 22 04:35:56.495678 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495617    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.495678 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495646    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.495678 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495665    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b2a682d-272f-4870-92f2-4079ef692531-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495682    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495706    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495728    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-config\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495755    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495828    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495865    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495895    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495914    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495933    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.495989    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.496028    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.496053    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-web-config\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496152 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.496080    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b2a682d-272f-4870-92f2-4079ef692531-config-out\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496813 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.496077    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496813 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.496127    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496813 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.496164    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx85n\" (UniqueName: \"kubernetes.io/projected/1b2a682d-272f-4870-92f2-4079ef692531-kube-api-access-lx85n\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496813 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.496204    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496813 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.496603    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.496813 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.496632    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.497182 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.496857    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.497182 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.496865    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.497182 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.497126    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.499104 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.498027    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.499104 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.499063    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.499302 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.499132    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.499965 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.499912    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.500659 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.500634    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.501143 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.501123    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-web-config\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.501242 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.501190    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-config\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.501242 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.501235    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.501329 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.501264    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.501481 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.501461    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1b2a682d-272f-4870-92f2-4079ef692531-config-out\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.501525 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.501482    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1b2a682d-272f-4870-92f2-4079ef692531-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.501563 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.501544    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1b2a682d-272f-4870-92f2-4079ef692531-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.502654 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.502639    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1b2a682d-272f-4870-92f2-4079ef692531-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.504799 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.504781    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx85n\" (UniqueName: \"kubernetes.io/projected/1b2a682d-272f-4870-92f2-4079ef692531-kube-api-access-lx85n\") pod \"prometheus-k8s-0\" (UID: \"1b2a682d-272f-4870-92f2-4079ef692531\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.608564 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.608532    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:35:56.740664 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:56.740640    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 22 04:35:56.742237 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:35:56.742211    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2a682d_272f_4870_92f2_4079ef692531.slice/crio-44cdf6096cf7f9682803b2ef90a4486ceca1bd77ad2b1754919eedf947273d92 WatchSource:0}: Error finding container 44cdf6096cf7f9682803b2ef90a4486ceca1bd77ad2b1754919eedf947273d92: Status 404 returned error can't find the container with id 44cdf6096cf7f9682803b2ef90a4486ceca1bd77ad2b1754919eedf947273d92
Jul 22 04:35:57.239468 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:57.239432    2584 generic.go:356] "Generic (PLEG): container finished" podID="1b2a682d-272f-4870-92f2-4079ef692531" containerID="466aa59fe32d284e55ee04b54aa559dec1047c4d0943442ae0a8fa67153c74c0" exitCode=0
Jul 22 04:35:57.239618 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:57.239517    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b2a682d-272f-4870-92f2-4079ef692531","Type":"ContainerDied","Data":"466aa59fe32d284e55ee04b54aa559dec1047c4d0943442ae0a8fa67153c74c0"}
Jul 22 04:35:57.239618 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:57.239589    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b2a682d-272f-4870-92f2-4079ef692531","Type":"ContainerStarted","Data":"44cdf6096cf7f9682803b2ef90a4486ceca1bd77ad2b1754919eedf947273d92"}
Jul 22 04:35:58.249535 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:58.249501    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b2a682d-272f-4870-92f2-4079ef692531","Type":"ContainerStarted","Data":"871c76e29ead4da5c3f782812e40b0a8d3a70b8060706166bc8eeaa9d3a82bf8"}
Jul 22 04:35:58.249958 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:58.249588    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b2a682d-272f-4870-92f2-4079ef692531","Type":"ContainerStarted","Data":"5e9b8dac6aa7e77a3be54b5e807c7f1b7d9eedae42cf36672d0a6f73a0f6ebab"}
Jul 22 04:35:58.249958 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:58.249615    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b2a682d-272f-4870-92f2-4079ef692531","Type":"ContainerStarted","Data":"18019c00e81f65ebc2989f8b689f3005b26501dfef94f0f48d848c78ec3fcf76"}
Jul 22 04:35:58.249958 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:58.249638    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b2a682d-272f-4870-92f2-4079ef692531","Type":"ContainerStarted","Data":"3310a28f02c40cd72c2ec066f9009f1a21c03503f471fdf1a86cd1fa92d4a603"}
Jul 22 04:35:58.249958 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:58.249661    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b2a682d-272f-4870-92f2-4079ef692531","Type":"ContainerStarted","Data":"693b57552e5c32190a70e3e0371987390ca29a470eb0bcd16ffcf9987e8046f3"}
Jul 22 04:35:58.249958 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:58.249686    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1b2a682d-272f-4870-92f2-4079ef692531","Type":"ContainerStarted","Data":"de9580404e786e8ef25118e28057ab4984f7fccf8e768eca40bd4e4f044f93e3"}
Jul 22 04:35:58.277575 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:58.277512    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.259362719 podStartE2EDuration="2.277495634s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.132915ms" isStatefulPod=false podCreationTimestamp="2026-07-22 04:35:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:35:58.274835675 +0000 UTC m=+168.332673237" watchObservedRunningTime="2026-07-22 04:35:58.277495634 +0000 UTC m=+168.335333224"
Jul 22 04:35:58.683510 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:58.683429    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:35:58.733405 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:35:58.733356    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:01.608959 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:01.608888    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:36:03.968132 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:03.968049    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:04.021388 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:04.021361    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:04.080186 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:04.080156    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:14.699953 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:14.699907    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:14.799535 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:14.799488    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:41.361930 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:41.361893    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:41.409840 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:41.409809    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:44.290469 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:44.290424    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:44.378816 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:44.378781    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:36:56.609712 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:56.609669    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:36:56.624778 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:56.624754    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:36:57.468118 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:36:57.468095    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 22 04:37:05.889113 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:05.889079    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:06.670307 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:06.670272    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:09.497858 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:09.497810    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:09.549452 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:09.549425    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:11.509912 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:11.509885    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:11.676074 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:11.676032    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:11.795804 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:11.795716    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:13.526921 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:13.526885    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:13.982809 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:13.982776    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:14.174256 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:14.174220    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:16.293930 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:16.293902    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:16.352261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:16.352226    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:21.587759 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:21.587721    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:23.759585 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:23.759544    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:23.860531 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:23.860483    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:29.047641 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:29.047599    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:29.164474 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:29.164439    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:29.267831 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:29.267801    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:31.474647 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:31.474610    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:34.542455 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:34.542350    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:42.410898 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:42.410863    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:42.471008 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:42.470935    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:46.722971 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:46.722922    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:46.828400 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:46.828353    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:47.542163 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:47.542116    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:47.795553 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:47.795472    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:47.899664 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:47.899632    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:47.932200 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:47.932172    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"]
Jul 22 04:37:47.935262 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:47.935240    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:47.938096 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:47.938071    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 22 04:37:47.938210 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:47.938076    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 22 04:37:47.938499 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:47.938481    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 22 04:37:47.938588 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:47.938500    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 22 04:37:47.938649 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:47.938598    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nzjg5\""
Jul 22 04:37:47.963630 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:47.961778    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"]
Jul 22 04:37:48.036032 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.035996    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea388928-b794-4566-be92-6f7c02c36dfd-manifests\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.036032 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.036031    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea388928-b794-4566-be92-6f7c02c36dfd-tmp\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.036226 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.036125    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea388928-b794-4566-be92-6f7c02c36dfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.036226 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.036153    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7hk4\" (UniqueName: \"kubernetes.io/projected/ea388928-b794-4566-be92-6f7c02c36dfd-kube-api-access-j7hk4\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.036226 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.036177    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea388928-b794-4566-be92-6f7c02c36dfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.042125 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.042094    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:48.137401 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.137312    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea388928-b794-4566-be92-6f7c02c36dfd-manifests\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.137401 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.137351    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea388928-b794-4566-be92-6f7c02c36dfd-tmp\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.137614 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.137433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea388928-b794-4566-be92-6f7c02c36dfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.137614 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.137458    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7hk4\" (UniqueName: \"kubernetes.io/projected/ea388928-b794-4566-be92-6f7c02c36dfd-kube-api-access-j7hk4\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.137614 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.137489    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea388928-b794-4566-be92-6f7c02c36dfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.137803 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.137777    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea388928-b794-4566-be92-6f7c02c36dfd-manifests\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.139652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.139625    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea388928-b794-4566-be92-6f7c02c36dfd-tmp\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.139982 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.139962    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea388928-b794-4566-be92-6f7c02c36dfd-webhook-cert\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.140063 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.139986    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea388928-b794-4566-be92-6f7c02c36dfd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.143620 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.143578    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:48.146085 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.146066    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7hk4\" (UniqueName: \"kubernetes.io/projected/ea388928-b794-4566-be92-6f7c02c36dfd-kube-api-access-j7hk4\") pod \"opendatahub-operator-controller-manager-5567574457-8xr7v\" (UID: \"ea388928-b794-4566-be92-6f7c02c36dfd\") " pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.244223 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.244192    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:48.245076 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.245061    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:48.343792 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.343760    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:48.400519 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.400496    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"]
Jul 22 04:37:48.403032 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:37:48.403002    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea388928_b794_4566_be92_6f7c02c36dfd.slice/crio-02d6e0ca53bddbe4b28e4c5d485be5c271760f5ed9bbd7ecaf496c66d83e1844 WatchSource:0}: Error finding container 02d6e0ca53bddbe4b28e4c5d485be5c271760f5ed9bbd7ecaf496c66d83e1844: Status 404 returned error can't find the container with id 02d6e0ca53bddbe4b28e4c5d485be5c271760f5ed9bbd7ecaf496c66d83e1844
Jul 22 04:37:48.465138 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.465097    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:37:48.632114 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:48.632073    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v" event={"ID":"ea388928-b794-4566-be92-6f7c02c36dfd","Type":"ContainerStarted","Data":"02d6e0ca53bddbe4b28e4c5d485be5c271760f5ed9bbd7ecaf496c66d83e1844"}
Jul 22 04:37:51.645024 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:51.644928    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v" event={"ID":"ea388928-b794-4566-be92-6f7c02c36dfd","Type":"ContainerStarted","Data":"8d61508b3a52248e3ba875a6d9cf8ab8f011c679fd3488e3ed4416f093fa23fd"}
Jul 22 04:37:52.649698 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:52.649666    2584 generic.go:356] "Generic (PLEG): container finished" podID="ea388928-b794-4566-be92-6f7c02c36dfd" containerID="8d61508b3a52248e3ba875a6d9cf8ab8f011c679fd3488e3ed4416f093fa23fd" exitCode=0
Jul 22 04:37:52.650136 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:52.649735    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v" event={"ID":"ea388928-b794-4566-be92-6f7c02c36dfd","Type":"ContainerDied","Data":"8d61508b3a52248e3ba875a6d9cf8ab8f011c679fd3488e3ed4416f093fa23fd"}
Jul 22 04:37:53.655341 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:53.655297    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v" event={"ID":"ea388928-b794-4566-be92-6f7c02c36dfd","Type":"ContainerStarted","Data":"e8c6bf8e193a65622eb1052927a806fcac7ed75b2695ad8129ed0ecb0fd2916a"}
Jul 22 04:37:53.655733 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:53.655388    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:37:53.676223 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:37:53.676166    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v" podStartSLOduration=2.340886132 podStartE2EDuration="6.676151247s" totalImagesPullingTime="3.307922609s" totalInitContainerRuntime="1.027342506s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:37:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:37:53.675797955 +0000 UTC m=+283.733635529" watchObservedRunningTime="2026-07-22 04:37:53.676151247 +0000 UTC m=+283.733988808"
Jul 22 04:38:01.443315 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:01.443273    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:01.544785 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:01.544745    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:04.662030 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:04.661999    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5567574457-8xr7v"
Jul 22 04:38:05.434267 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.434229    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"]
Jul 22 04:38:05.439806 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.439783    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.443592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.443566    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 22 04:38:05.443592 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.443586    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 22 04:38:05.443789 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.443594    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 22 04:38:05.443789 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.443634    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 22 04:38:05.443789 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.443571    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 22 04:38:05.443789 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.443586    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6z5fv\""
Jul 22 04:38:05.445417 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.445395    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"]
Jul 22 04:38:05.584203 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.584170    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxhjf\" (UniqueName: \"kubernetes.io/projected/3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5-kube-api-access-rxhjf\") pod \"lws-controller-manager-6f987c9cb4-5x5tv\" (UID: \"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5\") " pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.584381 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.584293    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5-manager-config\") pod \"lws-controller-manager-6f987c9cb4-5x5tv\" (UID: \"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5\") " pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.584381 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.584326    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5-cert\") pod \"lws-controller-manager-6f987c9cb4-5x5tv\" (UID: \"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5\") " pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.584381 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.584358    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5-metrics-cert\") pod \"lws-controller-manager-6f987c9cb4-5x5tv\" (UID: \"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5\") " pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.690476 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.690385    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5-manager-config\") pod \"lws-controller-manager-6f987c9cb4-5x5tv\" (UID: \"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5\") " pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.690476 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.690439    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5-cert\") pod \"lws-controller-manager-6f987c9cb4-5x5tv\" (UID: \"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5\") " pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.690866 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.690480    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5-metrics-cert\") pod \"lws-controller-manager-6f987c9cb4-5x5tv\" (UID: \"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5\") " pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.690866 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.690516    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxhjf\" (UniqueName: \"kubernetes.io/projected/3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5-kube-api-access-rxhjf\") pod \"lws-controller-manager-6f987c9cb4-5x5tv\" (UID: \"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5\") " pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.691142 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.691124    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5-manager-config\") pod \"lws-controller-manager-6f987c9cb4-5x5tv\" (UID: \"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5\") " pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.692884 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.692862    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5-cert\") pod \"lws-controller-manager-6f987c9cb4-5x5tv\" (UID: \"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5\") " pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.693014 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.692993    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5-metrics-cert\") pod \"lws-controller-manager-6f987c9cb4-5x5tv\" (UID: \"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5\") " pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.697894 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.697872    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxhjf\" (UniqueName: \"kubernetes.io/projected/3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5-kube-api-access-rxhjf\") pod \"lws-controller-manager-6f987c9cb4-5x5tv\" (UID: \"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5\") " pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.749100 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.749051    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:05.876771 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:05.876740    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"]
Jul 22 04:38:05.879805 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:38:05.879772    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b70e0f3_5ca1_4a0c_9bc1_f3548f7304e5.slice/crio-27733fc373599322623c462ca78d169a2f15542bf84faec2718d93f59e4116f8 WatchSource:0}: Error finding container 27733fc373599322623c462ca78d169a2f15542bf84faec2718d93f59e4116f8: Status 404 returned error can't find the container with id 27733fc373599322623c462ca78d169a2f15542bf84faec2718d93f59e4116f8
Jul 22 04:38:06.704054 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:06.704018    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv" event={"ID":"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5","Type":"ContainerStarted","Data":"27733fc373599322623c462ca78d169a2f15542bf84faec2718d93f59e4116f8"}
Jul 22 04:38:07.167293 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:07.167260    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:07.271447 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:07.271410    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:07.900047 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:07.899989    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:08.714465 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:08.714432    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv" event={"ID":"3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5","Type":"ContainerStarted","Data":"24110ccb79259dfd3f39847d030fef48cebf30fd2bee8db8c5b7bd0c23b493a8"}
Jul 22 04:38:08.714643 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:08.714503    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:38:08.732089 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:08.732028    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv" podStartSLOduration=1.307017798 podStartE2EDuration="3.732005042s" totalImagesPullingTime="2.424987244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:38:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:38:08.730409592 +0000 UTC m=+298.788247153" watchObservedRunningTime="2026-07-22 04:38:08.732005042 +0000 UTC m=+298.789842604"
Jul 22 04:38:09.398581 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.398553    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"]
Jul 22 04:38:09.401831 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.401810    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"
Jul 22 04:38:09.404345 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.404308    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 22 04:38:09.404864 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.404305    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 04:38:09.405066 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.405048    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 22 04:38:09.405245 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.405220    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 22 04:38:09.405537 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.405515    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8jt7v\""
Jul 22 04:38:09.413263 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.413241    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"]
Jul 22 04:38:09.522579 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.522523    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e2f25ac-546f-4db3-968b-cdb416ce98c0-tmp\") pod \"kube-auth-proxy-d644bdf8d-bqlh8\" (UID: \"2e2f25ac-546f-4db3-968b-cdb416ce98c0\") " pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"
Jul 22 04:38:09.522769 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.522619    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5g8d\" (UniqueName: \"kubernetes.io/projected/2e2f25ac-546f-4db3-968b-cdb416ce98c0-kube-api-access-m5g8d\") pod \"kube-auth-proxy-d644bdf8d-bqlh8\" (UID: \"2e2f25ac-546f-4db3-968b-cdb416ce98c0\") " pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"
Jul 22 04:38:09.522769 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.522668    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2f25ac-546f-4db3-968b-cdb416ce98c0-tls-certs\") pod \"kube-auth-proxy-d644bdf8d-bqlh8\" (UID: \"2e2f25ac-546f-4db3-968b-cdb416ce98c0\") " pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"
Jul 22 04:38:09.536591 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.536557    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:09.623056 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.623019    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5g8d\" (UniqueName: \"kubernetes.io/projected/2e2f25ac-546f-4db3-968b-cdb416ce98c0-kube-api-access-m5g8d\") pod \"kube-auth-proxy-d644bdf8d-bqlh8\" (UID: \"2e2f25ac-546f-4db3-968b-cdb416ce98c0\") " pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"
Jul 22 04:38:09.623261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.623074    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2f25ac-546f-4db3-968b-cdb416ce98c0-tls-certs\") pod \"kube-auth-proxy-d644bdf8d-bqlh8\" (UID: \"2e2f25ac-546f-4db3-968b-cdb416ce98c0\") " pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"
Jul 22 04:38:09.623261 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.623123    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e2f25ac-546f-4db3-968b-cdb416ce98c0-tmp\") pod \"kube-auth-proxy-d644bdf8d-bqlh8\" (UID: \"2e2f25ac-546f-4db3-968b-cdb416ce98c0\") " pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"
Jul 22 04:38:09.625390 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.625354    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e2f25ac-546f-4db3-968b-cdb416ce98c0-tmp\") pod \"kube-auth-proxy-d644bdf8d-bqlh8\" (UID: \"2e2f25ac-546f-4db3-968b-cdb416ce98c0\") " pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"
Jul 22 04:38:09.625788 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.625759    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e2f25ac-546f-4db3-968b-cdb416ce98c0-tls-certs\") pod \"kube-auth-proxy-d644bdf8d-bqlh8\" (UID: \"2e2f25ac-546f-4db3-968b-cdb416ce98c0\") " pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"
Jul 22 04:38:09.630618 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.630590    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5g8d\" (UniqueName: \"kubernetes.io/projected/2e2f25ac-546f-4db3-968b-cdb416ce98c0-kube-api-access-m5g8d\") pod \"kube-auth-proxy-d644bdf8d-bqlh8\" (UID: \"2e2f25ac-546f-4db3-968b-cdb416ce98c0\") " pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"
Jul 22 04:38:09.657494 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.657407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:09.718076 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.718048    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"
Jul 22 04:38:09.849308 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:09.849266    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8"]
Jul 22 04:38:09.851865 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:38:09.851837    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e2f25ac_546f_4db3_968b_cdb416ce98c0.slice/crio-998db7a00efc2ee85a5f2d7ccf2a884eef5847a1f231767ba8ea57023cb4580a WatchSource:0}: Error finding container 998db7a00efc2ee85a5f2d7ccf2a884eef5847a1f231767ba8ea57023cb4580a: Status 404 returned error can't find the container with id 998db7a00efc2ee85a5f2d7ccf2a884eef5847a1f231767ba8ea57023cb4580a
Jul 22 04:38:10.293234 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:10.293207    2584 kubelet.go:1648] "Image garbage collection succeeded"
Jul 22 04:38:10.387164 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:10.387090    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:10.444035 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:10.443959    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:10.723196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:10.723164    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8" event={"ID":"2e2f25ac-546f-4db3-968b-cdb416ce98c0","Type":"ContainerStarted","Data":"998db7a00efc2ee85a5f2d7ccf2a884eef5847a1f231767ba8ea57023cb4580a"}
Jul 22 04:38:11.173520 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:11.173443    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:12.476138 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:12.476103    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 22 04:38:12.732424 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:12.732334    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8" event={"ID":"2e2f25ac-546f-4db3-968b-cdb416ce98c0","Type":"ContainerStarted","Data":"e6e7cd4322cb9428e7f370087dac2f5c4314ed385df246f566e132c93a12144a"}
Jul 22 04:38:12.748963 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:12.748882    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d644bdf8d-bqlh8" podStartSLOduration=1.129172679 podStartE2EDuration="3.74886488s" totalImagesPullingTime="2.619692201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:38:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:38:12.747556811 +0000 UTC m=+302.805394374" watchObservedRunningTime="2026-07-22 04:38:12.74886488 +0000 UTC m=+302.806702466"
Jul 22 04:38:16.584308 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:16.584278    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:16.685272 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:16.685239    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:16.966685 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:16.966647    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:17.117637 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:17.117604    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:17.217497 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:17.217407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:18.052571 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:18.052542    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:18.138216 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:18.138185    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:18.356795 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:18.356719    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:18.454501 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:18.454462    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:18.552235 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:18.552197    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:18.654506 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:18.654414    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:38:19.721224 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:38:19.721187    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f987c9cb4-5x5tv"
Jul 22 04:39:08.644483 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:08.644375    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:08.748156 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:08.748128    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:08.831803 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:08.831771    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:36.807253 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:36.807218    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:37.410923 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:37.410884    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:42.062230 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:42.062197    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:42.171240 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:42.171203    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:42.260665 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:42.260629    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:44.007409 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:44.007370    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:44.117317 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:44.117280    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:44.283672 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:44.283588    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:44.406396 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:44.406364    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:44.823576 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:44.823549    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:45.871977 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:45.871926    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:47.280354 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:47.280322    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:49.427251 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:49.427220    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:51.258904 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:51.258869    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:52.420503 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:52.420466    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:52.471473 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:52.471444    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:52.820648 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:52.820618    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:52.900607 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:52.900581    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:56.629569 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.629540    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:56.734629 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.734590    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:56.796032 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.795994    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"]
Jul 22 04:39:56.799110 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.799092    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"
Jul 22 04:39:56.801405 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.801379    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:56.801988 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.801967    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 22 04:39:56.802306 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.802288    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 22 04:39:56.803117 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.803101    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g8w6n\""
Jul 22 04:39:56.803187 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.803145    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 22 04:39:56.803414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.803399    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 22 04:39:56.809414 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.809391    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"]
Jul 22 04:39:56.868372 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.868334    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/77096d84-ac68-42b5-80fc-3a1c6fac78bd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ljjmp\" (UID: \"77096d84-ac68-42b5-80fc-3a1c6fac78bd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"
Jul 22 04:39:56.868372 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.868373    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77096d84-ac68-42b5-80fc-3a1c6fac78bd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ljjmp\" (UID: \"77096d84-ac68-42b5-80fc-3a1c6fac78bd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"
Jul 22 04:39:56.868582 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.868447    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxwjw\" (UniqueName: \"kubernetes.io/projected/77096d84-ac68-42b5-80fc-3a1c6fac78bd-kube-api-access-zxwjw\") pod \"kuadrant-console-plugin-66b5774985-ljjmp\" (UID: \"77096d84-ac68-42b5-80fc-3a1c6fac78bd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"
Jul 22 04:39:56.969590 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.969552    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/77096d84-ac68-42b5-80fc-3a1c6fac78bd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ljjmp\" (UID: \"77096d84-ac68-42b5-80fc-3a1c6fac78bd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"
Jul 22 04:39:56.969590 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.969592    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77096d84-ac68-42b5-80fc-3a1c6fac78bd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ljjmp\" (UID: \"77096d84-ac68-42b5-80fc-3a1c6fac78bd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"
Jul 22 04:39:56.969809 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.969614    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxwjw\" (UniqueName: \"kubernetes.io/projected/77096d84-ac68-42b5-80fc-3a1c6fac78bd-kube-api-access-zxwjw\") pod \"kuadrant-console-plugin-66b5774985-ljjmp\" (UID: \"77096d84-ac68-42b5-80fc-3a1c6fac78bd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"
Jul 22 04:39:56.969809 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:39:56.969731    2584 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 22 04:39:56.969905 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:39:56.969825    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77096d84-ac68-42b5-80fc-3a1c6fac78bd-plugin-serving-cert podName:77096d84-ac68-42b5-80fc-3a1c6fac78bd nodeName:}" failed. No retries permitted until 2026-07-22 04:39:57.469803394 +0000 UTC m=+407.527640934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/77096d84-ac68-42b5-80fc-3a1c6fac78bd-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-ljjmp" (UID: "77096d84-ac68-42b5-80fc-3a1c6fac78bd") : secret "plugin-serving-cert" not found
Jul 22 04:39:56.970297 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.970276    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/77096d84-ac68-42b5-80fc-3a1c6fac78bd-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ljjmp\" (UID: \"77096d84-ac68-42b5-80fc-3a1c6fac78bd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"
Jul 22 04:39:56.980231 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:56.980208    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxwjw\" (UniqueName: \"kubernetes.io/projected/77096d84-ac68-42b5-80fc-3a1c6fac78bd-kube-api-access-zxwjw\") pod \"kuadrant-console-plugin-66b5774985-ljjmp\" (UID: \"77096d84-ac68-42b5-80fc-3a1c6fac78bd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"
Jul 22 04:39:57.151969 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:57.151887    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:39:57.473099 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:57.473069    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/77096d84-ac68-42b5-80fc-3a1c6fac78bd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ljjmp\" (UID: \"77096d84-ac68-42b5-80fc-3a1c6fac78bd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"
Jul 22 04:39:57.475259 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:57.475228    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/77096d84-ac68-42b5-80fc-3a1c6fac78bd-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ljjmp\" (UID: \"77096d84-ac68-42b5-80fc-3a1c6fac78bd\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"
Jul 22 04:39:57.708674 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:57.708639    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"
Jul 22 04:39:57.842212 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:57.842187    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp"]
Jul 22 04:39:57.844581 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:39:57.844553    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77096d84_ac68_42b5_80fc_3a1c6fac78bd.slice/crio-f1c6d12561f1d30cae84537468e889aa0d1106fe51cc48ad818368ee0e17fe27 WatchSource:0}: Error finding container f1c6d12561f1d30cae84537468e889aa0d1106fe51cc48ad818368ee0e17fe27: Status 404 returned error can't find the container with id f1c6d12561f1d30cae84537468e889aa0d1106fe51cc48ad818368ee0e17fe27
Jul 22 04:39:57.845740 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:57.845718    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 04:39:58.111669 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:39:58.111585    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp" event={"ID":"77096d84-ac68-42b5-80fc-3a1c6fac78bd","Type":"ContainerStarted","Data":"f1c6d12561f1d30cae84537468e889aa0d1106fe51cc48ad818368ee0e17fe27"}
Jul 22 04:40:00.414623 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:00.414583    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:00.515701 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:00.515653    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:07.229294 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:07.229262    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:07.330731 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:07.330693    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:10.998147 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:10.998110    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:11.046751 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:11.046715    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:11.200828 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:11.200792    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:11.257450 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:11.257372    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:12.817774 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:12.817730    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:12.898794 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:12.898665    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:14.362924 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:14.362890    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:14.457413 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:14.457379    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:14.555675 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:14.555646    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:14.657146 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:14.657067    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:15.044408 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:15.044373    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:15.092504 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:15.092468    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:17.871006 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:17.870934    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:17.971104 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:17.971065    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:20.219084 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:20.219045    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp" event={"ID":"77096d84-ac68-42b5-80fc-3a1c6fac78bd","Type":"ContainerStarted","Data":"08c319625f8979b06d100b51325ea97a4817a9bc80984970a0d89ca4e0775c00"}
Jul 22 04:40:20.237759 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:20.237702    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ljjmp" podStartSLOduration=2.674412018 podStartE2EDuration="24.237686596s" totalImagesPullingTime="21.563274578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:39:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:40:20.23637781 +0000 UTC m=+430.294215378" watchObservedRunningTime="2026-07-22 04:40:20.237686596 +0000 UTC m=+430.295524158"
Jul 22 04:40:24.880196 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:24.880156    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:24.983097 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:24.983045    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:25.572781 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:25.572741    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:25.673249 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:25.673208    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:28.689903 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:28.689863    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:28.740040 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:28.740002    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:29.075151 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:29.075115    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:29.125337 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:29.125309    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:31.685315 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:31.685282    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:31.749206 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:31.749176    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:37.078738 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:37.078615    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:37.137575 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:37.137533    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:39.468147 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:39.468115    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:39.837460 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:39.837384    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:43.684135 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:43.684088    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:43.784797 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:43.784765    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:51.544905 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.544863    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"]
Jul 22 04:40:51.551146 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.551118    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:51.593637 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.593597    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"]
Jul 22 04:40:51.593804 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.593713    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"
Jul 22 04:40:51.596167 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.596148    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 22 04:40:51.650997 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.650959    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"]
Jul 22 04:40:51.654571 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.654543    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:51.710793 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.710757    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:51.728092 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.728045    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f655b8b4-94f5-488e-bf79-5372a15f45f9-config-file\") pod \"limitador-limitador-64c94fd64f-tsb5p\" (UID: \"f655b8b4-94f5-488e-bf79-5372a15f45f9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"
Jul 22 04:40:51.728251 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.728110    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lgkw\" (UniqueName: \"kubernetes.io/projected/f655b8b4-94f5-488e-bf79-5372a15f45f9-kube-api-access-5lgkw\") pod \"limitador-limitador-64c94fd64f-tsb5p\" (UID: \"f655b8b4-94f5-488e-bf79-5372a15f45f9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"
Jul 22 04:40:51.829601 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.829512    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lgkw\" (UniqueName: \"kubernetes.io/projected/f655b8b4-94f5-488e-bf79-5372a15f45f9-kube-api-access-5lgkw\") pod \"limitador-limitador-64c94fd64f-tsb5p\" (UID: \"f655b8b4-94f5-488e-bf79-5372a15f45f9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"
Jul 22 04:40:51.829750 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.829673    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f655b8b4-94f5-488e-bf79-5372a15f45f9-config-file\") pod \"limitador-limitador-64c94fd64f-tsb5p\" (UID: \"f655b8b4-94f5-488e-bf79-5372a15f45f9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"
Jul 22 04:40:51.830313 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.830296    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f655b8b4-94f5-488e-bf79-5372a15f45f9-config-file\") pod \"limitador-limitador-64c94fd64f-tsb5p\" (UID: \"f655b8b4-94f5-488e-bf79-5372a15f45f9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"
Jul 22 04:40:51.837002 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.836968    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lgkw\" (UniqueName: \"kubernetes.io/projected/f655b8b4-94f5-488e-bf79-5372a15f45f9-kube-api-access-5lgkw\") pod \"limitador-limitador-64c94fd64f-tsb5p\" (UID: \"f655b8b4-94f5-488e-bf79-5372a15f45f9\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"
Jul 22 04:40:51.902843 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:51.902807    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"
Jul 22 04:40:52.033508 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:52.033473    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"]
Jul 22 04:40:52.038018 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:40:52.037980    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf655b8b4_94f5_488e_bf79_5372a15f45f9.slice/crio-581773f9575676557929c6b00e7ba5329df9f495ac9121845b0eecbb0773e894 WatchSource:0}: Error finding container 581773f9575676557929c6b00e7ba5329df9f495ac9121845b0eecbb0773e894: Status 404 returned error can't find the container with id 581773f9575676557929c6b00e7ba5329df9f495ac9121845b0eecbb0773e894
Jul 22 04:40:52.346262 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:52.346218    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p" event={"ID":"f655b8b4-94f5-488e-bf79-5372a15f45f9","Type":"ContainerStarted","Data":"581773f9575676557929c6b00e7ba5329df9f495ac9121845b0eecbb0773e894"}
Jul 22 04:40:52.377233 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:52.377196    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:52.433635 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:52.433603    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:40:52.554035 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:52.554005    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-4k6lx"]
Jul 22 04:40:52.557765 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:52.557743    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4k6lx"
Jul 22 04:40:52.560466 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:52.560444    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m5rmx\""
Jul 22 04:40:52.561989 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:52.561967    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4k6lx"]
Jul 22 04:40:52.636895 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:52.636802    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnw4z\" (UniqueName: \"kubernetes.io/projected/9ab8751a-f8b1-4724-b2a6-68d36d3617fa-kube-api-access-lnw4z\") pod \"authorino-75d556bd77-4k6lx\" (UID: \"9ab8751a-f8b1-4724-b2a6-68d36d3617fa\") " pod="kuadrant-system/authorino-75d556bd77-4k6lx"
Jul 22 04:40:52.737418 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:52.737377    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnw4z\" (UniqueName: \"kubernetes.io/projected/9ab8751a-f8b1-4724-b2a6-68d36d3617fa-kube-api-access-lnw4z\") pod \"authorino-75d556bd77-4k6lx\" (UID: \"9ab8751a-f8b1-4724-b2a6-68d36d3617fa\") " pod="kuadrant-system/authorino-75d556bd77-4k6lx"
Jul 22 04:40:52.747759 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:52.747722    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnw4z\" (UniqueName: \"kubernetes.io/projected/9ab8751a-f8b1-4724-b2a6-68d36d3617fa-kube-api-access-lnw4z\") pod \"authorino-75d556bd77-4k6lx\" (UID: \"9ab8751a-f8b1-4724-b2a6-68d36d3617fa\") " pod="kuadrant-system/authorino-75d556bd77-4k6lx"
Jul 22 04:40:52.868134 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:52.867836    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4k6lx"
Jul 22 04:40:53.024262 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:53.024201    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4k6lx"]
Jul 22 04:40:53.027144 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:40:53.027109    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ab8751a_f8b1_4724_b2a6_68d36d3617fa.slice/crio-17e392d3a8cc45d608c43ed235b2ca39e10832bdd22ed3b94dcab7a81fb8e4bb WatchSource:0}: Error finding container 17e392d3a8cc45d608c43ed235b2ca39e10832bdd22ed3b94dcab7a81fb8e4bb: Status 404 returned error can't find the container with id 17e392d3a8cc45d608c43ed235b2ca39e10832bdd22ed3b94dcab7a81fb8e4bb
Jul 22 04:40:53.357985 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:53.357923    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4k6lx" event={"ID":"9ab8751a-f8b1-4724-b2a6-68d36d3617fa","Type":"ContainerStarted","Data":"17e392d3a8cc45d608c43ed235b2ca39e10832bdd22ed3b94dcab7a81fb8e4bb"}
Jul 22 04:40:55.374025 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:55.373982    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p" event={"ID":"f655b8b4-94f5-488e-bf79-5372a15f45f9","Type":"ContainerStarted","Data":"473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d"}
Jul 22 04:40:55.374451 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:55.374099    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"
Jul 22 04:40:55.390564 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:55.390494    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p" podStartSLOduration=1.665047765 podStartE2EDuration="4.390476471s" totalImagesPullingTime="2.725428706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:40:55.389112042 +0000 UTC m=+465.446949627" watchObservedRunningTime="2026-07-22 04:40:55.390476471 +0000 UTC m=+465.448314032"
Jul 22 04:40:57.384831 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:57.384798    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4k6lx" event={"ID":"9ab8751a-f8b1-4724-b2a6-68d36d3617fa","Type":"ContainerStarted","Data":"42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103"}
Jul 22 04:40:57.399316 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:40:57.399268    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-4k6lx" podStartSLOduration=1.822575208 podStartE2EDuration="5.39925336s" totalImagesPullingTime="3.576678152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:40:57.397367491 +0000 UTC m=+467.455205067" watchObservedRunningTime="2026-07-22 04:40:57.39925336 +0000 UTC m=+467.457090920"
Jul 22 04:41:06.341163 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:06.341131    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"]
Jul 22 04:41:06.341607 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:06.341304    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p" podUID="f655b8b4-94f5-488e-bf79-5372a15f45f9" containerName="limitador" containerID="cri-o://473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d" gracePeriod=30
Jul 22 04:41:06.342032 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:06.342011    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"
Jul 22 04:41:06.879656 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:06.879629    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"
Jul 22 04:41:07.061523 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.061478    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5lgkw\" (UniqueName: \"kubernetes.io/projected/f655b8b4-94f5-488e-bf79-5372a15f45f9-kube-api-access-5lgkw\") pod \"f655b8b4-94f5-488e-bf79-5372a15f45f9\" (UID: \"f655b8b4-94f5-488e-bf79-5372a15f45f9\") "
Jul 22 04:41:07.061523 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.061534    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f655b8b4-94f5-488e-bf79-5372a15f45f9-config-file\") pod \"f655b8b4-94f5-488e-bf79-5372a15f45f9\" (UID: \"f655b8b4-94f5-488e-bf79-5372a15f45f9\") "
Jul 22 04:41:07.061915 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.061889    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f655b8b4-94f5-488e-bf79-5372a15f45f9-config-file" (OuterVolumeSpecName: "config-file") pod "f655b8b4-94f5-488e-bf79-5372a15f45f9" (UID: "f655b8b4-94f5-488e-bf79-5372a15f45f9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 04:41:07.063714 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.063684    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f655b8b4-94f5-488e-bf79-5372a15f45f9-kube-api-access-5lgkw" (OuterVolumeSpecName: "kube-api-access-5lgkw") pod "f655b8b4-94f5-488e-bf79-5372a15f45f9" (UID: "f655b8b4-94f5-488e-bf79-5372a15f45f9"). InnerVolumeSpecName "kube-api-access-5lgkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:41:07.162125 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.162075    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5lgkw\" (UniqueName: \"kubernetes.io/projected/f655b8b4-94f5-488e-bf79-5372a15f45f9-kube-api-access-5lgkw\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:41:07.162125 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.162121    2584 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f655b8b4-94f5-488e-bf79-5372a15f45f9-config-file\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:41:07.426036 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.425930    2584 generic.go:356] "Generic (PLEG): container finished" podID="f655b8b4-94f5-488e-bf79-5372a15f45f9" containerID="473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d" exitCode=0
Jul 22 04:41:07.426036 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.426005    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"
Jul 22 04:41:07.426036 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.426014    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p" event={"ID":"f655b8b4-94f5-488e-bf79-5372a15f45f9","Type":"ContainerDied","Data":"473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d"}
Jul 22 04:41:07.426482 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.426081    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-tsb5p" event={"ID":"f655b8b4-94f5-488e-bf79-5372a15f45f9","Type":"ContainerDied","Data":"581773f9575676557929c6b00e7ba5329df9f495ac9121845b0eecbb0773e894"}
Jul 22 04:41:07.426482 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.426112    2584 scope.go:117] "RemoveContainer" containerID="473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d"
Jul 22 04:41:07.434822 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.434772    2584 scope.go:117] "RemoveContainer" containerID="473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d"
Jul 22 04:41:07.435251 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:41:07.435229    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d\": container with ID starting with 473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d not found: ID does not exist" containerID="473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d"
Jul 22 04:41:07.435325 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.435261    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d"} err="failed to get container status \"473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d\": rpc error: code = NotFound desc = could not find container \"473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d\": container with ID starting with 473b4e653e9798342c499370fbac90f76a6693e117f543bebc93a3edd0c42c0d not found: ID does not exist"
Jul 22 04:41:07.446879 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.446854    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"]
Jul 22 04:41:07.450355 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.450335    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-tsb5p"]
Jul 22 04:41:07.900032 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.899995    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:41:07.998163 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:07.998131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:41:08.335407 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.335374    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"]
Jul 22 04:41:08.335678 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.335666    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f655b8b4-94f5-488e-bf79-5372a15f45f9" containerName="limitador"
Jul 22 04:41:08.335724 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.335680    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f655b8b4-94f5-488e-bf79-5372a15f45f9" containerName="limitador"
Jul 22 04:41:08.335758 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.335751    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f655b8b4-94f5-488e-bf79-5372a15f45f9" containerName="limitador"
Jul 22 04:41:08.338321 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.338301    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"
Jul 22 04:41:08.340830 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.340809    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 22 04:41:08.340964 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.340839    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 22 04:41:08.340964 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.340840    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 22 04:41:08.341807 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.341790    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-872x9\""
Jul 22 04:41:08.347499 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.347477    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"]
Jul 22 04:41:08.370615 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.370586    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5b53e45a-a900-4851-8908-df0c6db0be9b-data\") pod \"postgres-69fb4594cf-smxnn\" (UID: \"5b53e45a-a900-4851-8908-df0c6db0be9b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"
Jul 22 04:41:08.370725 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.370628    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp4g6\" (UniqueName: \"kubernetes.io/projected/5b53e45a-a900-4851-8908-df0c6db0be9b-kube-api-access-dp4g6\") pod \"postgres-69fb4594cf-smxnn\" (UID: \"5b53e45a-a900-4851-8908-df0c6db0be9b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"
Jul 22 04:41:08.391719 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.391661    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:41:08.471083 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.471051    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp4g6\" (UniqueName: \"kubernetes.io/projected/5b53e45a-a900-4851-8908-df0c6db0be9b-kube-api-access-dp4g6\") pod \"postgres-69fb4594cf-smxnn\" (UID: \"5b53e45a-a900-4851-8908-df0c6db0be9b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"
Jul 22 04:41:08.471444 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.471125    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5b53e45a-a900-4851-8908-df0c6db0be9b-data\") pod \"postgres-69fb4594cf-smxnn\" (UID: \"5b53e45a-a900-4851-8908-df0c6db0be9b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"
Jul 22 04:41:08.471444 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.471432    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5b53e45a-a900-4851-8908-df0c6db0be9b-data\") pod \"postgres-69fb4594cf-smxnn\" (UID: \"5b53e45a-a900-4851-8908-df0c6db0be9b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"
Jul 22 04:41:08.475559 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.475536    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f655b8b4-94f5-488e-bf79-5372a15f45f9" path="/var/lib/kubelet/pods/f655b8b4-94f5-488e-bf79-5372a15f45f9/volumes"
Jul 22 04:41:08.480625 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.480604    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp4g6\" (UniqueName: \"kubernetes.io/projected/5b53e45a-a900-4851-8908-df0c6db0be9b-kube-api-access-dp4g6\") pod \"postgres-69fb4594cf-smxnn\" (UID: \"5b53e45a-a900-4851-8908-df0c6db0be9b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"
Jul 22 04:41:08.649089 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.648998    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"
Jul 22 04:41:08.784534 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:08.784498    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"]
Jul 22 04:41:08.788628 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:41:08.788595    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b53e45a_a900_4851_8908_df0c6db0be9b.slice/crio-3598325213a1412fd83dd4d4702b4d282cdc392ce66f7423abdce41bd2e4be4e WatchSource:0}: Error finding container 3598325213a1412fd83dd4d4702b4d282cdc392ce66f7423abdce41bd2e4be4e: Status 404 returned error can't find the container with id 3598325213a1412fd83dd4d4702b4d282cdc392ce66f7423abdce41bd2e4be4e
Jul 22 04:41:09.437166 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:09.437130    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn" event={"ID":"5b53e45a-a900-4851-8908-df0c6db0be9b","Type":"ContainerStarted","Data":"3598325213a1412fd83dd4d4702b4d282cdc392ce66f7423abdce41bd2e4be4e"}
Jul 22 04:41:14.343482 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:14.343457    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 22 04:41:14.460562 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:14.460530    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn" event={"ID":"5b53e45a-a900-4851-8908-df0c6db0be9b","Type":"ContainerStarted","Data":"5a58ad43ae1b785f34e976d8eda3fd60a9def0025105cfebb544fb75a745bc32"}
Jul 22 04:41:14.460713 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:14.460599    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"
Jul 22 04:41:14.474903 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:14.474851    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn" podStartSLOduration=0.923766017 podStartE2EDuration="6.474835396s" totalImagesPullingTime="5.551069379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:41:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:41:14.474451422 +0000 UTC m=+484.532289007" watchObservedRunningTime="2026-07-22 04:41:14.474835396 +0000 UTC m=+484.532672956"
Jul 22 04:41:20.495020 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:20.494982    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-smxnn"
Jul 22 04:41:20.801897 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:20.801809    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:41:21.599768 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:21.599721    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:41:22.739429 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:22.739394    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4k6lx"]
Jul 22 04:41:22.739889 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:22.739566    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-4k6lx" podUID="9ab8751a-f8b1-4724-b2a6-68d36d3617fa" containerName="authorino" containerID="cri-o://42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103" gracePeriod=30
Jul 22 04:41:22.989024 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:22.989001    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4k6lx"
Jul 22 04:41:23.087997 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:23.087909    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnw4z\" (UniqueName: \"kubernetes.io/projected/9ab8751a-f8b1-4724-b2a6-68d36d3617fa-kube-api-access-lnw4z\") pod \"9ab8751a-f8b1-4724-b2a6-68d36d3617fa\" (UID: \"9ab8751a-f8b1-4724-b2a6-68d36d3617fa\") "
Jul 22 04:41:23.089907 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:23.089884    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ab8751a-f8b1-4724-b2a6-68d36d3617fa-kube-api-access-lnw4z" (OuterVolumeSpecName: "kube-api-access-lnw4z") pod "9ab8751a-f8b1-4724-b2a6-68d36d3617fa" (UID: "9ab8751a-f8b1-4724-b2a6-68d36d3617fa"). InnerVolumeSpecName "kube-api-access-lnw4z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:41:23.189099 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:23.189064    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnw4z\" (UniqueName: \"kubernetes.io/projected/9ab8751a-f8b1-4724-b2a6-68d36d3617fa-kube-api-access-lnw4z\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:41:23.500765 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:23.500732    2584 generic.go:356] "Generic (PLEG): container finished" podID="9ab8751a-f8b1-4724-b2a6-68d36d3617fa" containerID="42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103" exitCode=0
Jul 22 04:41:23.500765 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:23.500768    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-4k6lx"
Jul 22 04:41:23.501063 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:23.500812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4k6lx" event={"ID":"9ab8751a-f8b1-4724-b2a6-68d36d3617fa","Type":"ContainerDied","Data":"42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103"}
Jul 22 04:41:23.501063 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:23.500853    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-4k6lx" event={"ID":"9ab8751a-f8b1-4724-b2a6-68d36d3617fa","Type":"ContainerDied","Data":"17e392d3a8cc45d608c43ed235b2ca39e10832bdd22ed3b94dcab7a81fb8e4bb"}
Jul 22 04:41:23.501063 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:23.500870    2584 scope.go:117] "RemoveContainer" containerID="42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103"
Jul 22 04:41:23.511335 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:23.511317    2584 scope.go:117] "RemoveContainer" containerID="42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103"
Jul 22 04:41:23.511797 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:41:23.511774    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103\": container with ID starting with 42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103 not found: ID does not exist" containerID="42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103"
Jul 22 04:41:23.511850 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:23.511809    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103"} err="failed to get container status \"42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103\": rpc error: code = NotFound desc = could not find container \"42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103\": container with ID starting with 42af2133b72b37e361f2a78fddc60dc844b45a2123d1397de0db127a69ce9103 not found: ID does not exist"
Jul 22 04:41:23.523031 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:23.522985    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4k6lx"]
Jul 22 04:41:23.526841 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:23.526818    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-4k6lx"]
Jul 22 04:41:24.475648 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:24.475612    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ab8751a-f8b1-4724-b2a6-68d36d3617fa" path="/var/lib/kubelet/pods/9ab8751a-f8b1-4724-b2a6-68d36d3617fa/volumes"
Jul 22 04:41:27.411602 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.411568    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:41:27.427591 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.427560    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cbf4f4894-2l7jq"]
Jul 22 04:41:27.427863 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.427850    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ab8751a-f8b1-4724-b2a6-68d36d3617fa" containerName="authorino"
Jul 22 04:41:27.427910 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.427863    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ab8751a-f8b1-4724-b2a6-68d36d3617fa" containerName="authorino"
Jul 22 04:41:27.427910 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.427907    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ab8751a-f8b1-4724-b2a6-68d36d3617fa" containerName="authorino"
Jul 22 04:41:27.506773 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.506736    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:41:27.587873 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.587837    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:41:27.659147 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.659109    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cbf4f4894-2l7jq"]
Jul 22 04:41:27.659281 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.659223    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cbf4f4894-2l7jq"
Jul 22 04:41:27.661967 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.661888    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 22 04:41:27.661967 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.661896    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-chh6j\""
Jul 22 04:41:27.661967 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.661898    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 22 04:41:27.727647 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.727616    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9-webhook-cert\") pod \"maas-controller-7cbf4f4894-2l7jq\" (UID: \"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9\") " pod="opendatahub/maas-controller-7cbf4f4894-2l7jq"
Jul 22 04:41:27.727802 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.727656    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q58m7\" (UniqueName: \"kubernetes.io/projected/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9-kube-api-access-q58m7\") pod \"maas-controller-7cbf4f4894-2l7jq\" (UID: \"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9\") " pod="opendatahub/maas-controller-7cbf4f4894-2l7jq"
Jul 22 04:41:27.741487 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.741461    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:41:27.828259 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.828228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9-webhook-cert\") pod \"maas-controller-7cbf4f4894-2l7jq\" (UID: \"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9\") " pod="opendatahub/maas-controller-7cbf4f4894-2l7jq"
Jul 22 04:41:27.828423 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.828266    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q58m7\" (UniqueName: \"kubernetes.io/projected/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9-kube-api-access-q58m7\") pod \"maas-controller-7cbf4f4894-2l7jq\" (UID: \"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9\") " pod="opendatahub/maas-controller-7cbf4f4894-2l7jq"
Jul 22 04:41:27.830810 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.830774    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9-webhook-cert\") pod \"maas-controller-7cbf4f4894-2l7jq\" (UID: \"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9\") " pod="opendatahub/maas-controller-7cbf4f4894-2l7jq"
Jul 22 04:41:27.836829 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.836805    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q58m7\" (UniqueName: \"kubernetes.io/projected/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9-kube-api-access-q58m7\") pod \"maas-controller-7cbf4f4894-2l7jq\" (UID: \"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9\") " pod="opendatahub/maas-controller-7cbf4f4894-2l7jq"
Jul 22 04:41:27.969082 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:27.969050    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cbf4f4894-2l7jq"
Jul 22 04:41:28.108895 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:28.108869    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cbf4f4894-2l7jq"]
Jul 22 04:41:28.111187 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:41:28.111160    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod673ae77e_22f8_45b9_ba28_0bf2bbe6efd9.slice/crio-89f7134ff16e6630347c460442dd18033c3171259183b5e78842a3f8d7dea2ac WatchSource:0}: Error finding container 89f7134ff16e6630347c460442dd18033c3171259183b5e78842a3f8d7dea2ac: Status 404 returned error can't find the container with id 89f7134ff16e6630347c460442dd18033c3171259183b5e78842a3f8d7dea2ac
Jul 22 04:41:28.523045 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:28.523002    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cbf4f4894-2l7jq" event={"ID":"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9","Type":"ContainerStarted","Data":"89f7134ff16e6630347c460442dd18033c3171259183b5e78842a3f8d7dea2ac"}
Jul 22 04:41:30.435170 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:30.435144    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:41:30.533155 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:30.533119    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cbf4f4894-2l7jq" event={"ID":"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9","Type":"ContainerStarted","Data":"3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471"}
Jul 22 04:41:30.533356 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:30.533181    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cbf4f4894-2l7jq"
Jul 22 04:41:30.533446 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:30.533415    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:41:41.540290 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:41.540260    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cbf4f4894-2l7jq"
Jul 22 04:41:41.557516 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:41.557473    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cbf4f4894-2l7jq" podStartSLOduration=12.384793446 podStartE2EDuration="14.557457051s" totalImagesPullingTime="2.172663605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:41:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:41:30.550410797 +0000 UTC m=+500.608248359" watchObservedRunningTime="2026-07-22 04:41:41.557457051 +0000 UTC m=+511.615294611"
Jul 22 04:41:41.799736 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:41.799656    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cbf4f4894-2l7jq"]
Jul 22 04:41:41.799880 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:41.799839    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7cbf4f4894-2l7jq" podUID="673ae77e-22f8-45b9-ba28-0bf2bbe6efd9" containerName="manager" containerID="cri-o://3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471" gracePeriod=30
Jul 22 04:41:42.035301 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.035278    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cbf4f4894-2l7jq"
Jul 22 04:41:42.158895 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.158807    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q58m7\" (UniqueName: \"kubernetes.io/projected/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9-kube-api-access-q58m7\") pod \"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9\" (UID: \"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9\") "
Jul 22 04:41:42.158895 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.158846    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9-webhook-cert\") pod \"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9\" (UID: \"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9\") "
Jul 22 04:41:42.161124 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.161083    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "673ae77e-22f8-45b9-ba28-0bf2bbe6efd9" (UID: "673ae77e-22f8-45b9-ba28-0bf2bbe6efd9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 04:41:42.161230 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.161177    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9-kube-api-access-q58m7" (OuterVolumeSpecName: "kube-api-access-q58m7") pod "673ae77e-22f8-45b9-ba28-0bf2bbe6efd9" (UID: "673ae77e-22f8-45b9-ba28-0bf2bbe6efd9"). InnerVolumeSpecName "kube-api-access-q58m7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 04:41:42.259984 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.259927    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q58m7\" (UniqueName: \"kubernetes.io/projected/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9-kube-api-access-q58m7\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:41:42.259984 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.259978    2584 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9-webhook-cert\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 04:41:42.586179 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.586135    2584 generic.go:356] "Generic (PLEG): container finished" podID="673ae77e-22f8-45b9-ba28-0bf2bbe6efd9" containerID="3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471" exitCode=0
Jul 22 04:41:42.586582 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.586193    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cbf4f4894-2l7jq"
Jul 22 04:41:42.586582 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.586195    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cbf4f4894-2l7jq" event={"ID":"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9","Type":"ContainerDied","Data":"3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471"}
Jul 22 04:41:42.586582 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.586275    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cbf4f4894-2l7jq" event={"ID":"673ae77e-22f8-45b9-ba28-0bf2bbe6efd9","Type":"ContainerDied","Data":"89f7134ff16e6630347c460442dd18033c3171259183b5e78842a3f8d7dea2ac"}
Jul 22 04:41:42.586582 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.586298    2584 scope.go:117] "RemoveContainer" containerID="3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471"
Jul 22 04:41:42.594249 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.594228    2584 scope.go:117] "RemoveContainer" containerID="3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471"
Jul 22 04:41:42.594496 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:41:42.594478    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471\": container with ID starting with 3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471 not found: ID does not exist" containerID="3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471"
Jul 22 04:41:42.594542 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.594504    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471"} err="failed to get container status \"3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471\": rpc error: code = NotFound desc = could not find container \"3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471\": container with ID starting with 3306675aaecbd4a1f696fd32aa241c2f2ea3500ff07aa6878916d90909d11471 not found: ID does not exist"
Jul 22 04:41:42.603179 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.603152    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7cbf4f4894-2l7jq"]
Jul 22 04:41:42.605118 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:42.605098    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7cbf4f4894-2l7jq"]
Jul 22 04:41:44.476057 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:41:44.476025    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="673ae77e-22f8-45b9-ba28-0bf2bbe6efd9" path="/var/lib/kubelet/pods/673ae77e-22f8-45b9-ba28-0bf2bbe6efd9/volumes"
Jul 22 04:42:02.080763 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.080728    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:02.175771 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.175733    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:02.554282 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.554245    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:02.593025 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.592988    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67476b6695-ghz87"]
Jul 22 04:42:02.593393 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.593380    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="673ae77e-22f8-45b9-ba28-0bf2bbe6efd9" containerName="manager"
Jul 22 04:42:02.593435 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.593398    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="673ae77e-22f8-45b9-ba28-0bf2bbe6efd9" containerName="manager"
Jul 22 04:42:02.593499 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.593487    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="673ae77e-22f8-45b9-ba28-0bf2bbe6efd9" containerName="manager"
Jul 22 04:42:02.596892 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.596874    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:02.599625 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.599603    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 22 04:42:02.610000 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.609973    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67476b6695-ghz87"]
Jul 22 04:42:02.625273 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.625237    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xsrc\" (UniqueName: \"kubernetes.io/projected/d3c71d11-298b-4f8d-b71b-49eac4b8f1ec-kube-api-access-5xsrc\") pod \"maas-api-67476b6695-ghz87\" (UID: \"d3c71d11-298b-4f8d-b71b-49eac4b8f1ec\") " pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:02.625436 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.625313    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3c71d11-298b-4f8d-b71b-49eac4b8f1ec-maas-api-tls\") pod \"maas-api-67476b6695-ghz87\" (UID: \"d3c71d11-298b-4f8d-b71b-49eac4b8f1ec\") " pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:02.625436 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.625374    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3c71d11-298b-4f8d-b71b-49eac4b8f1ec-openshift-service-ca\") pod \"maas-api-67476b6695-ghz87\" (UID: \"d3c71d11-298b-4f8d-b71b-49eac4b8f1ec\") " pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:02.726445 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.726397    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xsrc\" (UniqueName: \"kubernetes.io/projected/d3c71d11-298b-4f8d-b71b-49eac4b8f1ec-kube-api-access-5xsrc\") pod \"maas-api-67476b6695-ghz87\" (UID: \"d3c71d11-298b-4f8d-b71b-49eac4b8f1ec\") " pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:02.726623 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.726461    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3c71d11-298b-4f8d-b71b-49eac4b8f1ec-maas-api-tls\") pod \"maas-api-67476b6695-ghz87\" (UID: \"d3c71d11-298b-4f8d-b71b-49eac4b8f1ec\") " pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:02.726623 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.726500    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3c71d11-298b-4f8d-b71b-49eac4b8f1ec-openshift-service-ca\") pod \"maas-api-67476b6695-ghz87\" (UID: \"d3c71d11-298b-4f8d-b71b-49eac4b8f1ec\") " pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:02.726623 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:42:02.726612    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 22 04:42:02.726727 ip-10-0-137-249 kubenswrapper[2584]: E0722 04:42:02.726692    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3c71d11-298b-4f8d-b71b-49eac4b8f1ec-maas-api-tls podName:d3c71d11-298b-4f8d-b71b-49eac4b8f1ec nodeName:}" failed. No retries permitted until 2026-07-22 04:42:03.226673387 +0000 UTC m=+533.284510932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d3c71d11-298b-4f8d-b71b-49eac4b8f1ec-maas-api-tls") pod "maas-api-67476b6695-ghz87" (UID: "d3c71d11-298b-4f8d-b71b-49eac4b8f1ec") : secret "maas-api-serving-cert" not found
Jul 22 04:42:02.727292 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.727272    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3c71d11-298b-4f8d-b71b-49eac4b8f1ec-openshift-service-ca\") pod \"maas-api-67476b6695-ghz87\" (UID: \"d3c71d11-298b-4f8d-b71b-49eac4b8f1ec\") " pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:02.734904 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:02.734880    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xsrc\" (UniqueName: \"kubernetes.io/projected/d3c71d11-298b-4f8d-b71b-49eac4b8f1ec-kube-api-access-5xsrc\") pod \"maas-api-67476b6695-ghz87\" (UID: \"d3c71d11-298b-4f8d-b71b-49eac4b8f1ec\") " pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:03.096507 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.096475    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:03.201714 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.201655    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:03.201969 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.201935    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"]
Jul 22 04:42:03.205269 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.205252    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"
Jul 22 04:42:03.207826 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.207802    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-ghjwv\""
Jul 22 04:42:03.207826 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.207821    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 22 04:42:03.219002 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.218976    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"]
Jul 22 04:42:03.231219 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.231188    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7gnv\" (UniqueName: \"kubernetes.io/projected/b38f5afd-474a-4fdc-9491-b3ad0fb2af89-kube-api-access-l7gnv\") pod \"payload-pre-processing-7677b774bb-hjmn5\" (UID: \"b38f5afd-474a-4fdc-9491-b3ad0fb2af89\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"
Jul 22 04:42:03.231373 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.231233    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b38f5afd-474a-4fdc-9491-b3ad0fb2af89-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-hjmn5\" (UID: \"b38f5afd-474a-4fdc-9491-b3ad0fb2af89\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"
Jul 22 04:42:03.231373 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.231272    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3c71d11-298b-4f8d-b71b-49eac4b8f1ec-maas-api-tls\") pod \"maas-api-67476b6695-ghz87\" (UID: \"d3c71d11-298b-4f8d-b71b-49eac4b8f1ec\") " pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:03.233576 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.233543    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d3c71d11-298b-4f8d-b71b-49eac4b8f1ec-maas-api-tls\") pod \"maas-api-67476b6695-ghz87\" (UID: \"d3c71d11-298b-4f8d-b71b-49eac4b8f1ec\") " pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:03.295192 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.295154    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:03.332226 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.332195    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7gnv\" (UniqueName: \"kubernetes.io/projected/b38f5afd-474a-4fdc-9491-b3ad0fb2af89-kube-api-access-l7gnv\") pod \"payload-pre-processing-7677b774bb-hjmn5\" (UID: \"b38f5afd-474a-4fdc-9491-b3ad0fb2af89\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"
Jul 22 04:42:03.332386 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.332242    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b38f5afd-474a-4fdc-9491-b3ad0fb2af89-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-hjmn5\" (UID: \"b38f5afd-474a-4fdc-9491-b3ad0fb2af89\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"
Jul 22 04:42:03.332898 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.332879    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b38f5afd-474a-4fdc-9491-b3ad0fb2af89-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-hjmn5\" (UID: \"b38f5afd-474a-4fdc-9491-b3ad0fb2af89\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"
Jul 22 04:42:03.342819 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.342793    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7gnv\" (UniqueName: \"kubernetes.io/projected/b38f5afd-474a-4fdc-9491-b3ad0fb2af89-kube-api-access-l7gnv\") pod \"payload-pre-processing-7677b774bb-hjmn5\" (UID: \"b38f5afd-474a-4fdc-9491-b3ad0fb2af89\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"
Jul 22 04:42:03.512879 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.512843    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:03.515722 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.515704    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"
Jul 22 04:42:03.660037 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.660001    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"]
Jul 22 04:42:03.665010 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:42:03.664979    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38f5afd_474a_4fdc_9491_b3ad0fb2af89.slice/crio-16817df2317b1240725805f1746d734140424e1a6dd6c2574181e8661cd87260 WatchSource:0}: Error finding container 16817df2317b1240725805f1746d734140424e1a6dd6c2574181e8661cd87260: Status 404 returned error can't find the container with id 16817df2317b1240725805f1746d734140424e1a6dd6c2574181e8661cd87260
Jul 22 04:42:03.672386 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.672359    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5" event={"ID":"b38f5afd-474a-4fdc-9491-b3ad0fb2af89","Type":"ContainerStarted","Data":"16817df2317b1240725805f1746d734140424e1a6dd6c2574181e8661cd87260"}
Jul 22 04:42:03.687308 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:03.687265    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67476b6695-ghz87"]
Jul 22 04:42:03.689350 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:42:03.689329    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c71d11_298b_4f8d_b71b_49eac4b8f1ec.slice/crio-f51c1eef132dbab3b2a01f8d22693f2f7b3ddc2a6facae6191b4d080b5d00ebf WatchSource:0}: Error finding container f51c1eef132dbab3b2a01f8d22693f2f7b3ddc2a6facae6191b4d080b5d00ebf: Status 404 returned error can't find the container with id f51c1eef132dbab3b2a01f8d22693f2f7b3ddc2a6facae6191b4d080b5d00ebf
Jul 22 04:42:04.679752 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:04.679713    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87" event={"ID":"d3c71d11-298b-4f8d-b71b-49eac4b8f1ec","Type":"ContainerStarted","Data":"f51c1eef132dbab3b2a01f8d22693f2f7b3ddc2a6facae6191b4d080b5d00ebf"}
Jul 22 04:42:06.693661 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:06.693621    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87" event={"ID":"d3c71d11-298b-4f8d-b71b-49eac4b8f1ec","Type":"ContainerStarted","Data":"2c087904d3b7e3e53219a41951e8e30a36ca011368a69e30564450b6d078a35c"}
Jul 22 04:42:06.694133 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:06.693684    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:06.695258 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:06.695226    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5" event={"ID":"b38f5afd-474a-4fdc-9491-b3ad0fb2af89","Type":"ContainerStarted","Data":"41eb566f24548a89518092630c9d174b1aa2356c1ec4a833d98c240761c4ca44"}
Jul 22 04:42:06.695396 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:06.695368    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"
Jul 22 04:42:06.711239 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:06.711189    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87" podStartSLOduration=2.256878196 podStartE2EDuration="4.711173031s" totalImagesPullingTime="2.454294835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:42:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:42:06.710413681 +0000 UTC m=+536.768251244" watchObservedRunningTime="2026-07-22 04:42:06.711173031 +0000 UTC m=+536.769010591"
Jul 22 04:42:06.725270 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:06.725214    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5" podStartSLOduration=1.216224376 podStartE2EDuration="3.725197061s" totalImagesPullingTime="2.508972685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:42:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:42:06.724408761 +0000 UTC m=+536.782246324" watchObservedRunningTime="2026-07-22 04:42:06.725197061 +0000 UTC m=+536.783034621"
Jul 22 04:42:12.705974 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:12.705612    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67476b6695-ghz87"
Jul 22 04:42:13.699199 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:13.699158    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:13.792057 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:13.792020    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:17.701610 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:17.701577    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-hjmn5"
Jul 22 04:42:22.874159 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:22.874128    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"]
Jul 22 04:42:22.877165 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:22.877150    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:22.879638 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:22.879615    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 22 04:42:22.879776 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:22.879659    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 22 04:42:22.879776 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:22.879667    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 22 04:42:22.880451 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:22.880436    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6ntgm\""
Jul 22 04:42:22.887863 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:22.887842    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"]
Jul 22 04:42:22.897895 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:22.897873    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:23.004567 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.004530    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d06798e9-0a96-493b-b911-742f88223746-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.004567 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.004570    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d06798e9-0a96-493b-b911-742f88223746-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.004815 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.004589    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d06798e9-0a96-493b-b911-742f88223746-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.004815 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.004706    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf2xt\" (UniqueName: \"kubernetes.io/projected/d06798e9-0a96-493b-b911-742f88223746-kube-api-access-xf2xt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.004815 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.004745    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d06798e9-0a96-493b-b911-742f88223746-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.004815 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.004803    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d06798e9-0a96-493b-b911-742f88223746-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.105405 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.105365    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d06798e9-0a96-493b-b911-742f88223746-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.105405 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.105407    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d06798e9-0a96-493b-b911-742f88223746-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.105620 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.105433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d06798e9-0a96-493b-b911-742f88223746-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.105620 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.105493    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf2xt\" (UniqueName: \"kubernetes.io/projected/d06798e9-0a96-493b-b911-742f88223746-kube-api-access-xf2xt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.105620 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.105520    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d06798e9-0a96-493b-b911-742f88223746-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.105771 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.105706    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d06798e9-0a96-493b-b911-742f88223746-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.105771 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.105747    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d06798e9-0a96-493b-b911-742f88223746-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.105868 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.105803    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d06798e9-0a96-493b-b911-742f88223746-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.105935 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.105916    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d06798e9-0a96-493b-b911-742f88223746-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.107749 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.107730    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d06798e9-0a96-493b-b911-742f88223746-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.108126 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.108107    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d06798e9-0a96-493b-b911-742f88223746-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.113804 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.113773    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf2xt\" (UniqueName: \"kubernetes.io/projected/d06798e9-0a96-493b-b911-742f88223746-kube-api-access-xf2xt\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z\" (UID: \"d06798e9-0a96-493b-b911-742f88223746\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.187615 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.187522    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:23.311366 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.311340    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"]
Jul 22 04:42:23.313776 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:42:23.313736    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06798e9_0a96_493b_b911_742f88223746.slice/crio-9195446b7bd7b9d125395ebfd5ab54cfe7679c8d44a9bf3af678e3af704e31e2 WatchSource:0}: Error finding container 9195446b7bd7b9d125395ebfd5ab54cfe7679c8d44a9bf3af678e3af704e31e2: Status 404 returned error can't find the container with id 9195446b7bd7b9d125395ebfd5ab54cfe7679c8d44a9bf3af678e3af704e31e2
Jul 22 04:42:23.764652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:23.764602    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z" event={"ID":"d06798e9-0a96-493b-b911-742f88223746","Type":"ContainerStarted","Data":"9195446b7bd7b9d125395ebfd5ab54cfe7679c8d44a9bf3af678e3af704e31e2"}
Jul 22 04:42:24.770054 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:24.770024    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z" event={"ID":"d06798e9-0a96-493b-b911-742f88223746","Type":"ContainerStarted","Data":"3d3a3bab39e888c47a8894ca8937b11fb7c82fa8348a8bf00d35d1a05b0f5ecf"}
Jul 22 04:42:24.788013 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:24.787928    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z" podStartSLOduration=1.68814966 podStartE2EDuration="2.787910424s" totalImagesPullingTime="1.099760764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:42:24.787056467 +0000 UTC m=+554.844894049" watchObservedRunningTime="2026-07-22 04:42:24.787910424 +0000 UTC m=+554.845747985"
Jul 22 04:42:33.188188 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:33.188146    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:33.188559 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:33.188215    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:33.200909 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:33.200880    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:33.823608 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:33.823579    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z"
Jul 22 04:42:44.413856 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:44.413817    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:53.654389 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.654357    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"]
Jul 22 04:42:53.661022 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.661000    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.663392 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.663373    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 22 04:42:53.669112 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.668192    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"]
Jul 22 04:42:53.686853 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.686812    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:42:53.767325 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.767283    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxfc8\" (UniqueName: \"kubernetes.io/projected/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-kube-api-access-zxfc8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.767484 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.767379    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.767484 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.767437    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.767559 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.767494    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.767559 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.767517    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.767559 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.767538    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.868865 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.868827    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.869072 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.868881    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.869072 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.868921    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.869072 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.868955    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.869072 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.868981    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.869072 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.869019    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxfc8\" (UniqueName: \"kubernetes.io/projected/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-kube-api-access-zxfc8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.869319 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.869261    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.869419 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.869398    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.869476 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.869423    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.871219 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.871200    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.871536 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.871518    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.876263 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.876242    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxfc8\" (UniqueName: \"kubernetes.io/projected/7d95903c-ea84-4b21-bfa4-ea2b7c6f9683-kube-api-access-zxfc8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-lg8tj\" (UID: \"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:53.976003 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:53.975849    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:42:54.100617 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:54.100588    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"]
Jul 22 04:42:54.103163 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:42:54.103138    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d95903c_ea84_4b21_bfa4_ea2b7c6f9683.slice/crio-d2f7d79f71f23342106e8388a6fe293306b2b7608b9ab27a8a29b437520c4016 WatchSource:0}: Error finding container d2f7d79f71f23342106e8388a6fe293306b2b7608b9ab27a8a29b437520c4016: Status 404 returned error can't find the container with id d2f7d79f71f23342106e8388a6fe293306b2b7608b9ab27a8a29b437520c4016
Jul 22 04:42:54.898096 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:54.898057    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj" event={"ID":"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683","Type":"ContainerStarted","Data":"41056a1916aa05c998cd461561cd85b6f67c8321a5126a4290f8349845fabe59"}
Jul 22 04:42:54.898462 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:54.898110    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj" event={"ID":"7d95903c-ea84-4b21-bfa4-ea2b7c6f9683","Type":"ContainerStarted","Data":"d2f7d79f71f23342106e8388a6fe293306b2b7608b9ab27a8a29b437520c4016"}
Jul 22 04:42:54.915442 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:42:54.915391    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj" podStartSLOduration=1.7455940829999999 podStartE2EDuration="1.915376313s" totalImagesPullingTime="169.78223ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:42:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:42:54.913007224 +0000 UTC m=+584.970844786" watchObservedRunningTime="2026-07-22 04:42:54.915376313 +0000 UTC m=+584.973213867"
Jul 22 04:43:03.673693 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:03.673656    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:03.725468 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:03.725437    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:03.976368 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:03.976330    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:43:03.976540 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:03.976402    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:43:03.988691 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:03.988656    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:43:04.561364 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:04.561331    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:04.948007 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:04.947900    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-lg8tj"
Jul 22 04:43:09.666219 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:09.666189    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:25.962908 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:25.962873    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"]
Jul 22 04:43:25.966082 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:25.966067    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:25.968364 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:25.968344    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 22 04:43:25.975806 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:25.975775    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"]
Jul 22 04:43:26.058477 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.058431    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:26.145652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.145613    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lps28\" (UniqueName: \"kubernetes.io/projected/9429194e-51b4-4a8c-b20d-82197fc8f833-kube-api-access-lps28\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.145652 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.145655    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9429194e-51b4-4a8c-b20d-82197fc8f833-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.145887 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.145685    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9429194e-51b4-4a8c-b20d-82197fc8f833-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.145887 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.145770    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9429194e-51b4-4a8c-b20d-82197fc8f833-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.145887 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.145815    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9429194e-51b4-4a8c-b20d-82197fc8f833-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.145887 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.145832    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9429194e-51b4-4a8c-b20d-82197fc8f833-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.246774 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.246685    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9429194e-51b4-4a8c-b20d-82197fc8f833-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.246774 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.246726    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9429194e-51b4-4a8c-b20d-82197fc8f833-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.246774 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.246768    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lps28\" (UniqueName: \"kubernetes.io/projected/9429194e-51b4-4a8c-b20d-82197fc8f833-kube-api-access-lps28\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.247052 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.246795    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9429194e-51b4-4a8c-b20d-82197fc8f833-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.247052 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.246826    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9429194e-51b4-4a8c-b20d-82197fc8f833-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.247052 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.246912    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9429194e-51b4-4a8c-b20d-82197fc8f833-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.247198 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.247178    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9429194e-51b4-4a8c-b20d-82197fc8f833-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.247259 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.247233    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9429194e-51b4-4a8c-b20d-82197fc8f833-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.247310 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.247263    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9429194e-51b4-4a8c-b20d-82197fc8f833-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.249100 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.249081    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9429194e-51b4-4a8c-b20d-82197fc8f833-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.249382 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.249362    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9429194e-51b4-4a8c-b20d-82197fc8f833-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.254649 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.254627    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lps28\" (UniqueName: \"kubernetes.io/projected/9429194e-51b4-4a8c-b20d-82197fc8f833-kube-api-access-lps28\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg\" (UID: \"9429194e-51b4-4a8c-b20d-82197fc8f833\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.275702 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.275672    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:26.403794 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:26.403770    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"]
Jul 22 04:43:26.406381 ip-10-0-137-249 kubenswrapper[2584]: W0722 04:43:26.406355    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9429194e_51b4_4a8c_b20d_82197fc8f833.slice/crio-e738a1b4caf7219e4b156e448e3addba9611928f2787d4d4eb09f9b7cd8a69ec WatchSource:0}: Error finding container e738a1b4caf7219e4b156e448e3addba9611928f2787d4d4eb09f9b7cd8a69ec: Status 404 returned error can't find the container with id e738a1b4caf7219e4b156e448e3addba9611928f2787d4d4eb09f9b7cd8a69ec
Jul 22 04:43:27.032369 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:27.032337    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg" event={"ID":"9429194e-51b4-4a8c-b20d-82197fc8f833","Type":"ContainerStarted","Data":"cd3a7522caec5bb127d912673942693f3defdef61af8b790fb2921522bf0f985"}
Jul 22 04:43:27.032369 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:27.032376    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg" event={"ID":"9429194e-51b4-4a8c-b20d-82197fc8f833","Type":"ContainerStarted","Data":"e738a1b4caf7219e4b156e448e3addba9611928f2787d4d4eb09f9b7cd8a69ec"}
Jul 22 04:43:27.048427 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:27.048378    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg" podStartSLOduration=1.885776431 podStartE2EDuration="2.048363317s" totalImagesPullingTime="162.586886ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 04:43:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 04:43:27.047648489 +0000 UTC m=+617.105486050" watchObservedRunningTime="2026-07-22 04:43:27.048363317 +0000 UTC m=+617.106200877"
Jul 22 04:43:36.276494 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:36.276399    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:36.276983 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:36.276485    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:36.288849 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:36.288825    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:37.084449 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:37.084391    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg"
Jul 22 04:43:41.820924 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:41.820883    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:43:41.872293 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:43:41.872260    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:44:08.682454 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:44:08.682423    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:44:08.783611 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:44:08.783578    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:44:32.406202 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:44:32.406167    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:44:44.472793 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:44:44.472753    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:45:14.896188 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:45:14.896091    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:45:38.684835 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:45:38.684792    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:45:38.767731 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:45:38.767703    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:45:39.723078 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:45:39.723025    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:45:39.831435 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:45:39.831401    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:46:19.833917 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:46:19.833883    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:47:44.124697 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:47:44.124659    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:47:45.351155 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:47:45.351116    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:48:20.773993 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:48:20.773952    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:48:22.159121 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:48:22.159076    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:48:26.645235 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:48:26.645202    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:48:26.818854 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:48:26.818821    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:48:26.900893 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:48:26.900809    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:48:27.024542 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:48:27.024509    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:48:32.698532 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:48:32.698496    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:48:32.766533 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:48:32.766488    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:49:32.775409 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:49:32.775314    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:51:40.691734 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:51:40.691659    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:51:40.781568 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:51:40.781539    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:12.623322 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:56:12.623279    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:24.287673 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:56:24.287636    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:35.957027 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:56:35.956991    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:36.057876 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:56:36.057845    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:58.472921 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:56:58.472881    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:56:59.172004 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:56:59.171972    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:58:18.428399 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:58:18.428359    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:56.271275 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:59:56.271243    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 04:59:56.361305 ip-10-0-137-249 kubenswrapper[2584]: I0722 04:59:56.361269    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:07.181355 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:07.181271    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:28.635312 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:28.635276    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:31.674226 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:31.674187    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:31.776776 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:31.776737    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:32.131680 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:32.131645    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:37.820816 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:37.820781    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:37.923374 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:37.923346    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:38.070522 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:38.070491    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:38.388142 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:38.388104    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:38.576150 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:38.576112    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:41.091230 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.091194    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:41.192948 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.192918    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:41.214564 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.214536    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"]
Jul 22 05:00:41.217737 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.217713    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:41.220256 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.220232    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9e76c960-serving-cert\""
Jul 22 05:00:41.220380 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.220257    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4nh9t\""
Jul 22 05:00:41.227407 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.227376    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25c84a1-052c-44b2-87a3-c2f090af44a1-openshift-service-ca\") pod \"maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:41.227534 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.227430    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x95pk\" (UniqueName: \"kubernetes.io/projected/d25c84a1-052c-44b2-87a3-c2f090af44a1-kube-api-access-x95pk\") pod \"maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:41.227534 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.227517    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d25c84a1-052c-44b2-87a3-c2f090af44a1-maas-api-tls\") pod \"maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:41.228584 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.228559    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"]
Jul 22 05:00:41.291714 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.291672    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:41.328572 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.328537    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x95pk\" (UniqueName: \"kubernetes.io/projected/d25c84a1-052c-44b2-87a3-c2f090af44a1-kube-api-access-x95pk\") pod \"maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:41.328733 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.328617    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d25c84a1-052c-44b2-87a3-c2f090af44a1-maas-api-tls\") pod \"maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:41.328733 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.328656    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25c84a1-052c-44b2-87a3-c2f090af44a1-openshift-service-ca\") pod \"maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:41.328822 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:00:41.328757    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-serving-cert: secret "maas-api-e2e-ait-9e76c960-serving-cert" not found
Jul 22 05:00:41.328867 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:00:41.328843    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d25c84a1-052c-44b2-87a3-c2f090af44a1-maas-api-tls podName:d25c84a1-052c-44b2-87a3-c2f090af44a1 nodeName:}" failed. No retries permitted until 2026-07-22 05:00:41.82882157 +0000 UTC m=+1651.886659116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d25c84a1-052c-44b2-87a3-c2f090af44a1-maas-api-tls") pod "maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z" (UID: "d25c84a1-052c-44b2-87a3-c2f090af44a1") : secret "maas-api-e2e-ait-9e76c960-serving-cert" not found
Jul 22 05:00:41.329382 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.329363    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25c84a1-052c-44b2-87a3-c2f090af44a1-openshift-service-ca\") pod \"maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:41.337284 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.337262    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x95pk\" (UniqueName: \"kubernetes.io/projected/d25c84a1-052c-44b2-87a3-c2f090af44a1-kube-api-access-x95pk\") pod \"maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:41.407417 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.407341    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:41.730435 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.730403    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:41.831408 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.831377    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:00:41.832477 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.832456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d25c84a1-052c-44b2-87a3-c2f090af44a1-maas-api-tls\") pod \"maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:41.834988 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:41.834964    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d25c84a1-052c-44b2-87a3-c2f090af44a1-maas-api-tls\") pod \"maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:42.130676 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:42.130592    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:42.261581 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:42.261557    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"]
Jul 22 05:00:42.264045 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:00:42.264014    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25c84a1_052c_44b2_87a3_c2f090af44a1.slice/crio-f658bf8396fbd3dc9d6835c93e95f90f2d082f936969abbf1104f66a687987c9 WatchSource:0}: Error finding container f658bf8396fbd3dc9d6835c93e95f90f2d082f936969abbf1104f66a687987c9: Status 404 returned error can't find the container with id f658bf8396fbd3dc9d6835c93e95f90f2d082f936969abbf1104f66a687987c9
Jul 22 05:00:42.265786 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:42.265768    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 05:00:42.410221 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:42.410127    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z" event={"ID":"d25c84a1-052c-44b2-87a3-c2f090af44a1","Type":"ContainerStarted","Data":"f658bf8396fbd3dc9d6835c93e95f90f2d082f936969abbf1104f66a687987c9"}
Jul 22 05:00:43.416007 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:43.415971    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z" event={"ID":"d25c84a1-052c-44b2-87a3-c2f090af44a1","Type":"ContainerStarted","Data":"ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569"}
Jul 22 05:00:43.416367 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:43.416061    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:00:43.433133 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:43.433089    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z" podStartSLOduration=1.810313576 podStartE2EDuration="2.433069202s" totalImagesPullingTime="622.755626ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:00:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:00:43.431261624 +0000 UTC m=+1653.489099186" watchObservedRunningTime="2026-07-22 05:00:43.433069202 +0000 UTC m=+1653.490906763"
Jul 22 05:00:49.426157 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:00:49.426125    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:01:17.081379 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.081345    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"]
Jul 22 05:01:17.081813 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.081593    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z" podUID="d25c84a1-052c-44b2-87a3-c2f090af44a1" containerName="maas-api" containerID="cri-o://ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569" gracePeriod=30
Jul 22 05:01:17.111787 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.111749    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:17.325086 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.325062    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:01:17.360970 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.360880    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25c84a1-052c-44b2-87a3-c2f090af44a1-openshift-service-ca\") pod \"d25c84a1-052c-44b2-87a3-c2f090af44a1\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") "
Jul 22 05:01:17.360970 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.360963    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x95pk\" (UniqueName: \"kubernetes.io/projected/d25c84a1-052c-44b2-87a3-c2f090af44a1-kube-api-access-x95pk\") pod \"d25c84a1-052c-44b2-87a3-c2f090af44a1\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") "
Jul 22 05:01:17.361171 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.361024    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d25c84a1-052c-44b2-87a3-c2f090af44a1-maas-api-tls\") pod \"d25c84a1-052c-44b2-87a3-c2f090af44a1\" (UID: \"d25c84a1-052c-44b2-87a3-c2f090af44a1\") "
Jul 22 05:01:17.361286 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.361260    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d25c84a1-052c-44b2-87a3-c2f090af44a1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d25c84a1-052c-44b2-87a3-c2f090af44a1" (UID: "d25c84a1-052c-44b2-87a3-c2f090af44a1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:01:17.363133 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.363108    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d25c84a1-052c-44b2-87a3-c2f090af44a1-kube-api-access-x95pk" (OuterVolumeSpecName: "kube-api-access-x95pk") pod "d25c84a1-052c-44b2-87a3-c2f090af44a1" (UID: "d25c84a1-052c-44b2-87a3-c2f090af44a1"). InnerVolumeSpecName "kube-api-access-x95pk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:01:17.363290 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.363183    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d25c84a1-052c-44b2-87a3-c2f090af44a1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d25c84a1-052c-44b2-87a3-c2f090af44a1" (UID: "d25c84a1-052c-44b2-87a3-c2f090af44a1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:01:17.462237 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.462201    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x95pk\" (UniqueName: \"kubernetes.io/projected/d25c84a1-052c-44b2-87a3-c2f090af44a1-kube-api-access-x95pk\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:01:17.462237 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.462237    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d25c84a1-052c-44b2-87a3-c2f090af44a1-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:01:17.462420 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.462251    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d25c84a1-052c-44b2-87a3-c2f090af44a1-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:01:17.553607 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.553567    2584 generic.go:356] "Generic (PLEG): container finished" podID="d25c84a1-052c-44b2-87a3-c2f090af44a1" containerID="ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569" exitCode=0
Jul 22 05:01:17.553607 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.553612    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"
Jul 22 05:01:17.553881 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.553651    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z" event={"ID":"d25c84a1-052c-44b2-87a3-c2f090af44a1","Type":"ContainerDied","Data":"ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569"}
Jul 22 05:01:17.553881 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.553725    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z" event={"ID":"d25c84a1-052c-44b2-87a3-c2f090af44a1","Type":"ContainerDied","Data":"f658bf8396fbd3dc9d6835c93e95f90f2d082f936969abbf1104f66a687987c9"}
Jul 22 05:01:17.553881 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.553759    2584 scope.go:117] "RemoveContainer" containerID="ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569"
Jul 22 05:01:17.562017 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.561872    2584 scope.go:117] "RemoveContainer" containerID="ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569"
Jul 22 05:01:17.562267 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:01:17.562234    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569\": container with ID starting with ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569 not found: ID does not exist" containerID="ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569"
Jul 22 05:01:17.562362 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.562274    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569"} err="failed to get container status \"ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569\": rpc error: code = NotFound desc = could not find container \"ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569\": container with ID starting with ef10ddd645062d09d0fb39ce799b36bbd2600603bf3c3ee6ee95334b928c4569 not found: ID does not exist"
Jul 22 05:01:17.574454 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.574426    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"]
Jul 22 05:01:17.578142 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:17.578122    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9e76c960-94f98f6fc-78r4z"]
Jul 22 05:01:18.475923 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:18.475888    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d25c84a1-052c-44b2-87a3-c2f090af44a1" path="/var/lib/kubelet/pods/d25c84a1-052c-44b2-87a3-c2f090af44a1/volumes"
Jul 22 05:01:21.834800 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:21.834762    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:21.966054 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:21.966020    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:22.133962 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:22.133867    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:22.465744 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:22.465705    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:22.566402 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:22.566365    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:22.668357 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:22.668307    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:22.920254 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:22.920175    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:23.246648 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:23.246607    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:25.443635 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.443598    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:25.663307 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.663276    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"]
Jul 22 05:01:25.663616 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.663594    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d25c84a1-052c-44b2-87a3-c2f090af44a1" containerName="maas-api"
Jul 22 05:01:25.663616 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.663607    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d25c84a1-052c-44b2-87a3-c2f090af44a1" containerName="maas-api"
Jul 22 05:01:25.663759 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.663668    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d25c84a1-052c-44b2-87a3-c2f090af44a1" containerName="maas-api"
Jul 22 05:01:25.672406 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.672378    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:25.675696 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.675672    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"]
Jul 22 05:01:25.675901 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.675878    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4nh9t\""
Jul 22 05:01:25.676126 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.676107    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-dec153cb-serving-cert\""
Jul 22 05:01:25.695168 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.695099    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:25.730340 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.730306    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-openshift-service-ca\") pod \"maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:25.730466 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.730351    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txblz\" (UniqueName: \"kubernetes.io/projected/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-kube-api-access-txblz\") pod \"maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:25.730466 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.730444    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-maas-api-tls\") pod \"maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:25.830931 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.830897    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-openshift-service-ca\") pod \"maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:25.831120 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.830961    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txblz\" (UniqueName: \"kubernetes.io/projected/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-kube-api-access-txblz\") pod \"maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:25.831120 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.831047    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-maas-api-tls\") pod \"maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:25.831228 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:01:25.831205    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-serving-cert: secret "maas-api-e2e-migrate-dec153cb-serving-cert" not found
Jul 22 05:01:25.831332 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:01:25.831320    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-maas-api-tls podName:6eff2fe1-eea7-47c2-aaef-e12af83b0fbe nodeName:}" failed. No retries permitted until 2026-07-22 05:01:26.331301262 +0000 UTC m=+1696.389138805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-maas-api-tls") pod "maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk" (UID: "6eff2fe1-eea7-47c2-aaef-e12af83b0fbe") : secret "maas-api-e2e-migrate-dec153cb-serving-cert" not found
Jul 22 05:01:25.831512 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.831492    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-openshift-service-ca\") pod \"maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:25.840330 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.840307    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txblz\" (UniqueName: \"kubernetes.io/projected/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-kube-api-access-txblz\") pod \"maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:25.949340 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:25.949254    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:26.132606 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:26.132575    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:26.232906 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:26.232873    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:01:26.335504 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:26.335462    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-maas-api-tls\") pod \"maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:26.337914 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:26.337894    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-maas-api-tls\") pod \"maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:26.585929 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:26.585845    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:26.717333 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:26.717309    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"]
Jul 22 05:01:26.720464 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:01:26.720260    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eff2fe1_eea7_47c2_aaef_e12af83b0fbe.slice/crio-7e6cf71b35b20108a26175bc8adba992245c30feebfffaabb191658ba0839347 WatchSource:0}: Error finding container 7e6cf71b35b20108a26175bc8adba992245c30feebfffaabb191658ba0839347: Status 404 returned error can't find the container with id 7e6cf71b35b20108a26175bc8adba992245c30feebfffaabb191658ba0839347
Jul 22 05:01:27.598861 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:27.598826    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk" event={"ID":"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe","Type":"ContainerStarted","Data":"2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c"}
Jul 22 05:01:27.599295 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:27.598880    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk" event={"ID":"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe","Type":"ContainerStarted","Data":"7e6cf71b35b20108a26175bc8adba992245c30feebfffaabb191658ba0839347"}
Jul 22 05:01:27.599295 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:27.598919    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:01:27.614693 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:27.614646    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk" podStartSLOduration=1.949923225 podStartE2EDuration="2.614629778s" totalImagesPullingTime="664.706553ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:01:27.613556554 +0000 UTC m=+1697.671394116" watchObservedRunningTime="2026-07-22 05:01:27.614629778 +0000 UTC m=+1697.672467369"
Jul 22 05:01:33.608930 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:01:33.608853    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:02:00.912792 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:00.912756    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"]
Jul 22 05:02:00.913397 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:00.912994    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk" podUID="6eff2fe1-eea7-47c2-aaef-e12af83b0fbe" containerName="maas-api" containerID="cri-o://2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c" gracePeriod=30
Jul 22 05:02:00.932726 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:00.932700    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:01.155387 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.155361    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:02:01.342907 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.342873    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-maas-api-tls\") pod \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") "
Jul 22 05:02:01.343097 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.342934    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txblz\" (UniqueName: \"kubernetes.io/projected/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-kube-api-access-txblz\") pod \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") "
Jul 22 05:02:01.343097 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.342994    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-openshift-service-ca\") pod \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\" (UID: \"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe\") "
Jul 22 05:02:01.343447 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.343413    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6eff2fe1-eea7-47c2-aaef-e12af83b0fbe" (UID: "6eff2fe1-eea7-47c2-aaef-e12af83b0fbe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:02:01.345056 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.345029    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6eff2fe1-eea7-47c2-aaef-e12af83b0fbe" (UID: "6eff2fe1-eea7-47c2-aaef-e12af83b0fbe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:02:01.345144 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.345127    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-kube-api-access-txblz" (OuterVolumeSpecName: "kube-api-access-txblz") pod "6eff2fe1-eea7-47c2-aaef-e12af83b0fbe" (UID: "6eff2fe1-eea7-47c2-aaef-e12af83b0fbe"). InnerVolumeSpecName "kube-api-access-txblz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:02:01.444423 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.444384    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txblz\" (UniqueName: \"kubernetes.io/projected/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-kube-api-access-txblz\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:02:01.444423 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.444416    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:02:01.444423 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.444427    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:02:01.745060 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.745029    2584 generic.go:356] "Generic (PLEG): container finished" podID="6eff2fe1-eea7-47c2-aaef-e12af83b0fbe" containerID="2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c" exitCode=0
Jul 22 05:02:01.745239 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.745075    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"
Jul 22 05:02:01.745239 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.745130    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk" event={"ID":"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe","Type":"ContainerDied","Data":"2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c"}
Jul 22 05:02:01.745239 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.745186    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk" event={"ID":"6eff2fe1-eea7-47c2-aaef-e12af83b0fbe","Type":"ContainerDied","Data":"7e6cf71b35b20108a26175bc8adba992245c30feebfffaabb191658ba0839347"}
Jul 22 05:02:01.745239 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.745213    2584 scope.go:117] "RemoveContainer" containerID="2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c"
Jul 22 05:02:01.753650 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.753631    2584 scope.go:117] "RemoveContainer" containerID="2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c"
Jul 22 05:02:01.753914 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:02:01.753896    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c\": container with ID starting with 2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c not found: ID does not exist" containerID="2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c"
Jul 22 05:02:01.753992 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.753926    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c"} err="failed to get container status \"2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c\": rpc error: code = NotFound desc = could not find container \"2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c\": container with ID starting with 2d216f9053c83ee567d096f579cd76621bfc84683e9e8a22bcba152db8deb50c not found: ID does not exist"
Jul 22 05:02:01.766419 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.766391    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"]
Jul 22 05:02:01.772066 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:01.772041    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-dec153cb-b6b769d45-j4pjk"]
Jul 22 05:02:02.476422 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:02.476391    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eff2fe1-eea7-47c2-aaef-e12af83b0fbe" path="/var/lib/kubelet/pods/6eff2fe1-eea7-47c2-aaef-e12af83b0fbe/volumes"
Jul 22 05:02:05.572289 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:05.572232    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:05.735152 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:05.735117    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:05.959684 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:05.959606    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:06.196711 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:06.196674    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:06.521475 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:06.521417    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:06.981831 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:06.981796    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:08.568089 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.568055    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:08.671627 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.671584    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:08.680200 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.680165    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"]
Jul 22 05:02:08.680481 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.680469    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eff2fe1-eea7-47c2-aaef-e12af83b0fbe" containerName="maas-api"
Jul 22 05:02:08.680533 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.680482    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eff2fe1-eea7-47c2-aaef-e12af83b0fbe" containerName="maas-api"
Jul 22 05:02:08.680569 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.680541    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eff2fe1-eea7-47c2-aaef-e12af83b0fbe" containerName="maas-api"
Jul 22 05:02:08.684894 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.684875    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:08.687539 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.687518    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-303fe40d-serving-cert\""
Jul 22 05:02:08.687645 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.687561    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4nh9t\""
Jul 22 05:02:08.695358 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.695336    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"]
Jul 22 05:02:08.763997 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.763961    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:08.806820 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.806789    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b85576-66d2-4275-ba80-0c1ebda0af2a-openshift-service-ca\") pod \"maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:08.807017 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.806825    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33b85576-66d2-4275-ba80-0c1ebda0af2a-maas-api-tls\") pod \"maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:08.807017 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.806896    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z758\" (UniqueName: \"kubernetes.io/projected/33b85576-66d2-4275-ba80-0c1ebda0af2a-kube-api-access-5z758\") pod \"maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:08.908220 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.908140    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b85576-66d2-4275-ba80-0c1ebda0af2a-openshift-service-ca\") pod \"maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:08.908220 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.908187    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33b85576-66d2-4275-ba80-0c1ebda0af2a-maas-api-tls\") pod \"maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:08.908458 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.908236    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z758\" (UniqueName: \"kubernetes.io/projected/33b85576-66d2-4275-ba80-0c1ebda0af2a-kube-api-access-5z758\") pod \"maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:08.908458 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:02:08.908362    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-serving-cert: secret "maas-api-e2e-ait-303fe40d-serving-cert" not found
Jul 22 05:02:08.908458 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:02:08.908452    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33b85576-66d2-4275-ba80-0c1ebda0af2a-maas-api-tls podName:33b85576-66d2-4275-ba80-0c1ebda0af2a nodeName:}" failed. No retries permitted until 2026-07-22 05:02:09.408429748 +0000 UTC m=+1739.466267289 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/33b85576-66d2-4275-ba80-0c1ebda0af2a-maas-api-tls") pod "maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj" (UID: "33b85576-66d2-4275-ba80-0c1ebda0af2a") : secret "maas-api-e2e-ait-303fe40d-serving-cert" not found
Jul 22 05:02:08.908901 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.908878    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b85576-66d2-4275-ba80-0c1ebda0af2a-openshift-service-ca\") pod \"maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:08.917401 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:08.917378    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z758\" (UniqueName: \"kubernetes.io/projected/33b85576-66d2-4275-ba80-0c1ebda0af2a-kube-api-access-5z758\") pod \"maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:09.173529 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:09.173454    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:09.392697 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:09.392660    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:09.411769 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:09.411743    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33b85576-66d2-4275-ba80-0c1ebda0af2a-maas-api-tls\") pod \"maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:09.414181 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:09.414154    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33b85576-66d2-4275-ba80-0c1ebda0af2a-maas-api-tls\") pod \"maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:09.499915 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:09.499884    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:09.597906 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:09.597864    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:09.725173 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:09.725141    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"]
Jul 22 05:02:09.728760 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:02:09.728724    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33b85576_66d2_4275_ba80_0c1ebda0af2a.slice/crio-d0d344d495940ed3fca799b125189a1aa6daf7a0a4c85f22ac7795efea6a19d2 WatchSource:0}: Error finding container d0d344d495940ed3fca799b125189a1aa6daf7a0a4c85f22ac7795efea6a19d2: Status 404 returned error can't find the container with id d0d344d495940ed3fca799b125189a1aa6daf7a0a4c85f22ac7795efea6a19d2
Jul 22 05:02:09.783005 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:09.782904    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj" event={"ID":"33b85576-66d2-4275-ba80-0c1ebda0af2a","Type":"ContainerStarted","Data":"d0d344d495940ed3fca799b125189a1aa6daf7a0a4c85f22ac7795efea6a19d2"}
Jul 22 05:02:10.787980 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:10.787911    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj" event={"ID":"33b85576-66d2-4275-ba80-0c1ebda0af2a","Type":"ContainerStarted","Data":"d004c22b7862f2cc3f4906ba677671d73c5daa5bfa818567594e0122b494dbf3"}
Jul 22 05:02:10.788372 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:10.788109    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:10.804410 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:10.804362    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj" podStartSLOduration=2.379805499 podStartE2EDuration="2.804346915s" totalImagesPullingTime="424.541416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:02:10.803141227 +0000 UTC m=+1740.860978788" watchObservedRunningTime="2026-07-22 05:02:10.804346915 +0000 UTC m=+1740.862184488"
Jul 22 05:02:16.798283 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:16.798253    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:44.745802 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:44.745770    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"]
Jul 22 05:02:44.746356 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:44.745988    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj" podUID="33b85576-66d2-4275-ba80-0c1ebda0af2a" containerName="maas-api" containerID="cri-o://d004c22b7862f2cc3f4906ba677671d73c5daa5bfa818567594e0122b494dbf3" gracePeriod=30
Jul 22 05:02:44.777690 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:44.777659    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:44.932673 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:44.932642    2584 generic.go:356] "Generic (PLEG): container finished" podID="33b85576-66d2-4275-ba80-0c1ebda0af2a" containerID="d004c22b7862f2cc3f4906ba677671d73c5daa5bfa818567594e0122b494dbf3" exitCode=0
Jul 22 05:02:44.932806 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:44.932711    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj" event={"ID":"33b85576-66d2-4275-ba80-0c1ebda0af2a","Type":"ContainerDied","Data":"d004c22b7862f2cc3f4906ba677671d73c5daa5bfa818567594e0122b494dbf3"}
Jul 22 05:02:44.992770 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:44.992747    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:45.132966 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.132853    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5z758\" (UniqueName: \"kubernetes.io/projected/33b85576-66d2-4275-ba80-0c1ebda0af2a-kube-api-access-5z758\") pod \"33b85576-66d2-4275-ba80-0c1ebda0af2a\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") "
Jul 22 05:02:45.132966 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.132905    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b85576-66d2-4275-ba80-0c1ebda0af2a-openshift-service-ca\") pod \"33b85576-66d2-4275-ba80-0c1ebda0af2a\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") "
Jul 22 05:02:45.133155 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.132988    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33b85576-66d2-4275-ba80-0c1ebda0af2a-maas-api-tls\") pod \"33b85576-66d2-4275-ba80-0c1ebda0af2a\" (UID: \"33b85576-66d2-4275-ba80-0c1ebda0af2a\") "
Jul 22 05:02:45.133304 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.133277    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33b85576-66d2-4275-ba80-0c1ebda0af2a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "33b85576-66d2-4275-ba80-0c1ebda0af2a" (UID: "33b85576-66d2-4275-ba80-0c1ebda0af2a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:02:45.135058 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.135030    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33b85576-66d2-4275-ba80-0c1ebda0af2a-kube-api-access-5z758" (OuterVolumeSpecName: "kube-api-access-5z758") pod "33b85576-66d2-4275-ba80-0c1ebda0af2a" (UID: "33b85576-66d2-4275-ba80-0c1ebda0af2a"). InnerVolumeSpecName "kube-api-access-5z758". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:02:45.135153 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.135053    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33b85576-66d2-4275-ba80-0c1ebda0af2a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "33b85576-66d2-4275-ba80-0c1ebda0af2a" (UID: "33b85576-66d2-4275-ba80-0c1ebda0af2a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:02:45.233914 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.233885    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/33b85576-66d2-4275-ba80-0c1ebda0af2a-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:02:45.233914 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.233910    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5z758\" (UniqueName: \"kubernetes.io/projected/33b85576-66d2-4275-ba80-0c1ebda0af2a-kube-api-access-5z758\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:02:45.234079 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.233920    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/33b85576-66d2-4275-ba80-0c1ebda0af2a-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:02:45.938372 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.938345    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"
Jul 22 05:02:45.938372 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.938361    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj" event={"ID":"33b85576-66d2-4275-ba80-0c1ebda0af2a","Type":"ContainerDied","Data":"d0d344d495940ed3fca799b125189a1aa6daf7a0a4c85f22ac7795efea6a19d2"}
Jul 22 05:02:45.938820 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.938421    2584 scope.go:117] "RemoveContainer" containerID="d004c22b7862f2cc3f4906ba677671d73c5daa5bfa818567594e0122b494dbf3"
Jul 22 05:02:45.958852 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.958829    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"]
Jul 22 05:02:45.966217 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:45.963117    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-303fe40d-65569b4d7f-tgjlj"]
Jul 22 05:02:46.475549 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:46.475519    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33b85576-66d2-4275-ba80-0c1ebda0af2a" path="/var/lib/kubelet/pods/33b85576-66d2-4275-ba80-0c1ebda0af2a/volumes"
Jul 22 05:02:49.419756 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:49.419717    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:50.613275 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:50.613245    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:50.835367 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:50.835335    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:51.053204 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:51.053165    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:51.356206 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:51.356131    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:51.953300 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:51.953262    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:53.806299 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:53.806262    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:53.905145 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:53.905114    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:53.909161 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:53.909133    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"]
Jul 22 05:02:53.909498 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:53.909483    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33b85576-66d2-4275-ba80-0c1ebda0af2a" containerName="maas-api"
Jul 22 05:02:53.909578 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:53.909502    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="33b85576-66d2-4275-ba80-0c1ebda0af2a" containerName="maas-api"
Jul 22 05:02:53.909636 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:53.909612    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="33b85576-66d2-4275-ba80-0c1ebda0af2a" containerName="maas-api"
Jul 22 05:02:53.913741 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:53.913722    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:53.916306 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:53.916288    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-9e622b09-serving-cert\""
Jul 22 05:02:53.916421 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:53.916291    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4nh9t\""
Jul 22 05:02:53.923620 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:53.923597    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"]
Jul 22 05:02:53.967293 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:53.967264    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:54.006014 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.005987    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwlzl\" (UniqueName: \"kubernetes.io/projected/f9941269-008f-4c9b-a703-2bd071aab877-kube-api-access-jwlzl\") pod \"maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:54.006164 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.006071    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9941269-008f-4c9b-a703-2bd071aab877-openshift-service-ca\") pod \"maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:54.006164 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.006108    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9941269-008f-4c9b-a703-2bd071aab877-maas-api-tls\") pod \"maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:54.107111 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.107026    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwlzl\" (UniqueName: \"kubernetes.io/projected/f9941269-008f-4c9b-a703-2bd071aab877-kube-api-access-jwlzl\") pod \"maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:54.107111 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.107091    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9941269-008f-4c9b-a703-2bd071aab877-openshift-service-ca\") pod \"maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:54.107300 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.107134    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9941269-008f-4c9b-a703-2bd071aab877-maas-api-tls\") pod \"maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:54.107300 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:02:54.107236    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-serving-cert: secret "maas-api-e2e-derive-9e622b09-serving-cert" not found
Jul 22 05:02:54.107419 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:02:54.107310    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9941269-008f-4c9b-a703-2bd071aab877-maas-api-tls podName:f9941269-008f-4c9b-a703-2bd071aab877 nodeName:}" failed. No retries permitted until 2026-07-22 05:02:54.607290917 +0000 UTC m=+1784.665128456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f9941269-008f-4c9b-a703-2bd071aab877-maas-api-tls") pod "maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7" (UID: "f9941269-008f-4c9b-a703-2bd071aab877") : secret "maas-api-e2e-derive-9e622b09-serving-cert" not found
Jul 22 05:02:54.107715 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.107696    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9941269-008f-4c9b-a703-2bd071aab877-openshift-service-ca\") pod \"maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:54.120074 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.120054    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwlzl\" (UniqueName: \"kubernetes.io/projected/f9941269-008f-4c9b-a703-2bd071aab877-kube-api-access-jwlzl\") pod \"maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:54.483406 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.483377    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:54.584210 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.584179    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:02:54.611364 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.611328    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9941269-008f-4c9b-a703-2bd071aab877-maas-api-tls\") pod \"maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:54.613724 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.613695    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9941269-008f-4c9b-a703-2bd071aab877-maas-api-tls\") pod \"maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:54.824555 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.824456    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:54.955223 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.955198    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"]
Jul 22 05:02:54.957613 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:02:54.957585    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9941269_008f_4c9b_a703_2bd071aab877.slice/crio-7feed3fadfd52e9ad3cf4f23cba5c5fa656868b1d5014da567f06236cd56d7ba WatchSource:0}: Error finding container 7feed3fadfd52e9ad3cf4f23cba5c5fa656868b1d5014da567f06236cd56d7ba: Status 404 returned error can't find the container with id 7feed3fadfd52e9ad3cf4f23cba5c5fa656868b1d5014da567f06236cd56d7ba
Jul 22 05:02:54.980614 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:54.980577    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7" event={"ID":"f9941269-008f-4c9b-a703-2bd071aab877","Type":"ContainerStarted","Data":"7feed3fadfd52e9ad3cf4f23cba5c5fa656868b1d5014da567f06236cd56d7ba"}
Jul 22 05:02:55.986662 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:55.986626    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7" event={"ID":"f9941269-008f-4c9b-a703-2bd071aab877","Type":"ContainerStarted","Data":"d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670"}
Jul 22 05:02:55.987094 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:55.986743    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:02:56.002705 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:02:56.002658    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7" podStartSLOduration=2.568770616 podStartE2EDuration="3.00264267s" totalImagesPullingTime="433.872054ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:02:56.001248869 +0000 UTC m=+1786.059086455" watchObservedRunningTime="2026-07-22 05:02:56.00264267 +0000 UTC m=+1786.060480246"
Jul 22 05:03:01.997001 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:01.996972    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:03:08.432898 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:08.432809    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:08.531362 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:08.531325    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:16.288115 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:16.288080    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:16.388393 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:16.388359    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:29.276058 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.276020    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"]
Jul 22 05:03:29.276528 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.276281    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7" podUID="f9941269-008f-4c9b-a703-2bd071aab877" containerName="maas-api" containerID="cri-o://d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670" gracePeriod=30
Jul 22 05:03:29.303587 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.303563    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:29.513909 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.513883    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:03:29.613085 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.613002    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9941269-008f-4c9b-a703-2bd071aab877-openshift-service-ca\") pod \"f9941269-008f-4c9b-a703-2bd071aab877\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") "
Jul 22 05:03:29.613255 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.613101    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9941269-008f-4c9b-a703-2bd071aab877-maas-api-tls\") pod \"f9941269-008f-4c9b-a703-2bd071aab877\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") "
Jul 22 05:03:29.613255 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.613193    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwlzl\" (UniqueName: \"kubernetes.io/projected/f9941269-008f-4c9b-a703-2bd071aab877-kube-api-access-jwlzl\") pod \"f9941269-008f-4c9b-a703-2bd071aab877\" (UID: \"f9941269-008f-4c9b-a703-2bd071aab877\") "
Jul 22 05:03:29.613255 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.613240    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9941269-008f-4c9b-a703-2bd071aab877-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f9941269-008f-4c9b-a703-2bd071aab877" (UID: "f9941269-008f-4c9b-a703-2bd071aab877"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:03:29.613453 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.613438    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9941269-008f-4c9b-a703-2bd071aab877-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:03:29.615198 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.615177    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9941269-008f-4c9b-a703-2bd071aab877-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f9941269-008f-4c9b-a703-2bd071aab877" (UID: "f9941269-008f-4c9b-a703-2bd071aab877"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:03:29.615279 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.615217    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9941269-008f-4c9b-a703-2bd071aab877-kube-api-access-jwlzl" (OuterVolumeSpecName: "kube-api-access-jwlzl") pod "f9941269-008f-4c9b-a703-2bd071aab877" (UID: "f9941269-008f-4c9b-a703-2bd071aab877"). InnerVolumeSpecName "kube-api-access-jwlzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:03:29.714484 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.714451    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwlzl\" (UniqueName: \"kubernetes.io/projected/f9941269-008f-4c9b-a703-2bd071aab877-kube-api-access-jwlzl\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:03:29.714484 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:29.714479    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9941269-008f-4c9b-a703-2bd071aab877-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:03:30.127528 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:30.127491    2584 generic.go:356] "Generic (PLEG): container finished" podID="f9941269-008f-4c9b-a703-2bd071aab877" containerID="d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670" exitCode=0
Jul 22 05:03:30.127528 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:30.127530    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"
Jul 22 05:03:30.127758 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:30.127573    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7" event={"ID":"f9941269-008f-4c9b-a703-2bd071aab877","Type":"ContainerDied","Data":"d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670"}
Jul 22 05:03:30.127758 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:30.127615    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7" event={"ID":"f9941269-008f-4c9b-a703-2bd071aab877","Type":"ContainerDied","Data":"7feed3fadfd52e9ad3cf4f23cba5c5fa656868b1d5014da567f06236cd56d7ba"}
Jul 22 05:03:30.127758 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:30.127638    2584 scope.go:117] "RemoveContainer" containerID="d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670"
Jul 22 05:03:30.136327 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:30.136308    2584 scope.go:117] "RemoveContainer" containerID="d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670"
Jul 22 05:03:30.136603 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:03:30.136582    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670\": container with ID starting with d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670 not found: ID does not exist" containerID="d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670"
Jul 22 05:03:30.136652 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:30.136612    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670"} err="failed to get container status \"d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670\": rpc error: code = NotFound desc = could not find container \"d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670\": container with ID starting with d1c31d84939f5a5e0d773998b80a1465fc4249d916bf89f5f849ceb155d80670 not found: ID does not exist"
Jul 22 05:03:30.148349 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:30.148321    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"]
Jul 22 05:03:30.149982 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:30.149961    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9e622b09-674d74b4fb-jhgj7"]
Jul 22 05:03:30.475817 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:30.475785    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9941269-008f-4c9b-a703-2bd071aab877" path="/var/lib/kubelet/pods/f9941269-008f-4c9b-a703-2bd071aab877/volumes"
Jul 22 05:03:33.775399 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:33.775367    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:33.935539 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:33.935512    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:34.169350 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:34.169271    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:34.651284 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:34.651242    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:34.746073 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:34.746037    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:34.846116 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:34.846081    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:36.217824 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:36.217766    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:41.878881 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:41.878849    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:41.986486 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:41.986455    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:42.079304 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:42.079270    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:42.180333 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:42.180245    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:03:42.577390 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:03:42.577359    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:08.553799 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:08.553756    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:15.097537 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:15.097501    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:15.197453 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:15.197418    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:30.996714 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:30.996680    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:36.821100 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:36.821018    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:36.873072 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:36.873036    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:36.952054 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:36.952013    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:37.052383 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:37.052351    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:44.273661 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:44.273623    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:47.548145 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:47.548114    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:48.354631 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:48.354593    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:54.226899 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:54.226845    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:54.337919 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:54.337877    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:54.427327 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:54.427292    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:54.527795 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:54.527715    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:55.352492 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:55.352459    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:55.450094 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:55.450064    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:55.576759 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:55.576728    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:04:57.175113 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:04:57.175077    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:02.821854 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:02.821820    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:02.923207 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:02.923172    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:03.517387 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:03.517349    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:09.247353 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:09.247317    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:09.347920 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:09.347883    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:09.479761 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:09.479722    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:09.809274 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:09.809229    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:10.086617 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:10.086524    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:13.368765 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.368728    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"]
Jul 22 05:05:13.369236 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.369049    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9941269-008f-4c9b-a703-2bd071aab877" containerName="maas-api"
Jul 22 05:05:13.369236 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.369062    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9941269-008f-4c9b-a703-2bd071aab877" containerName="maas-api"
Jul 22 05:05:13.369236 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.369128    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9941269-008f-4c9b-a703-2bd071aab877" containerName="maas-api"
Jul 22 05:05:13.371809 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.371791    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:13.374295 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.374270    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-31b554fe-serving-cert\""
Jul 22 05:05:13.374452 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.374436    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4nh9t\""
Jul 22 05:05:13.380081 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.379983    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"]
Jul 22 05:05:13.513289 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.513253    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d7e683-a553-4ed5-a9a9-3da90b288de6-maas-api-tls\") pod \"maas-api-e2e-mt-31b554fe-675c55d846-94tfn\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:13.513499 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.513338    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d7e683-a553-4ed5-a9a9-3da90b288de6-openshift-service-ca\") pod \"maas-api-e2e-mt-31b554fe-675c55d846-94tfn\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:13.513499 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.513367    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjb8t\" (UniqueName: \"kubernetes.io/projected/87d7e683-a553-4ed5-a9a9-3da90b288de6-kube-api-access-gjb8t\") pod \"maas-api-e2e-mt-31b554fe-675c55d846-94tfn\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:13.614544 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.614499    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d7e683-a553-4ed5-a9a9-3da90b288de6-openshift-service-ca\") pod \"maas-api-e2e-mt-31b554fe-675c55d846-94tfn\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:13.614744 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.614649    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjb8t\" (UniqueName: \"kubernetes.io/projected/87d7e683-a553-4ed5-a9a9-3da90b288de6-kube-api-access-gjb8t\") pod \"maas-api-e2e-mt-31b554fe-675c55d846-94tfn\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:13.615364 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.614881    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d7e683-a553-4ed5-a9a9-3da90b288de6-maas-api-tls\") pod \"maas-api-e2e-mt-31b554fe-675c55d846-94tfn\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:13.615364 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:05:13.615132    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-serving-cert: secret "maas-api-e2e-mt-31b554fe-serving-cert" not found
Jul 22 05:05:13.615364 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:05:13.615200    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87d7e683-a553-4ed5-a9a9-3da90b288de6-maas-api-tls podName:87d7e683-a553-4ed5-a9a9-3da90b288de6 nodeName:}" failed. No retries permitted until 2026-07-22 05:05:14.115181114 +0000 UTC m=+1924.173018655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/87d7e683-a553-4ed5-a9a9-3da90b288de6-maas-api-tls") pod "maas-api-e2e-mt-31b554fe-675c55d846-94tfn" (UID: "87d7e683-a553-4ed5-a9a9-3da90b288de6") : secret "maas-api-e2e-mt-31b554fe-serving-cert" not found
Jul 22 05:05:13.615588 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.615417    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d7e683-a553-4ed5-a9a9-3da90b288de6-openshift-service-ca\") pod \"maas-api-e2e-mt-31b554fe-675c55d846-94tfn\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:13.627549 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:13.627484    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjb8t\" (UniqueName: \"kubernetes.io/projected/87d7e683-a553-4ed5-a9a9-3da90b288de6-kube-api-access-gjb8t\") pod \"maas-api-e2e-mt-31b554fe-675c55d846-94tfn\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:14.120192 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:14.120155    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d7e683-a553-4ed5-a9a9-3da90b288de6-maas-api-tls\") pod \"maas-api-e2e-mt-31b554fe-675c55d846-94tfn\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:14.122547 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:14.122516    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d7e683-a553-4ed5-a9a9-3da90b288de6-maas-api-tls\") pod \"maas-api-e2e-mt-31b554fe-675c55d846-94tfn\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:14.153450 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:14.153384    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:14.246819 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:14.246787    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:14.285513 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:14.285477    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:14.413537 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:14.413510    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"]
Jul 22 05:05:14.415827 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:05:14.415805    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d7e683_a553_4ed5_a9a9_3da90b288de6.slice/crio-de07c440276a5f57e2020fae8e0c153ee5c3f5013b951aa3c93288cf9ae13b67 WatchSource:0}: Error finding container de07c440276a5f57e2020fae8e0c153ee5c3f5013b951aa3c93288cf9ae13b67: Status 404 returned error can't find the container with id de07c440276a5f57e2020fae8e0c153ee5c3f5013b951aa3c93288cf9ae13b67
Jul 22 05:05:14.574935 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:14.574899    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn" event={"ID":"87d7e683-a553-4ed5-a9a9-3da90b288de6","Type":"ContainerStarted","Data":"de07c440276a5f57e2020fae8e0c153ee5c3f5013b951aa3c93288cf9ae13b67"}
Jul 22 05:05:15.580236 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:15.580197    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn" event={"ID":"87d7e683-a553-4ed5-a9a9-3da90b288de6","Type":"ContainerStarted","Data":"e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e"}
Jul 22 05:05:15.580672 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:15.580344    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:15.596415 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:15.596368    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn" podStartSLOduration=2.045101609 podStartE2EDuration="2.596353202s" totalImagesPullingTime="551.251593ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:05:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:05:15.595141305 +0000 UTC m=+1925.652978865" watchObservedRunningTime="2026-07-22 05:05:15.596353202 +0000 UTC m=+1925.654190763"
Jul 22 05:05:17.640646 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:17.640600    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:18.292834 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:18.292801    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:18.393063 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:18.393031    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:18.735732 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:18.735702    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:21.591253 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:21.591210    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:24.476433 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:24.476397    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:24.527107 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:24.527076    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:35.291674 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.291642    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"]
Jul 22 05:05:35.292362 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.292331    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn" podUID="87d7e683-a553-4ed5-a9a9-3da90b288de6" containerName="maas-api" containerID="cri-o://e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e" gracePeriod=30
Jul 22 05:05:35.319115 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:05:35.319083    2584 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d7e683_a553_4ed5_a9a9_3da90b288de6.slice/crio-e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d7e683_a553_4ed5_a9a9_3da90b288de6.slice/crio-conmon-e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e.scope\": RecentStats: unable to find data in memory cache]"
Jul 22 05:05:35.319748 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.319696    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:35.530364 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.530336    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:35.616773 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.616673    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d7e683-a553-4ed5-a9a9-3da90b288de6-maas-api-tls\") pod \"87d7e683-a553-4ed5-a9a9-3da90b288de6\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") "
Jul 22 05:05:35.616773 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.616731    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjb8t\" (UniqueName: \"kubernetes.io/projected/87d7e683-a553-4ed5-a9a9-3da90b288de6-kube-api-access-gjb8t\") pod \"87d7e683-a553-4ed5-a9a9-3da90b288de6\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") "
Jul 22 05:05:35.617040 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.616842    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d7e683-a553-4ed5-a9a9-3da90b288de6-openshift-service-ca\") pod \"87d7e683-a553-4ed5-a9a9-3da90b288de6\" (UID: \"87d7e683-a553-4ed5-a9a9-3da90b288de6\") "
Jul 22 05:05:35.617254 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.617227    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87d7e683-a553-4ed5-a9a9-3da90b288de6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "87d7e683-a553-4ed5-a9a9-3da90b288de6" (UID: "87d7e683-a553-4ed5-a9a9-3da90b288de6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:05:35.618822 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.618793    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d7e683-a553-4ed5-a9a9-3da90b288de6-kube-api-access-gjb8t" (OuterVolumeSpecName: "kube-api-access-gjb8t") pod "87d7e683-a553-4ed5-a9a9-3da90b288de6" (UID: "87d7e683-a553-4ed5-a9a9-3da90b288de6"). InnerVolumeSpecName "kube-api-access-gjb8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:05:35.618910 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.618822    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87d7e683-a553-4ed5-a9a9-3da90b288de6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "87d7e683-a553-4ed5-a9a9-3da90b288de6" (UID: "87d7e683-a553-4ed5-a9a9-3da90b288de6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:05:35.666536 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.666502    2584 generic.go:356] "Generic (PLEG): container finished" podID="87d7e683-a553-4ed5-a9a9-3da90b288de6" containerID="e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e" exitCode=0
Jul 22 05:05:35.666677 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.666553    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"
Jul 22 05:05:35.666677 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.666592    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn" event={"ID":"87d7e683-a553-4ed5-a9a9-3da90b288de6","Type":"ContainerDied","Data":"e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e"}
Jul 22 05:05:35.666677 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.666671    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn" event={"ID":"87d7e683-a553-4ed5-a9a9-3da90b288de6","Type":"ContainerDied","Data":"de07c440276a5f57e2020fae8e0c153ee5c3f5013b951aa3c93288cf9ae13b67"}
Jul 22 05:05:35.666781 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.666693    2584 scope.go:117] "RemoveContainer" containerID="e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e"
Jul 22 05:05:35.675032 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.675012    2584 scope.go:117] "RemoveContainer" containerID="e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e"
Jul 22 05:05:35.675293 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:05:35.675272    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e\": container with ID starting with e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e not found: ID does not exist" containerID="e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e"
Jul 22 05:05:35.675372 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.675302    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e"} err="failed to get container status \"e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e\": rpc error: code = NotFound desc = could not find container \"e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e\": container with ID starting with e1ec7250c2417d60d3e928e0b734d3493f0980751e821f80e88777f3bceac74e not found: ID does not exist"
Jul 22 05:05:35.686629 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.686605    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"]
Jul 22 05:05:35.688834 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.688814    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31b554fe-675c55d846-94tfn"]
Jul 22 05:05:35.717957 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.717916    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/87d7e683-a553-4ed5-a9a9-3da90b288de6-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:05:35.718089 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.717974    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjb8t\" (UniqueName: \"kubernetes.io/projected/87d7e683-a553-4ed5-a9a9-3da90b288de6-kube-api-access-gjb8t\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:05:35.718089 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:35.717984    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/87d7e683-a553-4ed5-a9a9-3da90b288de6-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:05:36.476141 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:36.476107    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87d7e683-a553-4ed5-a9a9-3da90b288de6" path="/var/lib/kubelet/pods/87d7e683-a553-4ed5-a9a9-3da90b288de6/volumes"
Jul 22 05:05:39.297383 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:39.297350    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:39.883937 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:39.883903    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:41.083767 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:41.083731    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:45.915712 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:45.915675    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:46.014981 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:46.014936    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:46.175862 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:46.175781    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:46.414114 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:46.414079    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:46.543011 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:46.542971    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:46.639030 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:46.639000    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:46.738335 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:46.738306    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:49.414357 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:49.414316    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:49.463188 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:49.463144    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:52.246887 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:52.246849    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:52.425170 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:52.425139    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:52.526235 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:52.526153    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:52.626528 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:52.626495    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:58.211083 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:58.211038    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:05:58.272720 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:05:58.272691    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:04.978318 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:04.978241    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:05.277859 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:05.277774    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:05.670271 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:05.670184    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:08.400962 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.400910    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:08.522349 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.522317    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"]
Jul 22 05:06:08.522636 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.522624    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d7e683-a553-4ed5-a9a9-3da90b288de6" containerName="maas-api"
Jul 22 05:06:08.522678 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.522637    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d7e683-a553-4ed5-a9a9-3da90b288de6" containerName="maas-api"
Jul 22 05:06:08.522712 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.522700    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d7e683-a553-4ed5-a9a9-3da90b288de6" containerName="maas-api"
Jul 22 05:06:08.525339 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.525321    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:08.528154 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.528126    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4nh9t\""
Jul 22 05:06:08.528505 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.528488    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-06f9a996-serving-cert\""
Jul 22 05:06:08.542513 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.542486    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"]
Jul 22 05:06:08.543132 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.543108    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:08.600832 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.600799    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6650f0-f7ca-401e-9519-dac92f9678c6-maas-api-tls\") pod \"maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr\" (UID: \"cf6650f0-f7ca-401e-9519-dac92f9678c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:08.601017 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.600855    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qv4d\" (UniqueName: \"kubernetes.io/projected/cf6650f0-f7ca-401e-9519-dac92f9678c6-kube-api-access-2qv4d\") pod \"maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr\" (UID: \"cf6650f0-f7ca-401e-9519-dac92f9678c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:08.601017 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.600896    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6650f0-f7ca-401e-9519-dac92f9678c6-openshift-service-ca\") pod \"maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr\" (UID: \"cf6650f0-f7ca-401e-9519-dac92f9678c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:08.656854 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.656768    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:08.701866 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.701834    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6650f0-f7ca-401e-9519-dac92f9678c6-maas-api-tls\") pod \"maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr\" (UID: \"cf6650f0-f7ca-401e-9519-dac92f9678c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:08.702052 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.701896    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qv4d\" (UniqueName: \"kubernetes.io/projected/cf6650f0-f7ca-401e-9519-dac92f9678c6-kube-api-access-2qv4d\") pod \"maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr\" (UID: \"cf6650f0-f7ca-401e-9519-dac92f9678c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:08.702052 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.701933    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6650f0-f7ca-401e-9519-dac92f9678c6-openshift-service-ca\") pod \"maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr\" (UID: \"cf6650f0-f7ca-401e-9519-dac92f9678c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:08.702617 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.702599    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6650f0-f7ca-401e-9519-dac92f9678c6-openshift-service-ca\") pod \"maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr\" (UID: \"cf6650f0-f7ca-401e-9519-dac92f9678c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:08.704365 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.704347    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6650f0-f7ca-401e-9519-dac92f9678c6-maas-api-tls\") pod \"maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr\" (UID: \"cf6650f0-f7ca-401e-9519-dac92f9678c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:08.711363 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.711340    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qv4d\" (UniqueName: \"kubernetes.io/projected/cf6650f0-f7ca-401e-9519-dac92f9678c6-kube-api-access-2qv4d\") pod \"maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr\" (UID: \"cf6650f0-f7ca-401e-9519-dac92f9678c6\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:08.757370 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.757331    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:08.834985 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.834931    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:08.962198 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.962175    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"]
Jul 22 05:06:08.964440 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:06:08.964407    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf6650f0_f7ca_401e_9519_dac92f9678c6.slice/crio-96f9a52959ad77c5c3e1e32fa7e5484638122340ad3c58491720b8e4e4679b45 WatchSource:0}: Error finding container 96f9a52959ad77c5c3e1e32fa7e5484638122340ad3c58491720b8e4e4679b45: Status 404 returned error can't find the container with id 96f9a52959ad77c5c3e1e32fa7e5484638122340ad3c58491720b8e4e4679b45
Jul 22 05:06:08.965920 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:08.965903    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 05:06:09.080190 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:09.080156    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:09.179069 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:09.178991    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:09.809653 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:09.809618    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr" event={"ID":"cf6650f0-f7ca-401e-9519-dac92f9678c6","Type":"ContainerStarted","Data":"96f9a52959ad77c5c3e1e32fa7e5484638122340ad3c58491720b8e4e4679b45"}
Jul 22 05:06:10.815485 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:10.815399    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr" event={"ID":"cf6650f0-f7ca-401e-9519-dac92f9678c6","Type":"ContainerStarted","Data":"1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad"}
Jul 22 05:06:10.815823 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:10.815536    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:10.832340 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:10.832288    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr" podStartSLOduration=1.934336271 podStartE2EDuration="2.832273716s" totalImagesPullingTime="897.937445ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:06:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:06:10.830766553 +0000 UTC m=+1980.888604151" watchObservedRunningTime="2026-07-22 05:06:10.832273716 +0000 UTC m=+1980.890111277"
Jul 22 05:06:12.872888 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:12.872858    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:06:16.826123 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:16.826093    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:06:21.680205 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:06:21.680170    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:17.122790 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.122752    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"]
Jul 22 05:07:17.123295 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.123019    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr" podUID="cf6650f0-f7ca-401e-9519-dac92f9678c6" containerName="maas-api" containerID="cri-o://1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad" gracePeriod=30
Jul 22 05:07:17.139191 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.139166    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:17.373536 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.373472    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:07:17.406070 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.406040    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qv4d\" (UniqueName: \"kubernetes.io/projected/cf6650f0-f7ca-401e-9519-dac92f9678c6-kube-api-access-2qv4d\") pod \"cf6650f0-f7ca-401e-9519-dac92f9678c6\" (UID: \"cf6650f0-f7ca-401e-9519-dac92f9678c6\") "
Jul 22 05:07:17.406262 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.406102    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6650f0-f7ca-401e-9519-dac92f9678c6-maas-api-tls\") pod \"cf6650f0-f7ca-401e-9519-dac92f9678c6\" (UID: \"cf6650f0-f7ca-401e-9519-dac92f9678c6\") "
Jul 22 05:07:17.406262 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.406142    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6650f0-f7ca-401e-9519-dac92f9678c6-openshift-service-ca\") pod \"cf6650f0-f7ca-401e-9519-dac92f9678c6\" (UID: \"cf6650f0-f7ca-401e-9519-dac92f9678c6\") "
Jul 22 05:07:17.406517 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.406484    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf6650f0-f7ca-401e-9519-dac92f9678c6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cf6650f0-f7ca-401e-9519-dac92f9678c6" (UID: "cf6650f0-f7ca-401e-9519-dac92f9678c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:07:17.408147 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.408118    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf6650f0-f7ca-401e-9519-dac92f9678c6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cf6650f0-f7ca-401e-9519-dac92f9678c6" (UID: "cf6650f0-f7ca-401e-9519-dac92f9678c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:07:17.408680 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.408658    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf6650f0-f7ca-401e-9519-dac92f9678c6-kube-api-access-2qv4d" (OuterVolumeSpecName: "kube-api-access-2qv4d") pod "cf6650f0-f7ca-401e-9519-dac92f9678c6" (UID: "cf6650f0-f7ca-401e-9519-dac92f9678c6"). InnerVolumeSpecName "kube-api-access-2qv4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:07:17.507787 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.507753    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qv4d\" (UniqueName: \"kubernetes.io/projected/cf6650f0-f7ca-401e-9519-dac92f9678c6-kube-api-access-2qv4d\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:07:17.507787 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.507783    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf6650f0-f7ca-401e-9519-dac92f9678c6-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:07:17.507787 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:17.507792    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf6650f0-f7ca-401e-9519-dac92f9678c6-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:07:18.100217 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:18.100183    2584 generic.go:356] "Generic (PLEG): container finished" podID="cf6650f0-f7ca-401e-9519-dac92f9678c6" containerID="1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad" exitCode=0
Jul 22 05:07:18.100394 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:18.100228    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"
Jul 22 05:07:18.100394 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:18.100230    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr" event={"ID":"cf6650f0-f7ca-401e-9519-dac92f9678c6","Type":"ContainerDied","Data":"1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad"}
Jul 22 05:07:18.100394 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:18.100356    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr" event={"ID":"cf6650f0-f7ca-401e-9519-dac92f9678c6","Type":"ContainerDied","Data":"96f9a52959ad77c5c3e1e32fa7e5484638122340ad3c58491720b8e4e4679b45"}
Jul 22 05:07:18.100394 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:18.100386    2584 scope.go:117] "RemoveContainer" containerID="1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad"
Jul 22 05:07:18.109232 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:18.109214    2584 scope.go:117] "RemoveContainer" containerID="1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad"
Jul 22 05:07:18.109494 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:07:18.109471    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad\": container with ID starting with 1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad not found: ID does not exist" containerID="1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad"
Jul 22 05:07:18.109591 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:18.109501    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad"} err="failed to get container status \"1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad\": rpc error: code = NotFound desc = could not find container \"1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad\": container with ID starting with 1a0a52722dde326891ee1818fd4027912f5e265c240356c228045a84bc8941ad not found: ID does not exist"
Jul 22 05:07:18.120382 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:18.120334    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"]
Jul 22 05:07:18.122391 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:18.122371    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-06f9a996-88845cdc7-jrbcr"]
Jul 22 05:07:18.476291 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:18.476258    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf6650f0-f7ca-401e-9519-dac92f9678c6" path="/var/lib/kubelet/pods/cf6650f0-f7ca-401e-9519-dac92f9678c6/volumes"
Jul 22 05:07:21.783077 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:21.783042    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:23.981909 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:23.981872    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:07:29.062215 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:07:29.062182    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:05.751021 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:05.750990    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:06.226710 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:06.226676    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:09.166534 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:09.166495    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:09.263710 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:09.263674    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:11.759895 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:11.759856    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:11.827520 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:11.827487    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:12.044225 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:12.044145    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:12.285151 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:12.285122    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:13.356624 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:13.356586    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:13.456212 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:13.456181    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:13.555919 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:13.555888    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:14.306931 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:14.306900    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:14.405326 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:14.405268    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:14.504936 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:14.504904    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:15.890961 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:15.890904    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:21.676647 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:21.676608    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:21.739086 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:21.739051    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:22.343340 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:22.343305    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:27.993010 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:27.992967    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:28.102406 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:28.102372    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:28.192895 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:28.192863    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:38.747486 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:38.747445    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:08:39.130202 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:08:39.130119    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:00.066278 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:00.066239    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:06.332282 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:06.332190    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:06.435324 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:06.435286    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:06.691578 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:06.691495    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:06.979274 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:06.979239    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:07.256193 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:07.256115    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:10.397997 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.397962    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:10.479214 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.479184    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:10.479394 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.479352    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"]
Jul 22 05:09:10.479808 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.479793    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf6650f0-f7ca-401e-9519-dac92f9678c6" containerName="maas-api"
Jul 22 05:09:10.479880 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.479812    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf6650f0-f7ca-401e-9519-dac92f9678c6" containerName="maas-api"
Jul 22 05:09:10.479935 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.479923    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf6650f0-f7ca-401e-9519-dac92f9678c6" containerName="maas-api"
Jul 22 05:09:10.483071 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.483051    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:10.485798 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.485776    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-fce892-serving-cert\""
Jul 22 05:09:10.485798 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.485792    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4nh9t\""
Jul 22 05:09:10.495514 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.495490    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"]
Jul 22 05:09:10.545014 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.544982    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:10.596110 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.596077    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d79js\" (UniqueName: \"kubernetes.io/projected/cacfc761-c1fb-4134-8431-1091300d0d9f-kube-api-access-d79js\") pod \"maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc\" (UID: \"cacfc761-c1fb-4134-8431-1091300d0d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:10.596110 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.596114    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cacfc761-c1fb-4134-8431-1091300d0d9f-maas-api-tls\") pod \"maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc\" (UID: \"cacfc761-c1fb-4134-8431-1091300d0d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:10.596321 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.596155    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cacfc761-c1fb-4134-8431-1091300d0d9f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc\" (UID: \"cacfc761-c1fb-4134-8431-1091300d0d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:10.650628 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.650548    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:10.697601 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.697571    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d79js\" (UniqueName: \"kubernetes.io/projected/cacfc761-c1fb-4134-8431-1091300d0d9f-kube-api-access-d79js\") pod \"maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc\" (UID: \"cacfc761-c1fb-4134-8431-1091300d0d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:10.697694 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.697609    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cacfc761-c1fb-4134-8431-1091300d0d9f-maas-api-tls\") pod \"maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc\" (UID: \"cacfc761-c1fb-4134-8431-1091300d0d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:10.697694 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.697662    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cacfc761-c1fb-4134-8431-1091300d0d9f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc\" (UID: \"cacfc761-c1fb-4134-8431-1091300d0d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:10.698351 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.698318    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cacfc761-c1fb-4134-8431-1091300d0d9f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc\" (UID: \"cacfc761-c1fb-4134-8431-1091300d0d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:10.700154 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.700134    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cacfc761-c1fb-4134-8431-1091300d0d9f-maas-api-tls\") pod \"maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc\" (UID: \"cacfc761-c1fb-4134-8431-1091300d0d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:10.722928 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.722902    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d79js\" (UniqueName: \"kubernetes.io/projected/cacfc761-c1fb-4134-8431-1091300d0d9f-kube-api-access-d79js\") pod \"maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc\" (UID: \"cacfc761-c1fb-4134-8431-1091300d0d9f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:10.796791 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.796757    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:10.933979 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:10.933827    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"]
Jul 22 05:09:10.936599 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:09:10.936576    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcacfc761_c1fb_4134_8431_1091300d0d9f.slice/crio-f31d1eb8d1d72802c077897c6acd63e781ec888898008af010208da6e83dcc85 WatchSource:0}: Error finding container f31d1eb8d1d72802c077897c6acd63e781ec888898008af010208da6e83dcc85: Status 404 returned error can't find the container with id f31d1eb8d1d72802c077897c6acd63e781ec888898008af010208da6e83dcc85
Jul 22 05:09:11.152857 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:11.152821    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:11.253129 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:11.253094    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:11.579749 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:11.579657    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc" event={"ID":"cacfc761-c1fb-4134-8431-1091300d0d9f","Type":"ContainerStarted","Data":"97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e"}
Jul 22 05:09:11.579749 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:11.579736    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc" event={"ID":"cacfc761-c1fb-4134-8431-1091300d0d9f","Type":"ContainerStarted","Data":"f31d1eb8d1d72802c077897c6acd63e781ec888898008af010208da6e83dcc85"}
Jul 22 05:09:11.580194 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:11.579787    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:11.596283 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:11.596236    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc" podStartSLOduration=1.199890173 podStartE2EDuration="1.596223244s" totalImagesPullingTime="396.333071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:09:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:09:11.595548482 +0000 UTC m=+2161.653386070" watchObservedRunningTime="2026-07-22 05:09:11.596223244 +0000 UTC m=+2161.654060805"
Jul 22 05:09:14.924196 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:14.924158    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:15.278481 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:15.278451    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:15.569452 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:15.569359    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:15.664114 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:15.664082    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:17.589859 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:17.589833    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:09:18.429079 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.429040    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:18.526882 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.526840    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:18.684405 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.684321    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"]
Jul 22 05:09:18.687830 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.687807    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:18.692777 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.692745    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-8e4aa9-serving-cert\""
Jul 22 05:09:18.706739 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.706709    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"]
Jul 22 05:09:18.740172 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.740141    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:18.770459 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.770422    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:18.770610 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.770531    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-maas-api-tls\") pod \"maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:18.770610 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.770592    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drqsh\" (UniqueName: \"kubernetes.io/projected/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-kube-api-access-drqsh\") pod \"maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:18.871779 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.871743    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-maas-api-tls\") pod \"maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:18.872002 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.871802    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drqsh\" (UniqueName: \"kubernetes.io/projected/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-kube-api-access-drqsh\") pod \"maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:18.872002 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.871851    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:18.872002 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:09:18.871882    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-serving-cert: secret "maas-api-e2e-inf-b-8e4aa9-serving-cert" not found
Jul 22 05:09:18.872002 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:09:18.871991    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-maas-api-tls podName:bd4c9680-7806-44b7-89bd-8b4a20bf68eb nodeName:}" failed. No retries permitted until 2026-07-22 05:09:19.371933332 +0000 UTC m=+2169.429770871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-maas-api-tls") pod "maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn" (UID: "bd4c9680-7806-44b7-89bd-8b4a20bf68eb") : secret "maas-api-e2e-inf-b-8e4aa9-serving-cert" not found
Jul 22 05:09:18.872491 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.872474    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-openshift-service-ca\") pod \"maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:18.881568 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.881544    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drqsh\" (UniqueName: \"kubernetes.io/projected/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-kube-api-access-drqsh\") pod \"maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:18.932486 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:18.932454    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:19.230700 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:19.230661    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:19.331696 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:19.331665    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:19.376229 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:19.376192    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-maas-api-tls\") pod \"maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:19.378577 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:19.378556    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-maas-api-tls\") pod \"maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:19.601724 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:19.601633    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:19.731204 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:19.731176    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"]
Jul 22 05:09:19.734173 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:09:19.734139    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd4c9680_7806_44b7_89bd_8b4a20bf68eb.slice/crio-7f532af3eb2c9e45226dcd1247482f228ad85fc438ee30d97b02edb40d5c6f24 WatchSource:0}: Error finding container 7f532af3eb2c9e45226dcd1247482f228ad85fc438ee30d97b02edb40d5c6f24: Status 404 returned error can't find the container with id 7f532af3eb2c9e45226dcd1247482f228ad85fc438ee30d97b02edb40d5c6f24
Jul 22 05:09:20.619025 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:20.618992    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn" event={"ID":"bd4c9680-7806-44b7-89bd-8b4a20bf68eb","Type":"ContainerStarted","Data":"a0ad6f7702b7f08ff399c11a51a68072efadb64b510c2602a8067c3a09903f3c"}
Jul 22 05:09:20.619219 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:20.619053    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn" event={"ID":"bd4c9680-7806-44b7-89bd-8b4a20bf68eb","Type":"ContainerStarted","Data":"7f532af3eb2c9e45226dcd1247482f228ad85fc438ee30d97b02edb40d5c6f24"}
Jul 22 05:09:20.619219 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:20.619079    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:20.634533 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:20.634457    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn" podStartSLOduration=2.282864681 podStartE2EDuration="2.634438267s" totalImagesPullingTime="351.573586ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:09:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:09:20.634183585 +0000 UTC m=+2170.692021149" watchObservedRunningTime="2026-07-22 05:09:20.634438267 +0000 UTC m=+2170.692275829"
Jul 22 05:09:22.973906 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:22.973869    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:26.629463 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:26.629435    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:09:31.981431 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:31.981395    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:32.063884 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:32.063846    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:36.106223 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:36.106192    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:39.990359 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:39.990292    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:40.092597 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:40.092565    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:43.287630 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:43.287596    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:09:57.988748 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:09:57.988695    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:42.684418 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:42.684345    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:43.577441 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:43.577407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:44.213270 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:44.213240    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:44.313203 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:44.313171    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:54.120184 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.120153    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"]
Jul 22 05:10:54.120705 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.120339    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc" podUID="cacfc761-c1fb-4134-8431-1091300d0d9f" containerName="maas-api" containerID="cri-o://97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e" gracePeriod=30
Jul 22 05:10:54.141403 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.141366    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:54.360382 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.360357    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:10:54.521726 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.521698    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cacfc761-c1fb-4134-8431-1091300d0d9f-maas-api-tls\") pod \"cacfc761-c1fb-4134-8431-1091300d0d9f\" (UID: \"cacfc761-c1fb-4134-8431-1091300d0d9f\") "
Jul 22 05:10:54.521896 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.521737    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cacfc761-c1fb-4134-8431-1091300d0d9f-openshift-service-ca\") pod \"cacfc761-c1fb-4134-8431-1091300d0d9f\" (UID: \"cacfc761-c1fb-4134-8431-1091300d0d9f\") "
Jul 22 05:10:54.521896 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.521800    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d79js\" (UniqueName: \"kubernetes.io/projected/cacfc761-c1fb-4134-8431-1091300d0d9f-kube-api-access-d79js\") pod \"cacfc761-c1fb-4134-8431-1091300d0d9f\" (UID: \"cacfc761-c1fb-4134-8431-1091300d0d9f\") "
Jul 22 05:10:54.522178 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.522147    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cacfc761-c1fb-4134-8431-1091300d0d9f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cacfc761-c1fb-4134-8431-1091300d0d9f" (UID: "cacfc761-c1fb-4134-8431-1091300d0d9f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:10:54.523770 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.523744    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cacfc761-c1fb-4134-8431-1091300d0d9f-kube-api-access-d79js" (OuterVolumeSpecName: "kube-api-access-d79js") pod "cacfc761-c1fb-4134-8431-1091300d0d9f" (UID: "cacfc761-c1fb-4134-8431-1091300d0d9f"). InnerVolumeSpecName "kube-api-access-d79js". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:10:54.523860 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.523839    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cacfc761-c1fb-4134-8431-1091300d0d9f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cacfc761-c1fb-4134-8431-1091300d0d9f" (UID: "cacfc761-c1fb-4134-8431-1091300d0d9f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:10:54.623278 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.623236    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d79js\" (UniqueName: \"kubernetes.io/projected/cacfc761-c1fb-4134-8431-1091300d0d9f-kube-api-access-d79js\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:10:54.623278 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.623274    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cacfc761-c1fb-4134-8431-1091300d0d9f-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:10:54.623278 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:54.623285    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cacfc761-c1fb-4134-8431-1091300d0d9f-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:10:55.027576 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:55.027537    2584 generic.go:356] "Generic (PLEG): container finished" podID="cacfc761-c1fb-4134-8431-1091300d0d9f" containerID="97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e" exitCode=0
Jul 22 05:10:55.027743 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:55.027587    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc" event={"ID":"cacfc761-c1fb-4134-8431-1091300d0d9f","Type":"ContainerDied","Data":"97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e"}
Jul 22 05:10:55.027743 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:55.027612    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"
Jul 22 05:10:55.027743 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:55.027659    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc" event={"ID":"cacfc761-c1fb-4134-8431-1091300d0d9f","Type":"ContainerDied","Data":"f31d1eb8d1d72802c077897c6acd63e781ec888898008af010208da6e83dcc85"}
Jul 22 05:10:55.027743 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:55.027684    2584 scope.go:117] "RemoveContainer" containerID="97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e"
Jul 22 05:10:55.035869 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:55.035851    2584 scope.go:117] "RemoveContainer" containerID="97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e"
Jul 22 05:10:55.036228 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:10:55.036192    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e\": container with ID starting with 97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e not found: ID does not exist" containerID="97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e"
Jul 22 05:10:55.036318 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:55.036241    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e"} err="failed to get container status \"97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e\": rpc error: code = NotFound desc = could not find container \"97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e\": container with ID starting with 97c9e2c7409271d064f05965c14590a443efb0138dd2f7394d4ab9a0d6ccf16e not found: ID does not exist"
Jul 22 05:10:55.048309 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:55.048280    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"]
Jul 22 05:10:55.052087 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:55.052059    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fce892-648ccc775b-qc7mc"]
Jul 22 05:10:56.476956 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:56.476906    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cacfc761-c1fb-4134-8431-1091300d0d9f" path="/var/lib/kubelet/pods/cacfc761-c1fb-4134-8431-1091300d0d9f/volumes"
Jul 22 05:10:58.785417 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:58.785386    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:10:59.176806 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:10:59.176723    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:04.846097 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:04.846060    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:04.945678 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:04.945637    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:05.119190 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:05.119100    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:05.374756 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:05.374668    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:05.987361 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:05.987328    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:06.088181 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:06.088153    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:15.927439 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:15.927403    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"]
Jul 22 05:11:15.928241 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:15.928190    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn" podUID="bd4c9680-7806-44b7-89bd-8b4a20bf68eb" containerName="maas-api" containerID="cri-o://a0ad6f7702b7f08ff399c11a51a68072efadb64b510c2602a8067c3a09903f3c" gracePeriod=30
Jul 22 05:11:15.948820 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:15.948791    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:16.119515 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:16.119486    2584 generic.go:356] "Generic (PLEG): container finished" podID="bd4c9680-7806-44b7-89bd-8b4a20bf68eb" containerID="a0ad6f7702b7f08ff399c11a51a68072efadb64b510c2602a8067c3a09903f3c" exitCode=0
Jul 22 05:11:16.119662 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:16.119556    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn" event={"ID":"bd4c9680-7806-44b7-89bd-8b4a20bf68eb","Type":"ContainerDied","Data":"a0ad6f7702b7f08ff399c11a51a68072efadb64b510c2602a8067c3a09903f3c"}
Jul 22 05:11:16.177634 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:16.177574    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:11:16.211360 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:16.211331    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-openshift-service-ca\") pod \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") "
Jul 22 05:11:16.211486 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:16.211392    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-maas-api-tls\") pod \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") "
Jul 22 05:11:16.211486 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:16.211451    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drqsh\" (UniqueName: \"kubernetes.io/projected/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-kube-api-access-drqsh\") pod \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\" (UID: \"bd4c9680-7806-44b7-89bd-8b4a20bf68eb\") "
Jul 22 05:11:16.211735 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:16.211707    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bd4c9680-7806-44b7-89bd-8b4a20bf68eb" (UID: "bd4c9680-7806-44b7-89bd-8b4a20bf68eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:11:16.213496 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:16.213463    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bd4c9680-7806-44b7-89bd-8b4a20bf68eb" (UID: "bd4c9680-7806-44b7-89bd-8b4a20bf68eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:11:16.213589 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:16.213544    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-kube-api-access-drqsh" (OuterVolumeSpecName: "kube-api-access-drqsh") pod "bd4c9680-7806-44b7-89bd-8b4a20bf68eb" (UID: "bd4c9680-7806-44b7-89bd-8b4a20bf68eb"). InnerVolumeSpecName "kube-api-access-drqsh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:11:16.312430 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:16.312394    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:11:16.312430 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:16.312422    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:11:16.312430 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:16.312436    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drqsh\" (UniqueName: \"kubernetes.io/projected/bd4c9680-7806-44b7-89bd-8b4a20bf68eb-kube-api-access-drqsh\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:11:17.125667 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:17.125637    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"
Jul 22 05:11:17.126191 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:17.125689    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn" event={"ID":"bd4c9680-7806-44b7-89bd-8b4a20bf68eb","Type":"ContainerDied","Data":"7f532af3eb2c9e45226dcd1247482f228ad85fc438ee30d97b02edb40d5c6f24"}
Jul 22 05:11:17.126191 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:17.125764    2584 scope.go:117] "RemoveContainer" containerID="a0ad6f7702b7f08ff399c11a51a68072efadb64b510c2602a8067c3a09903f3c"
Jul 22 05:11:17.141406 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:17.141379    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"]
Jul 22 05:11:17.147338 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:17.147311    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-8e4aa9-64844b6bf6-zpqmn"]
Jul 22 05:11:18.476455 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:18.476423    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd4c9680-7806-44b7-89bd-8b4a20bf68eb" path="/var/lib/kubelet/pods/bd4c9680-7806-44b7-89bd-8b4a20bf68eb/volumes"
Jul 22 05:11:20.570732 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:20.570704    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:20.958036 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:20.957958    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:26.803627 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:26.803589    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:27.888715 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:27.888644    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:28.009441 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:28.009407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:28.213706 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:28.213679    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:31.242928 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.242892    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:31.343453 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.343421    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:31.474667 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.474635    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"]
Jul 22 05:11:31.475035 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.475007    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd4c9680-7806-44b7-89bd-8b4a20bf68eb" containerName="maas-api"
Jul 22 05:11:31.475035 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.475027    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd4c9680-7806-44b7-89bd-8b4a20bf68eb" containerName="maas-api"
Jul 22 05:11:31.475201 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.475070    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cacfc761-c1fb-4134-8431-1091300d0d9f" containerName="maas-api"
Jul 22 05:11:31.475201 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.475077    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="cacfc761-c1fb-4134-8431-1091300d0d9f" containerName="maas-api"
Jul 22 05:11:31.475201 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.475160    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="cacfc761-c1fb-4134-8431-1091300d0d9f" containerName="maas-api"
Jul 22 05:11:31.475201 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.475177    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd4c9680-7806-44b7-89bd-8b4a20bf68eb" containerName="maas-api"
Jul 22 05:11:31.478229 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.478210    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:31.480839 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.480816    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4nh9t\""
Jul 22 05:11:31.480967 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.480872    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-c3de18-serving-cert\""
Jul 22 05:11:31.487469 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.487450    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"]
Jul 22 05:11:31.506428 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.506366    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:31.629383 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.629338    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:31.649554 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.649520    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-maas-api-tls\") pod \"maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2\" (UID: \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:31.649720 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.649572    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zt45\" (UniqueName: \"kubernetes.io/projected/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-kube-api-access-8zt45\") pod \"maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2\" (UID: \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:31.649720 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.649666    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-openshift-service-ca\") pod \"maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2\" (UID: \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:31.750392 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.750349    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-maas-api-tls\") pod \"maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2\" (UID: \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:31.750392 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.750395    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zt45\" (UniqueName: \"kubernetes.io/projected/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-kube-api-access-8zt45\") pod \"maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2\" (UID: \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:31.750645 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.750432    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-openshift-service-ca\") pod \"maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2\" (UID: \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:31.751067 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.751043    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-openshift-service-ca\") pod \"maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2\" (UID: \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:31.752792 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.752768    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-maas-api-tls\") pod \"maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2\" (UID: \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:31.758739 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.758689    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zt45\" (UniqueName: \"kubernetes.io/projected/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-kube-api-access-8zt45\") pod \"maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2\" (UID: \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:31.790119 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.790083    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:31.919227 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.919202    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"]
Jul 22 05:11:31.921012 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:11:31.920990    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a71eb4d_66e5_4e4e_b4c7_12f02f6f384d.slice/crio-44b9639a32d19cdc01899cb896077d038de527d6c520d09782c1a835ea3009da WatchSource:0}: Error finding container 44b9639a32d19cdc01899cb896077d038de527d6c520d09782c1a835ea3009da: Status 404 returned error can't find the container with id 44b9639a32d19cdc01899cb896077d038de527d6c520d09782c1a835ea3009da
Jul 22 05:11:31.922739 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:31.922723    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 22 05:11:32.060588 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:32.060495    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:32.161187 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:32.161157    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:32.188852 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:32.188814    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2" event={"ID":"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d","Type":"ContainerStarted","Data":"44b9639a32d19cdc01899cb896077d038de527d6c520d09782c1a835ea3009da"}
Jul 22 05:11:33.195244 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:33.195208    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2" event={"ID":"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d","Type":"ContainerStarted","Data":"4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10"}
Jul 22 05:11:33.195625 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:33.195275    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:33.212832 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:33.212781    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2" podStartSLOduration=1.633441965 podStartE2EDuration="2.212765799s" totalImagesPullingTime="579.323834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:11:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:11:33.211280065 +0000 UTC m=+2303.269117639" watchObservedRunningTime="2026-07-22 05:11:33.212765799 +0000 UTC m=+2303.270603360"
Jul 22 05:11:35.811056 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:35.811021    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:36.344258 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:36.344219    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:36.667759 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:36.667680    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:36.826689 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:36.826649    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:39.206027 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.205997    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:11:39.308449 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.308407    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:39.409878 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.409824    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:39.496239 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.496207    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"]
Jul 22 05:11:39.500164 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.500146    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:39.502536 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.502517    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-04dfa1-serving-cert\""
Jul 22 05:11:39.509222 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.509200    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"]
Jul 22 05:11:39.546888 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.546863    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:39.620741 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.620712    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eadca20-862e-49d3-893b-7f1587fb7aa8-openshift-service-ca\") pod \"maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:39.620896 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.620787    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7eadca20-862e-49d3-893b-7f1587fb7aa8-maas-api-tls\") pod \"maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:39.620896 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.620827    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vbw8\" (UniqueName: \"kubernetes.io/projected/7eadca20-862e-49d3-893b-7f1587fb7aa8-kube-api-access-8vbw8\") pod \"maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:39.722071 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.722035    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eadca20-862e-49d3-893b-7f1587fb7aa8-openshift-service-ca\") pod \"maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:39.722247 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.722104    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7eadca20-862e-49d3-893b-7f1587fb7aa8-maas-api-tls\") pod \"maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:39.722247 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.722141    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vbw8\" (UniqueName: \"kubernetes.io/projected/7eadca20-862e-49d3-893b-7f1587fb7aa8-kube-api-access-8vbw8\") pod \"maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:39.722247 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:11:39.722211    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-serving-cert: secret "maas-api-e2e-api-b-04dfa1-serving-cert" not found
Jul 22 05:11:39.722428 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:11:39.722284    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7eadca20-862e-49d3-893b-7f1587fb7aa8-maas-api-tls podName:7eadca20-862e-49d3-893b-7f1587fb7aa8 nodeName:}" failed. No retries permitted until 2026-07-22 05:11:40.22226357 +0000 UTC m=+2310.280101121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7eadca20-862e-49d3-893b-7f1587fb7aa8-maas-api-tls") pod "maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv" (UID: "7eadca20-862e-49d3-893b-7f1587fb7aa8") : secret "maas-api-e2e-api-b-04dfa1-serving-cert" not found
Jul 22 05:11:39.722822 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.722801    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eadca20-862e-49d3-893b-7f1587fb7aa8-openshift-service-ca\") pod \"maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:39.730146 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.730118    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vbw8\" (UniqueName: \"kubernetes.io/projected/7eadca20-862e-49d3-893b-7f1587fb7aa8-kube-api-access-8vbw8\") pod \"maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:39.955264 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:39.955146    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:40.214903 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:40.214856    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:40.227233 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:40.227198    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7eadca20-862e-49d3-893b-7f1587fb7aa8-maas-api-tls\") pod \"maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:40.229809 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:40.229789    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7eadca20-862e-49d3-893b-7f1587fb7aa8-maas-api-tls\") pod \"maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:40.308930 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:40.308871    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:40.413866 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:40.413825    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:40.542828 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:40.542798    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"]
Jul 22 05:11:40.545290 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:11:40.545262    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eadca20_862e_49d3_893b_7f1587fb7aa8.slice/crio-0760e084440749cb6b44647ada2cd514b3517522c229bee3ea0d6d1c9fc2882e WatchSource:0}: Error finding container 0760e084440749cb6b44647ada2cd514b3517522c229bee3ea0d6d1c9fc2882e: Status 404 returned error can't find the container with id 0760e084440749cb6b44647ada2cd514b3517522c229bee3ea0d6d1c9fc2882e
Jul 22 05:11:41.237282 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:41.237247    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv" event={"ID":"7eadca20-862e-49d3-893b-7f1587fb7aa8","Type":"ContainerStarted","Data":"1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f"}
Jul 22 05:11:41.237644 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:41.237330    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv" event={"ID":"7eadca20-862e-49d3-893b-7f1587fb7aa8","Type":"ContainerStarted","Data":"0760e084440749cb6b44647ada2cd514b3517522c229bee3ea0d6d1c9fc2882e"}
Jul 22 05:11:41.237644 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:41.237392    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:41.253880 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:41.253827    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv" podStartSLOduration=1.864322966 podStartE2EDuration="2.253807199s" totalImagesPullingTime="389.484233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:11:41.252181119 +0000 UTC m=+2311.310018680" watchObservedRunningTime="2026-07-22 05:11:41.253807199 +0000 UTC m=+2311.311644760"
Jul 22 05:11:43.844405 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:43.844374    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:47.247503 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:47.247477    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:11:52.808455 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:52.808391    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:11:52.909135 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:11:52.909094    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:00.985545 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:00.985507    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:01.086778 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:01.086740    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:02.800502 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:02.800409    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:02.900954 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:02.900902    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:08.045912 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.045875    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"]
Jul 22 05:12:08.046329 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.046149    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2" podUID="7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d" containerName="maas-api" containerID="cri-o://4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10" gracePeriod=30
Jul 22 05:12:08.073789 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.073732    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:08.289224 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.289199    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:12:08.356103 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.356009    2584 generic.go:356] "Generic (PLEG): container finished" podID="7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d" containerID="4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10" exitCode=0
Jul 22 05:12:08.356103 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.356058    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"
Jul 22 05:12:08.356103 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.356083    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2" event={"ID":"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d","Type":"ContainerDied","Data":"4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10"}
Jul 22 05:12:08.356370 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.356123    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2" event={"ID":"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d","Type":"ContainerDied","Data":"44b9639a32d19cdc01899cb896077d038de527d6c520d09782c1a835ea3009da"}
Jul 22 05:12:08.356370 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.356143    2584 scope.go:117] "RemoveContainer" containerID="4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10"
Jul 22 05:12:08.364317 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.364299    2584 scope.go:117] "RemoveContainer" containerID="4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10"
Jul 22 05:12:08.364537 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:12:08.364518    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10\": container with ID starting with 4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10 not found: ID does not exist" containerID="4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10"
Jul 22 05:12:08.364589 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.364546    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10"} err="failed to get container status \"4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10\": rpc error: code = NotFound desc = could not find container \"4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10\": container with ID starting with 4c78e98c352b58b62832f3a6c8ad3177907711ff127fb9ed73c8949ee9809c10 not found: ID does not exist"
Jul 22 05:12:08.369899 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.369880    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zt45\" (UniqueName: \"kubernetes.io/projected/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-kube-api-access-8zt45\") pod \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\" (UID: \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\") "
Jul 22 05:12:08.369993 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.369920    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-maas-api-tls\") pod \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\" (UID: \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\") "
Jul 22 05:12:08.369993 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.369975    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-openshift-service-ca\") pod \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\" (UID: \"7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d\") "
Jul 22 05:12:08.370282 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.370261    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d" (UID: "7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:12:08.371802 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.371787    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d" (UID: "7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:12:08.372029 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.372008    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-kube-api-access-8zt45" (OuterVolumeSpecName: "kube-api-access-8zt45") pod "7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d" (UID: "7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d"). InnerVolumeSpecName "kube-api-access-8zt45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:12:08.470566 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.470530    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:12:08.470566 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.470556    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zt45\" (UniqueName: \"kubernetes.io/projected/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-kube-api-access-8zt45\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:12:08.470566 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.470566    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:12:08.671904 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.671819    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"]
Jul 22 05:12:08.674874 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:08.674852    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c3de18-687b5f6c5b-txcr2"]
Jul 22 05:12:10.476546 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:10.476514    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d" path="/var/lib/kubelet/pods/7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d/volumes"
Jul 22 05:12:12.225743 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:12.225695    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:12.638536 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:12.638441    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:18.289456 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:18.289423    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:18.389064 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:18.389033    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:18.578480 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:18.578389    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:18.820217 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:18.820184    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:19.480822 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:19.480794    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:19.582155 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:19.582116    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:34.378853 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.378821    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"]
Jul 22 05:12:34.379454 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.379094    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv" podUID="7eadca20-862e-49d3-893b-7f1587fb7aa8" containerName="maas-api" containerID="cri-o://1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f" gracePeriod=30
Jul 22 05:12:34.404161 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.404136    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:34.626985 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.626957    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:12:34.696475 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.696377    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vbw8\" (UniqueName: \"kubernetes.io/projected/7eadca20-862e-49d3-893b-7f1587fb7aa8-kube-api-access-8vbw8\") pod \"7eadca20-862e-49d3-893b-7f1587fb7aa8\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") "
Jul 22 05:12:34.696475 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.696429    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eadca20-862e-49d3-893b-7f1587fb7aa8-openshift-service-ca\") pod \"7eadca20-862e-49d3-893b-7f1587fb7aa8\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") "
Jul 22 05:12:34.696475 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.696449    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7eadca20-862e-49d3-893b-7f1587fb7aa8-maas-api-tls\") pod \"7eadca20-862e-49d3-893b-7f1587fb7aa8\" (UID: \"7eadca20-862e-49d3-893b-7f1587fb7aa8\") "
Jul 22 05:12:34.696892 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.696863    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7eadca20-862e-49d3-893b-7f1587fb7aa8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7eadca20-862e-49d3-893b-7f1587fb7aa8" (UID: "7eadca20-862e-49d3-893b-7f1587fb7aa8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:12:34.698593 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.698565    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7eadca20-862e-49d3-893b-7f1587fb7aa8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7eadca20-862e-49d3-893b-7f1587fb7aa8" (UID: "7eadca20-862e-49d3-893b-7f1587fb7aa8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:12:34.698593 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.698565    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7eadca20-862e-49d3-893b-7f1587fb7aa8-kube-api-access-8vbw8" (OuterVolumeSpecName: "kube-api-access-8vbw8") pod "7eadca20-862e-49d3-893b-7f1587fb7aa8" (UID: "7eadca20-862e-49d3-893b-7f1587fb7aa8"). InnerVolumeSpecName "kube-api-access-8vbw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:12:34.797221 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.797189    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vbw8\" (UniqueName: \"kubernetes.io/projected/7eadca20-862e-49d3-893b-7f1587fb7aa8-kube-api-access-8vbw8\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:12:34.797221 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.797217    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7eadca20-862e-49d3-893b-7f1587fb7aa8-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:12:34.797221 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:34.797228    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7eadca20-862e-49d3-893b-7f1587fb7aa8-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:12:35.479160 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:35.479129    2584 generic.go:356] "Generic (PLEG): container finished" podID="7eadca20-862e-49d3-893b-7f1587fb7aa8" containerID="1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f" exitCode=0
Jul 22 05:12:35.479160 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:35.479162    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv" event={"ID":"7eadca20-862e-49d3-893b-7f1587fb7aa8","Type":"ContainerDied","Data":"1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f"}
Jul 22 05:12:35.479660 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:35.479173    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"
Jul 22 05:12:35.479660 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:35.479196    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv" event={"ID":"7eadca20-862e-49d3-893b-7f1587fb7aa8","Type":"ContainerDied","Data":"0760e084440749cb6b44647ada2cd514b3517522c229bee3ea0d6d1c9fc2882e"}
Jul 22 05:12:35.479660 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:35.479217    2584 scope.go:117] "RemoveContainer" containerID="1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f"
Jul 22 05:12:35.487671 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:35.487653    2584 scope.go:117] "RemoveContainer" containerID="1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f"
Jul 22 05:12:35.487933 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:12:35.487914    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f\": container with ID starting with 1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f not found: ID does not exist" containerID="1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f"
Jul 22 05:12:35.488056 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:35.487963    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f"} err="failed to get container status \"1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f\": rpc error: code = NotFound desc = could not find container \"1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f\": container with ID starting with 1496179f80eb58d0b8b821e34ea0cc6fec056f373d8ebbf961cf544f8d3c449f not found: ID does not exist"
Jul 22 05:12:35.499536 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:35.499507    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"]
Jul 22 05:12:35.501550 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:35.501524    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-04dfa1-744cbcb5ff-xlztv"]
Jul 22 05:12:36.476269 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:36.476237    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7eadca20-862e-49d3-893b-7f1587fb7aa8" path="/var/lib/kubelet/pods/7eadca20-862e-49d3-893b-7f1587fb7aa8/volumes"
Jul 22 05:12:39.031503 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:39.031469    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:39.460020 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:39.459915    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:44.165285 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:44.165250    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:45.166928 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:45.166893    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:45.266474 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:45.266441    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:45.475185 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:45.475156    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:45.712960 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:45.712921    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:46.073546 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:46.073513    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:46.393711 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:46.393635    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:46.746588 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:46.746558    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:49.736162 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.736124    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:49.834565 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.834535    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:49.868773 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.868740    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"]
Jul 22 05:12:49.869120 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.869108    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d" containerName="maas-api"
Jul 22 05:12:49.869171 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.869123    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d" containerName="maas-api"
Jul 22 05:12:49.869171 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.869136    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7eadca20-862e-49d3-893b-7f1587fb7aa8" containerName="maas-api"
Jul 22 05:12:49.869171 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.869142    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7eadca20-862e-49d3-893b-7f1587fb7aa8" containerName="maas-api"
Jul 22 05:12:49.869268 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.869192    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7eadca20-862e-49d3-893b-7f1587fb7aa8" containerName="maas-api"
Jul 22 05:12:49.869268 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.869202    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a71eb4d-66e5-4e4e-b4c7-12f02f6f384d" containerName="maas-api"
Jul 22 05:12:49.872023 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.872006    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:49.874464 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.874445    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-c0234d-serving-cert\""
Jul 22 05:12:49.874581 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.874546    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-4nh9t\""
Jul 22 05:12:49.880488 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.880465    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"]
Jul 22 05:12:49.935919 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.935875    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pjvg\" (UniqueName: \"kubernetes.io/projected/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-kube-api-access-9pjvg\") pod \"maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:49.936096 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.935926    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:49.936145 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.936117    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-maas-api-tls\") pod \"maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:49.969636 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:49.969604    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:50.037358 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:50.037261    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-maas-api-tls\") pod \"maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:50.037358 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:50.037300    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pjvg\" (UniqueName: \"kubernetes.io/projected/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-kube-api-access-9pjvg\") pod \"maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:50.037358 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:50.037324    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:50.037647 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:12:50.037433    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-serving-cert: secret "maas-api-e2e-shared-a-c0234d-serving-cert" not found
Jul 22 05:12:50.037647 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:12:50.037525    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-maas-api-tls podName:67d2785f-ddcc-4fc3-83f4-37be69e9d6dc nodeName:}" failed. No retries permitted until 2026-07-22 05:12:50.537505516 +0000 UTC m=+2380.595343068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-maas-api-tls") pod "maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw" (UID: "67d2785f-ddcc-4fc3-83f4-37be69e9d6dc") : secret "maas-api-e2e-shared-a-c0234d-serving-cert" not found
Jul 22 05:12:50.038143 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:50.038123    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-openshift-service-ca\") pod \"maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:50.047082 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:50.047056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pjvg\" (UniqueName: \"kubernetes.io/projected/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-kube-api-access-9pjvg\") pod \"maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:50.383951 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:50.383844    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:50.480541 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:50.480485    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:50.540849 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:50.540818    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-maas-api-tls\") pod \"maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:50.543296 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:50.543276    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-maas-api-tls\") pod \"maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:50.581064 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:50.581029    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:50.783054 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:50.783016    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:50.920829 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:50.920775    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"]
Jul 22 05:12:50.923735 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:12:50.923703    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67d2785f_ddcc_4fc3_83f4_37be69e9d6dc.slice/crio-76cb3fe4b197e01add2c07c9ec03d601473a1850bb8bd9ada2af523c1e5fe258 WatchSource:0}: Error finding container 76cb3fe4b197e01add2c07c9ec03d601473a1850bb8bd9ada2af523c1e5fe258: Status 404 returned error can't find the container with id 76cb3fe4b197e01add2c07c9ec03d601473a1850bb8bd9ada2af523c1e5fe258
Jul 22 05:12:51.549473 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:51.549437    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw" event={"ID":"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc","Type":"ContainerStarted","Data":"9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f"}
Jul 22 05:12:51.549677 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:51.549490    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw" event={"ID":"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc","Type":"ContainerStarted","Data":"76cb3fe4b197e01add2c07c9ec03d601473a1850bb8bd9ada2af523c1e5fe258"}
Jul 22 05:12:51.549677 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:51.549528    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:51.566526 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:51.566463    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw" podStartSLOduration=2.129142842 podStartE2EDuration="2.566448589s" totalImagesPullingTime="437.305747ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:12:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:12:51.565510063 +0000 UTC m=+2381.623347625" watchObservedRunningTime="2026-07-22 05:12:51.566448589 +0000 UTC m=+2381.624286150"
Jul 22 05:12:54.283570 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:54.283522    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:54.646240 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:54.646144    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:54.960284 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:54.960179    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:55.384147 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:55.384108    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:57.559202 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:57.559174    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:12:57.569073 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:57.569044    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:57.670568 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:57.670531    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:57.796760 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:57.796725    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:57.931667 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:57.931577    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:58.008761 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.008728    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"]
Jul 22 05:12:58.012680 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.012661    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:58.015445 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.015418    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-1a3bbb-serving-cert\""
Jul 22 05:12:58.024412 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.024391    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"]
Jul 22 05:12:58.047349 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.047315    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:58.106136 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.106099    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvlx6\" (UniqueName: \"kubernetes.io/projected/518ca5f7-70ec-4709-abc1-f776d6c29c99-kube-api-access-lvlx6\") pod \"maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:58.106305 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.106166    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/518ca5f7-70ec-4709-abc1-f776d6c29c99-maas-api-tls\") pod \"maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:58.106305 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.106202    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/518ca5f7-70ec-4709-abc1-f776d6c29c99-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:58.206678 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.206585    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/518ca5f7-70ec-4709-abc1-f776d6c29c99-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:58.206849 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.206697    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvlx6\" (UniqueName: \"kubernetes.io/projected/518ca5f7-70ec-4709-abc1-f776d6c29c99-kube-api-access-lvlx6\") pod \"maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:58.206849 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.206744    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/518ca5f7-70ec-4709-abc1-f776d6c29c99-maas-api-tls\") pod \"maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:58.206982 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:12:58.206865    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-serving-cert: secret "maas-api-e2e-shared-b-1a3bbb-serving-cert" not found
Jul 22 05:12:58.206982 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:12:58.206936    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/518ca5f7-70ec-4709-abc1-f776d6c29c99-maas-api-tls podName:518ca5f7-70ec-4709-abc1-f776d6c29c99 nodeName:}" failed. No retries permitted until 2026-07-22 05:12:58.706914902 +0000 UTC m=+2388.764752457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/518ca5f7-70ec-4709-abc1-f776d6c29c99-maas-api-tls") pod "maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q" (UID: "518ca5f7-70ec-4709-abc1-f776d6c29c99") : secret "maas-api-e2e-shared-b-1a3bbb-serving-cert" not found
Jul 22 05:12:58.207278 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.207260    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/518ca5f7-70ec-4709-abc1-f776d6c29c99-openshift-service-ca\") pod \"maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:58.218027 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.218000    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvlx6\" (UniqueName: \"kubernetes.io/projected/518ca5f7-70ec-4709-abc1-f776d6c29c99-kube-api-access-lvlx6\") pod \"maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:58.500067 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.500017    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:58.614731 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.614698    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:58.711484 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.711446    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/518ca5f7-70ec-4709-abc1-f776d6c29c99-maas-api-tls\") pod \"maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:58.713882 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.713855    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/518ca5f7-70ec-4709-abc1-f776d6c29c99-maas-api-tls\") pod \"maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:58.716816 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.716793    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:12:58.923255 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:58.923161    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:59.054084 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:59.054052    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"]
Jul 22 05:12:59.056908 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:12:59.056881    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod518ca5f7_70ec_4709_abc1_f776d6c29c99.slice/crio-667bf915f68f0e2ada0cca287c226ff73dea7eeccd30cd30f2be18732960f8ff WatchSource:0}: Error finding container 667bf915f68f0e2ada0cca287c226ff73dea7eeccd30cd30f2be18732960f8ff: Status 404 returned error can't find the container with id 667bf915f68f0e2ada0cca287c226ff73dea7eeccd30cd30f2be18732960f8ff
Jul 22 05:12:59.585677 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:59.585643    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q" event={"ID":"518ca5f7-70ec-4709-abc1-f776d6c29c99","Type":"ContainerStarted","Data":"18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af"}
Jul 22 05:12:59.585866 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:59.585696    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q" event={"ID":"518ca5f7-70ec-4709-abc1-f776d6c29c99","Type":"ContainerStarted","Data":"667bf915f68f0e2ada0cca287c226ff73dea7eeccd30cd30f2be18732960f8ff"}
Jul 22 05:12:59.585866 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:59.585791    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:12:59.604316 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:12:59.604267    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q" podStartSLOduration=2.278421842 podStartE2EDuration="2.604252414s" totalImagesPullingTime="325.830572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:12:59.602712752 +0000 UTC m=+2389.660550339" watchObservedRunningTime="2026-07-22 05:12:59.604252414 +0000 UTC m=+2389.662089977"
Jul 22 05:13:02.292833 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:13:02.292797    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:05.596318 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:13:05.596284    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:13:10.148135 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:13:10.148091    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:10.248692 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:13:10.248654    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:11.231788 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:13:11.231732    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:11.327483 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:13:11.327446    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:17.503413 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:13:17.503375    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:19.584915 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:13:19.584878    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:19.685333 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:13:19.685300    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:39.619562 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:13:39.619482    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:13:44.284100 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:13:44.284066    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:33.984429 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:14:33.984393    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:14:34.043977 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:14:34.043928    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:15:00.148368 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:00.148335    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744955-62wkw"]
Jul 22 05:15:00.151821 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:00.151805    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744955-62wkw"
Jul 22 05:15:00.154477 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:00.154452    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-4n2k7\""
Jul 22 05:15:00.160140 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:00.160113    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744955-62wkw"]
Jul 22 05:15:00.164081 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:00.164061    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744955-62wkw"
Jul 22 05:15:00.293700 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:00.293676    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744955-62wkw"]
Jul 22 05:15:00.295748 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:15:00.295720    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7447d2_f663_45df_a208_e516fda317a3.slice/crio-8338961f48ca5bd2e256ef0cc97798b7b3bb691c5dfcf8e02dfaacc04eabce15 WatchSource:0}: Error finding container 8338961f48ca5bd2e256ef0cc97798b7b3bb691c5dfcf8e02dfaacc04eabce15: Status 404 returned error can't find the container with id 8338961f48ca5bd2e256ef0cc97798b7b3bb691c5dfcf8e02dfaacc04eabce15
Jul 22 05:15:01.112680 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:01.112642    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744955-62wkw" event={"ID":"0a7447d2-f663-45df-a208-e516fda317a3","Type":"ContainerStarted","Data":"8338961f48ca5bd2e256ef0cc97798b7b3bb691c5dfcf8e02dfaacc04eabce15"}
Jul 22 05:15:04.129681 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:04.129637    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744955-62wkw" event={"ID":"0a7447d2-f663-45df-a208-e516fda317a3","Type":"ContainerStarted","Data":"3a9198fb2068d73489bd95acd06efa946e98574f39c1985ec77cfa3401f35805"}
Jul 22 05:15:04.144719 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:04.144668    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744955-62wkw" podStartSLOduration=1.1944815850000001 podStartE2EDuration="4.144621263s" totalImagesPullingTime="2.950139678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:15:04.143489099 +0000 UTC m=+2514.201326661" watchObservedRunningTime="2026-07-22 05:15:04.144621263 +0000 UTC m=+2514.202458826"
Jul 22 05:15:05.135432 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:05.135397    2584 generic.go:356] "Generic (PLEG): container finished" podID="0a7447d2-f663-45df-a208-e516fda317a3" containerID="3a9198fb2068d73489bd95acd06efa946e98574f39c1985ec77cfa3401f35805" exitCode=0
Jul 22 05:15:05.135822 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:05.135447    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744955-62wkw" event={"ID":"0a7447d2-f663-45df-a208-e516fda317a3","Type":"ContainerDied","Data":"3a9198fb2068d73489bd95acd06efa946e98574f39c1985ec77cfa3401f35805"}
Jul 22 05:15:06.269365 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:06.269339    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744955-62wkw"
Jul 22 05:15:07.146028 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:07.145999    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744955-62wkw"
Jul 22 05:15:07.146200 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:07.146034    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744955-62wkw" event={"ID":"0a7447d2-f663-45df-a208-e516fda317a3","Type":"ContainerDied","Data":"8338961f48ca5bd2e256ef0cc97798b7b3bb691c5dfcf8e02dfaacc04eabce15"}
Jul 22 05:15:07.146200 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:07.146077    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8338961f48ca5bd2e256ef0cc97798b7b3bb691c5dfcf8e02dfaacc04eabce15"
Jul 22 05:15:58.156719 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:58.156681    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:15:59.095123 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:15:59.095087    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:16:09.572336 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.572298    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"]
Jul 22 05:16:09.572770 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.572619    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a7447d2-f663-45df-a208-e516fda317a3" containerName="cleanup"
Jul 22 05:16:09.572770 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.572629    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a7447d2-f663-45df-a208-e516fda317a3" containerName="cleanup"
Jul 22 05:16:09.572770 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.572689    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a7447d2-f663-45df-a208-e516fda317a3" containerName="cleanup"
Jul 22 05:16:09.575677 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.575662    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.578130 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.578107    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c0234d\"/\"kube-root-ca.crt\""
Jul 22 05:16:09.578269 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.578175    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-c0234d\"/\"openshift-service-ca.crt\""
Jul 22 05:16:09.579162 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.579145    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c0234d\"/\"default-dockercfg-tg6lh\""
Jul 22 05:16:09.579283 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.579262    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-c0234d\"/\"sub-test-model-c0234d-kserve-self-signed-certs\""
Jul 22 05:16:09.583823 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.583803    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"]
Jul 22 05:16:09.663583 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.663551    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:16:09.680410 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.680377    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-home\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.680526 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.680426    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-tmp-dir\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.680526 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.680461    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-model-cache\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.680526 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.680514    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdlzq\" (UniqueName: \"kubernetes.io/projected/daafecd3-404e-43aa-bd00-6942549ec38c-kube-api-access-rdlzq\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.680630 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.680557    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-dshm\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.680630 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.680584    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daafecd3-404e-43aa-bd00-6942549ec38c-tls-certs\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.781257 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.781220    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-home\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.781438 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.781264    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-tmp-dir\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.781438 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.781298    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-model-cache\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.781438 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.781331    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdlzq\" (UniqueName: \"kubernetes.io/projected/daafecd3-404e-43aa-bd00-6942549ec38c-kube-api-access-rdlzq\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.781438 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.781358    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-dshm\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.781438 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.781380    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daafecd3-404e-43aa-bd00-6942549ec38c-tls-certs\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.781770 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.781705    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-home\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.781770 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.781722    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-model-cache\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.781902 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.781856    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-tmp-dir\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.783737 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.783714    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-dshm\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.784063 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.784044    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daafecd3-404e-43aa-bd00-6942549ec38c-tls-certs\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.788902 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.788884    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdlzq\" (UniqueName: \"kubernetes.io/projected/daafecd3-404e-43aa-bd00-6942549ec38c-kube-api-access-rdlzq\") pod \"sub-test-model-c0234d-kserve-79c99c844c-n2mwx\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") " pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:09.886478 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:09.886377    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:10.015337 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:10.015276    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"]
Jul 22 05:16:10.017696 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:16:10.017670    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddaafecd3_404e_43aa_bd00_6942549ec38c.slice/crio-908727dfde0d6edc5a2418555f55a36bcdd16957f165750595f8ed5349856c09 WatchSource:0}: Error finding container 908727dfde0d6edc5a2418555f55a36bcdd16957f165750595f8ed5349856c09: Status 404 returned error can't find the container with id 908727dfde0d6edc5a2418555f55a36bcdd16957f165750595f8ed5349856c09
Jul 22 05:16:10.419228 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:10.419190    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx" event={"ID":"daafecd3-404e-43aa-bd00-6942549ec38c","Type":"ContainerStarted","Data":"b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c"}
Jul 22 05:16:10.419395 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:10.419241    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx" event={"ID":"daafecd3-404e-43aa-bd00-6942549ec38c","Type":"ContainerStarted","Data":"908727dfde0d6edc5a2418555f55a36bcdd16957f165750595f8ed5349856c09"}
Jul 22 05:16:10.435111 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:10.435067    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx" podStartSLOduration=1.435051219 podStartE2EDuration="1.435051219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:16:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:16:10.434369026 +0000 UTC m=+2580.492206789" watchObservedRunningTime="2026-07-22 05:16:10.435051219 +0000 UTC m=+2580.492888780"
Jul 22 05:16:19.887419 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:19.887377    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:19.887419 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:19.887419    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:19.899830 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:19.899806    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:20.478116 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:20.478089    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:16:48.171308 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:16:48.171266    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:17:25.349625 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:25.349592    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"]
Jul 22 05:17:25.385157 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:25.385122    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:17:26.382664 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:26.382623    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:17:36.150640 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:36.150602    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:17:40.369836 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.369769    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx" podUID="daafecd3-404e-43aa-bd00-6942549ec38c" containerName="main" containerID="cri-o://b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c" gracePeriod=45
Jul 22 05:17:40.465778 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.465724    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx" podUID="daafecd3-404e-43aa-bd00-6942549ec38c" containerName="main" probeResult="failure" output="Get \"https://10.134.0.41:8000/ready\": dial tcp 10.134.0.41:8000: connect: connection refused"
Jul 22 05:17:40.613892 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.613862    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:17:40.684634 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.684540    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdlzq\" (UniqueName: \"kubernetes.io/projected/daafecd3-404e-43aa-bd00-6942549ec38c-kube-api-access-rdlzq\") pod \"daafecd3-404e-43aa-bd00-6942549ec38c\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") "
Jul 22 05:17:40.684634 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.684605    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-tmp-dir\") pod \"daafecd3-404e-43aa-bd00-6942549ec38c\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") "
Jul 22 05:17:40.684634 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.684626    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-dshm\") pod \"daafecd3-404e-43aa-bd00-6942549ec38c\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") "
Jul 22 05:17:40.684889 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.684729    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daafecd3-404e-43aa-bd00-6942549ec38c-tls-certs\") pod \"daafecd3-404e-43aa-bd00-6942549ec38c\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") "
Jul 22 05:17:40.684889 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.684778    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-home\") pod \"daafecd3-404e-43aa-bd00-6942549ec38c\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") "
Jul 22 05:17:40.684889 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.684798    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-model-cache\") pod \"daafecd3-404e-43aa-bd00-6942549ec38c\" (UID: \"daafecd3-404e-43aa-bd00-6942549ec38c\") "
Jul 22 05:17:40.684889 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.684840    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "daafecd3-404e-43aa-bd00-6942549ec38c" (UID: "daafecd3-404e-43aa-bd00-6942549ec38c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:17:40.685133 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.685060    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-home" (OuterVolumeSpecName: "home") pod "daafecd3-404e-43aa-bd00-6942549ec38c" (UID: "daafecd3-404e-43aa-bd00-6942549ec38c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:17:40.685133 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.685069    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-model-cache" (OuterVolumeSpecName: "model-cache") pod "daafecd3-404e-43aa-bd00-6942549ec38c" (UID: "daafecd3-404e-43aa-bd00-6942549ec38c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:17:40.685219 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.685134    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-tmp-dir\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:17:40.685219 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.685154    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-home\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:17:40.685219 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.685167    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-model-cache\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:17:40.686964 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.686913    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daafecd3-404e-43aa-bd00-6942549ec38c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "daafecd3-404e-43aa-bd00-6942549ec38c" (UID: "daafecd3-404e-43aa-bd00-6942549ec38c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:17:40.687067 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.686985    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-dshm" (OuterVolumeSpecName: "dshm") pod "daafecd3-404e-43aa-bd00-6942549ec38c" (UID: "daafecd3-404e-43aa-bd00-6942549ec38c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:17:40.687067 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.687006    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daafecd3-404e-43aa-bd00-6942549ec38c-kube-api-access-rdlzq" (OuterVolumeSpecName: "kube-api-access-rdlzq") pod "daafecd3-404e-43aa-bd00-6942549ec38c" (UID: "daafecd3-404e-43aa-bd00-6942549ec38c"). InnerVolumeSpecName "kube-api-access-rdlzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:17:40.786187 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.786152    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/daafecd3-404e-43aa-bd00-6942549ec38c-tls-certs\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:17:40.786187 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.786178    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdlzq\" (UniqueName: \"kubernetes.io/projected/daafecd3-404e-43aa-bd00-6942549ec38c-kube-api-access-rdlzq\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:17:40.786187 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.786189    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/daafecd3-404e-43aa-bd00-6942549ec38c-dshm\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:17:40.806178 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.806140    2584 generic.go:356] "Generic (PLEG): container finished" podID="daafecd3-404e-43aa-bd00-6942549ec38c" containerID="b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c" exitCode=0
Jul 22 05:17:40.806330 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.806185    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"
Jul 22 05:17:40.806330 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.806210    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx" event={"ID":"daafecd3-404e-43aa-bd00-6942549ec38c","Type":"ContainerDied","Data":"b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c"}
Jul 22 05:17:40.806330 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.806245    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx" event={"ID":"daafecd3-404e-43aa-bd00-6942549ec38c","Type":"ContainerDied","Data":"908727dfde0d6edc5a2418555f55a36bcdd16957f165750595f8ed5349856c09"}
Jul 22 05:17:40.806330 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.806267    2584 scope.go:117] "RemoveContainer" containerID="b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c"
Jul 22 05:17:40.814664 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.814645    2584 scope.go:117] "RemoveContainer" containerID="b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c"
Jul 22 05:17:40.814927 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:17:40.814909    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c\": container with ID starting with b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c not found: ID does not exist" containerID="b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c"
Jul 22 05:17:40.815009 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.814937    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c"} err="failed to get container status \"b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c\": rpc error: code = NotFound desc = could not find container \"b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c\": container with ID starting with b42953c2a943a8211b915107dca6462865179047e4d87da4da99e48caa650f2c not found: ID does not exist"
Jul 22 05:17:40.826490 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.826465    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"]
Jul 22 05:17:40.831821 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:40.831799    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-c0234d/sub-test-model-c0234d-kserve-79c99c844c-n2mwx"]
Jul 22 05:17:42.475707 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:17:42.475678    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daafecd3-404e-43aa-bd00-6942549ec38c" path="/var/lib/kubelet/pods/daafecd3-404e-43aa-bd00-6942549ec38c/volumes"
Jul 22 05:18:10.980706 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:10.980673    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:18:11.076978 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.076927    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:18:11.663621 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.663447    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"]
Jul 22 05:18:11.664067 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.664047    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daafecd3-404e-43aa-bd00-6942549ec38c" containerName="main"
Jul 22 05:18:11.664121 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.664071    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="daafecd3-404e-43aa-bd00-6942549ec38c" containerName="main"
Jul 22 05:18:11.664164 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.664152    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="daafecd3-404e-43aa-bd00-6942549ec38c" containerName="main"
Jul 22 05:18:11.668903 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.668882    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.672389 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.672365    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1a3bbb\"/\"rate-test-model-1a3bbb-kserve-self-signed-certs\""
Jul 22 05:18:11.672523 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.672414    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-1a3bbb\"/\"default-dockercfg-dmxqm\""
Jul 22 05:18:11.672523 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.672448    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1a3bbb\"/\"kube-root-ca.crt\""
Jul 22 05:18:11.672682 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.672610    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-1a3bbb\"/\"openshift-service-ca.crt\""
Jul 22 05:18:11.675702 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.675672    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"]
Jul 22 05:18:11.707327 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.707287    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:18:11.757834 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.757799    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-home\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.758024 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.757846    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvwxt\" (UniqueName: \"kubernetes.io/projected/92339ca4-ef38-4724-bec3-e2cd76a0da1b-kube-api-access-fvwxt\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.758024 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.757882    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-model-cache\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.758024 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.757906    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-tmp-dir\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.758024 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.757924    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92339ca4-ef38-4724-bec3-e2cd76a0da1b-tls-certs\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.758171 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.758050    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-dshm\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.858808 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.858770    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-model-cache\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.858808 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.858811    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-tmp-dir\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.859080 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.858831    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92339ca4-ef38-4724-bec3-e2cd76a0da1b-tls-certs\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.859080 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.858902    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-dshm\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.859080 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.858978    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-home\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.859080 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.859018    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvwxt\" (UniqueName: \"kubernetes.io/projected/92339ca4-ef38-4724-bec3-e2cd76a0da1b-kube-api-access-fvwxt\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.859313 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.859252    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-model-cache\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.859377 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.859320    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-tmp-dir\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.859452 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.859428    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-home\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.861272 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.861247    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-dshm\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.861523 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.861506    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92339ca4-ef38-4724-bec3-e2cd76a0da1b-tls-certs\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.867508 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.867486    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvwxt\" (UniqueName: \"kubernetes.io/projected/92339ca4-ef38-4724-bec3-e2cd76a0da1b-kube-api-access-fvwxt\") pod \"rate-test-model-1a3bbb-kserve-5df777678c-q26hx\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") " pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:11.979860 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:11.979823    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:12.108996 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:12.108971    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"]
Jul 22 05:18:12.110924 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:18:12.110893    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92339ca4_ef38_4724_bec3_e2cd76a0da1b.slice/crio-983c215b2ce77b368b7e51f3031e321519e911ff4ca36b9b5aedef3dce4725a9 WatchSource:0}: Error finding container 983c215b2ce77b368b7e51f3031e321519e911ff4ca36b9b5aedef3dce4725a9: Status 404 returned error can't find the container with id 983c215b2ce77b368b7e51f3031e321519e911ff4ca36b9b5aedef3dce4725a9
Jul 22 05:18:12.130168 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:12.130128    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:18:12.231255 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:12.231168    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:18:12.947933 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:12.947897    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx" event={"ID":"92339ca4-ef38-4724-bec3-e2cd76a0da1b","Type":"ContainerStarted","Data":"bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4"}
Jul 22 05:18:12.948113 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:12.947937    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx" event={"ID":"92339ca4-ef38-4724-bec3-e2cd76a0da1b","Type":"ContainerStarted","Data":"983c215b2ce77b368b7e51f3031e321519e911ff4ca36b9b5aedef3dce4725a9"}
Jul 22 05:18:12.963135 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:12.963088    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx" podStartSLOduration=1.9630708239999999 podStartE2EDuration="1.963070824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 05:18:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:18:12.962916294 +0000 UTC m=+2703.020753868" watchObservedRunningTime="2026-07-22 05:18:12.963070824 +0000 UTC m=+2703.020908385"
Jul 22 05:18:19.037896 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:19.037857    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:18:19.138614 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:19.138584    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:18:20.332815 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:20.332780    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:18:20.437994 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:20.437956    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:18:21.980808 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:21.980769    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:21.981235 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:21.980843    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:21.994063 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:21.994037    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:23.002723 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:23.002693    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:18:40.386731 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:40.386694    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:18:40.448295 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:40.448267    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:18:53.166397 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:53.166361    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:18:54.169571 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:54.169531    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"]
Jul 22 05:18:54.189538 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:18:54.189508    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:09.189546 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.189482    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx" podUID="92339ca4-ef38-4724-bec3-e2cd76a0da1b" containerName="main" containerID="cri-o://bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4" gracePeriod=45
Jul 22 05:19:09.438139 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.438111    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:19:09.560584 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.560549    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-model-cache\") pod \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") "
Jul 22 05:19:09.560584 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.560584    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-tmp-dir\") pod \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") "
Jul 22 05:19:09.560832 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.560621    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-home\") pod \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") "
Jul 22 05:19:09.560832 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.560639    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvwxt\" (UniqueName: \"kubernetes.io/projected/92339ca4-ef38-4724-bec3-e2cd76a0da1b-kube-api-access-fvwxt\") pod \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") "
Jul 22 05:19:09.560832 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.560661    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92339ca4-ef38-4724-bec3-e2cd76a0da1b-tls-certs\") pod \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") "
Jul 22 05:19:09.560832 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.560714    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-dshm\") pod \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\" (UID: \"92339ca4-ef38-4724-bec3-e2cd76a0da1b\") "
Jul 22 05:19:09.561055 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.560877    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "92339ca4-ef38-4724-bec3-e2cd76a0da1b" (UID: "92339ca4-ef38-4724-bec3-e2cd76a0da1b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:19:09.561055 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.560891    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-model-cache" (OuterVolumeSpecName: "model-cache") pod "92339ca4-ef38-4724-bec3-e2cd76a0da1b" (UID: "92339ca4-ef38-4724-bec3-e2cd76a0da1b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:19:09.561055 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.560910    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-home" (OuterVolumeSpecName: "home") pod "92339ca4-ef38-4724-bec3-e2cd76a0da1b" (UID: "92339ca4-ef38-4724-bec3-e2cd76a0da1b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:19:09.561221 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.561067    2584 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-model-cache\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:19:09.561221 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.561087    2584 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-tmp-dir\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:19:09.561221 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.561097    2584 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-home\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:19:09.562992 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.562962    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-dshm" (OuterVolumeSpecName: "dshm") pod "92339ca4-ef38-4724-bec3-e2cd76a0da1b" (UID: "92339ca4-ef38-4724-bec3-e2cd76a0da1b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 22 05:19:09.563079 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.563006    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92339ca4-ef38-4724-bec3-e2cd76a0da1b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "92339ca4-ef38-4724-bec3-e2cd76a0da1b" (UID: "92339ca4-ef38-4724-bec3-e2cd76a0da1b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:19:09.563079 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.563040    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92339ca4-ef38-4724-bec3-e2cd76a0da1b-kube-api-access-fvwxt" (OuterVolumeSpecName: "kube-api-access-fvwxt") pod "92339ca4-ef38-4724-bec3-e2cd76a0da1b" (UID: "92339ca4-ef38-4724-bec3-e2cd76a0da1b"). InnerVolumeSpecName "kube-api-access-fvwxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:19:09.661564 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.661529    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvwxt\" (UniqueName: \"kubernetes.io/projected/92339ca4-ef38-4724-bec3-e2cd76a0da1b-kube-api-access-fvwxt\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:19:09.661564 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.661559    2584 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/92339ca4-ef38-4724-bec3-e2cd76a0da1b-tls-certs\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:19:09.661564 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:09.661569    2584 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/92339ca4-ef38-4724-bec3-e2cd76a0da1b-dshm\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:19:10.198833 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:10.198800    2584 generic.go:356] "Generic (PLEG): container finished" podID="92339ca4-ef38-4724-bec3-e2cd76a0da1b" containerID="bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4" exitCode=0
Jul 22 05:19:10.199271 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:10.198841    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"
Jul 22 05:19:10.199271 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:10.198882    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx" event={"ID":"92339ca4-ef38-4724-bec3-e2cd76a0da1b","Type":"ContainerDied","Data":"bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4"}
Jul 22 05:19:10.199271 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:10.198925    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx" event={"ID":"92339ca4-ef38-4724-bec3-e2cd76a0da1b","Type":"ContainerDied","Data":"983c215b2ce77b368b7e51f3031e321519e911ff4ca36b9b5aedef3dce4725a9"}
Jul 22 05:19:10.199271 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:10.198956    2584 scope.go:117] "RemoveContainer" containerID="bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4"
Jul 22 05:19:10.208155 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:10.208139    2584 scope.go:117] "RemoveContainer" containerID="bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4"
Jul 22 05:19:10.208416 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:19:10.208394    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4\": container with ID starting with bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4 not found: ID does not exist" containerID="bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4"
Jul 22 05:19:10.208467 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:10.208424    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4"} err="failed to get container status \"bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4\": rpc error: code = NotFound desc = could not find container \"bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4\": container with ID starting with bed2ed144eff8c88d640d6fa70ae4c109947634f3f12cfeb9f26ccd5c65d28c4 not found: ID does not exist"
Jul 22 05:19:10.221644 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:10.221622    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"]
Jul 22 05:19:10.227022 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:10.227002    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-1a3bbb/rate-test-model-1a3bbb-kserve-5df777678c-q26hx"]
Jul 22 05:19:10.477460 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:10.477429    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92339ca4-ef38-4724-bec3-e2cd76a0da1b" path="/var/lib/kubelet/pods/92339ca4-ef38-4724-bec3-e2cd76a0da1b/volumes"
Jul 22 05:19:12.493343 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:12.493312    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:12.595676 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:12.595638    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:22.368305 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.368270    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"]
Jul 22 05:19:22.368682 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.368501    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw" podUID="67d2785f-ddcc-4fc3-83f4-37be69e9d6dc" containerName="maas-api" containerID="cri-o://9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f" gracePeriod=30
Jul 22 05:19:22.394888 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.394858    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:22.605877 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.605855    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:19:22.680841 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.680757    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pjvg\" (UniqueName: \"kubernetes.io/projected/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-kube-api-access-9pjvg\") pod \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") "
Jul 22 05:19:22.680841 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.680793    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-openshift-service-ca\") pod \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") "
Jul 22 05:19:22.680841 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.680812    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-maas-api-tls\") pod \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\" (UID: \"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc\") "
Jul 22 05:19:22.681165 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.681140    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "67d2785f-ddcc-4fc3-83f4-37be69e9d6dc" (UID: "67d2785f-ddcc-4fc3-83f4-37be69e9d6dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:19:22.682902 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.682875    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "67d2785f-ddcc-4fc3-83f4-37be69e9d6dc" (UID: "67d2785f-ddcc-4fc3-83f4-37be69e9d6dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:19:22.683005 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.682952    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-kube-api-access-9pjvg" (OuterVolumeSpecName: "kube-api-access-9pjvg") pod "67d2785f-ddcc-4fc3-83f4-37be69e9d6dc" (UID: "67d2785f-ddcc-4fc3-83f4-37be69e9d6dc"). InnerVolumeSpecName "kube-api-access-9pjvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:19:22.782096 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.782062    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pjvg\" (UniqueName: \"kubernetes.io/projected/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-kube-api-access-9pjvg\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:19:22.782096 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.782095    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:19:22.782293 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:22.782108    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:19:23.257787 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:23.257757    2584 generic.go:356] "Generic (PLEG): container finished" podID="67d2785f-ddcc-4fc3-83f4-37be69e9d6dc" containerID="9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f" exitCode=0
Jul 22 05:19:23.258013 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:23.257810    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw" event={"ID":"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc","Type":"ContainerDied","Data":"9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f"}
Jul 22 05:19:23.258013 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:23.257817    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"
Jul 22 05:19:23.258013 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:23.257875    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw" event={"ID":"67d2785f-ddcc-4fc3-83f4-37be69e9d6dc","Type":"ContainerDied","Data":"76cb3fe4b197e01add2c07c9ec03d601473a1850bb8bd9ada2af523c1e5fe258"}
Jul 22 05:19:23.258013 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:23.257897    2584 scope.go:117] "RemoveContainer" containerID="9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f"
Jul 22 05:19:23.266284 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:23.266262    2584 scope.go:117] "RemoveContainer" containerID="9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f"
Jul 22 05:19:23.266553 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:19:23.266535    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f\": container with ID starting with 9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f not found: ID does not exist" containerID="9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f"
Jul 22 05:19:23.266606 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:23.266562    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f"} err="failed to get container status \"9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f\": rpc error: code = NotFound desc = could not find container \"9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f\": container with ID starting with 9bb1a59c90ef48046e0cdce53913db9a31cf1e28ff8359364106983d964a364f not found: ID does not exist"
Jul 22 05:19:23.280899 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:23.280873    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"]
Jul 22 05:19:23.283388 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:23.283365    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw"]
Jul 22 05:19:24.476034 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:24.476001    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67d2785f-ddcc-4fc3-83f4-37be69e9d6dc" path="/var/lib/kubelet/pods/67d2785f-ddcc-4fc3-83f4-37be69e9d6dc/volumes"
Jul 22 05:19:25.554247 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:25.554202    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-c0234d-6d948c856f-f7vsw" podUID="67d2785f-ddcc-4fc3-83f4-37be69e9d6dc" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.38:8443/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Jul 22 05:19:27.010221 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:27.010174    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:27.440794 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:27.440687    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:28.498164 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:28.498086    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:33.282585 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:33.282508    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:33.383639 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:33.383578    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:33.565347 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:33.565252    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:33.796329 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:33.796291    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:34.554079 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:34.554045    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:34.666431 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:34.666402    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:44.336359 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.336323    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"]
Jul 22 05:19:44.336857 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.336537    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q" podUID="518ca5f7-70ec-4709-abc1-f776d6c29c99" containerName="maas-api" containerID="cri-o://18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af" gracePeriod=30
Jul 22 05:19:44.372786 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.372755    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:44.777295 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.777271    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:19:44.873973 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.873866    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/518ca5f7-70ec-4709-abc1-f776d6c29c99-maas-api-tls\") pod \"518ca5f7-70ec-4709-abc1-f776d6c29c99\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") "
Jul 22 05:19:44.874121 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.873975    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvlx6\" (UniqueName: \"kubernetes.io/projected/518ca5f7-70ec-4709-abc1-f776d6c29c99-kube-api-access-lvlx6\") pod \"518ca5f7-70ec-4709-abc1-f776d6c29c99\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") "
Jul 22 05:19:44.874121 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.874019    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/518ca5f7-70ec-4709-abc1-f776d6c29c99-openshift-service-ca\") pod \"518ca5f7-70ec-4709-abc1-f776d6c29c99\" (UID: \"518ca5f7-70ec-4709-abc1-f776d6c29c99\") "
Jul 22 05:19:44.874432 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.874398    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/518ca5f7-70ec-4709-abc1-f776d6c29c99-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "518ca5f7-70ec-4709-abc1-f776d6c29c99" (UID: "518ca5f7-70ec-4709-abc1-f776d6c29c99"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 22 05:19:44.876108 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.876088    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/518ca5f7-70ec-4709-abc1-f776d6c29c99-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "518ca5f7-70ec-4709-abc1-f776d6c29c99" (UID: "518ca5f7-70ec-4709-abc1-f776d6c29c99"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 22 05:19:44.876188 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.876107    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/518ca5f7-70ec-4709-abc1-f776d6c29c99-kube-api-access-lvlx6" (OuterVolumeSpecName: "kube-api-access-lvlx6") pod "518ca5f7-70ec-4709-abc1-f776d6c29c99" (UID: "518ca5f7-70ec-4709-abc1-f776d6c29c99"). InnerVolumeSpecName "kube-api-access-lvlx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 22 05:19:44.975352 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.975317    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/518ca5f7-70ec-4709-abc1-f776d6c29c99-maas-api-tls\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:19:44.975352 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.975349    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvlx6\" (UniqueName: \"kubernetes.io/projected/518ca5f7-70ec-4709-abc1-f776d6c29c99-kube-api-access-lvlx6\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:19:44.975352 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:44.975360    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/518ca5f7-70ec-4709-abc1-f776d6c29c99-openshift-service-ca\") on node \"ip-10-0-137-249.ec2.internal\" DevicePath \"\""
Jul 22 05:19:45.358059 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:45.358015    2584 generic.go:356] "Generic (PLEG): container finished" podID="518ca5f7-70ec-4709-abc1-f776d6c29c99" containerID="18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af" exitCode=0
Jul 22 05:19:45.358525 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:45.358065    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"
Jul 22 05:19:45.358525 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:45.358110    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q" event={"ID":"518ca5f7-70ec-4709-abc1-f776d6c29c99","Type":"ContainerDied","Data":"18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af"}
Jul 22 05:19:45.358525 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:45.358173    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q" event={"ID":"518ca5f7-70ec-4709-abc1-f776d6c29c99","Type":"ContainerDied","Data":"667bf915f68f0e2ada0cca287c226ff73dea7eeccd30cd30f2be18732960f8ff"}
Jul 22 05:19:45.358525 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:45.358207    2584 scope.go:117] "RemoveContainer" containerID="18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af"
Jul 22 05:19:45.366722 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:45.366705    2584 scope.go:117] "RemoveContainer" containerID="18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af"
Jul 22 05:19:45.366981 ip-10-0-137-249 kubenswrapper[2584]: E0722 05:19:45.366965    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af\": container with ID starting with 18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af not found: ID does not exist" containerID="18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af"
Jul 22 05:19:45.367034 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:45.366990    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af"} err="failed to get container status \"18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af\": rpc error: code = NotFound desc = could not find container \"18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af\": container with ID starting with 18e83c7595945f80738c2d69889fdbe6653a7f5f7b460d91c6643ff7d5de54af not found: ID does not exist"
Jul 22 05:19:45.378337 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:45.378314    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"]
Jul 22 05:19:45.382440 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:45.382417    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-1a3bbb-5b846587cc-l465q"]
Jul 22 05:19:46.477222 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:46.477190    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="518ca5f7-70ec-4709-abc1-f776d6c29c99" path="/var/lib/kubelet/pods/518ca5f7-70ec-4709-abc1-f776d6c29c99/volumes"
Jul 22 05:19:48.997667 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:48.997631    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:49.392494 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:49.392404    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:55.091749 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:55.091716    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:55.192710 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:55.192675    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:55.373010 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:55.372921    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:19:55.607164 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:19:55.607128    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:20:02.174812 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:02.174777    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5567574457-8xr7v_ea388928-b794-4566-be92-6f7c02c36dfd/copy-manifests/0.log"
Jul 22 05:20:02.187456 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:02.187430    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5567574457-8xr7v_ea388928-b794-4566-be92-6f7c02c36dfd/manager/0.log"
Jul 22 05:20:02.780129 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:02.780093    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-67476b6695-ghz87_d3c71d11-298b-4f8d-b71b-49eac4b8f1ec/maas-api/0.log"
Jul 22 05:20:03.119680 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:03.119606    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744955-62wkw_0a7447d2-f663-45df-a208-e516fda317a3/cleanup/0.log"
Jul 22 05:20:03.232739 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:03.232709    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-smxnn_5b53e45a-a900-4851-8908-df0c6db0be9b/postgres/0.log"
Jul 22 05:20:04.941650 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:04.941616    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ljjmp_77096d84-ac68-42b5-80fc-3a1c6fac78bd/kuadrant-console-plugin/0.log"
Jul 22 05:20:06.073868 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:06.073834    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d644bdf8d-bqlh8_2e2f25ac-546f-4db3-968b-cdb416ce98c0/kube-auth-proxy/0.log"
Jul 22 05:20:06.452770 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:06.452682    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-hjmn5_b38f5afd-474a-4fdc-9491-b3ad0fb2af89/payload-pre-processing/0.log"
Jul 22 05:20:07.039838 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:07.039809    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-kmp7z_d06798e9-0a96-493b-b911-742f88223746/main/0.log"
Jul 22 05:20:07.284451 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:07.284414    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-lg8tj_7d95903c-ea84-4b21-bfa4-ea2b7c6f9683/main/0.log"
Jul 22 05:20:07.646149 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:07.646120    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-nfdwg_9429194e-51b4-4a8c-b20d-82197fc8f833/main/0.log"
Jul 22 05:20:13.498342 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:13.498308    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:20:13.600785 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:13.600740    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:20:16.572167 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:16.572123    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sglqd_d5ab223e-0556-4987-88a3-828fe304d34d/global-pull-secret-syncer/0.log"
Jul 22 05:20:16.625920 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:16.625872    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log"
Jul 22 05:20:16.744004 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:16.743970    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-249.ec2.internal_f9eae42e7d66416d6ea3b4d6c66b2c30/haproxy/0.log"
Jul 22 05:20:22.469951 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:22.469905    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ljjmp_77096d84-ac68-42b5-80fc-3a1c6fac78bd/kuadrant-console-plugin/0.log"
Jul 22 05:20:24.818302 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:24.818263    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-55ff5b7b-5wrzj_d196a821-f064-419a-9521-8bab54ff3810/metrics-server/0.log"
Jul 22 05:20:25.041067 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:25.040991    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vfzcq_fd97a2d7-d049-481c-9cfc-8779c86815b9/node-exporter/0.log"
Jul 22 05:20:25.064569 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:25.064543    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vfzcq_fd97a2d7-d049-481c-9cfc-8779c86815b9/kube-rbac-proxy/0.log"
Jul 22 05:20:25.085114 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:25.085092    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vfzcq_fd97a2d7-d049-481c-9cfc-8779c86815b9/init-textfile/0.log"
Jul 22 05:20:25.222631 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:25.222603    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b2a682d-272f-4870-92f2-4079ef692531/prometheus/0.log"
Jul 22 05:20:25.247206 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:25.247183    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b2a682d-272f-4870-92f2-4079ef692531/config-reloader/0.log"
Jul 22 05:20:25.268494 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:25.268465    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b2a682d-272f-4870-92f2-4079ef692531/thanos-sidecar/0.log"
Jul 22 05:20:25.287799 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:25.287781    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b2a682d-272f-4870-92f2-4079ef692531/kube-rbac-proxy-web/0.log"
Jul 22 05:20:25.307052 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:25.306993    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b2a682d-272f-4870-92f2-4079ef692531/kube-rbac-proxy/0.log"
Jul 22 05:20:25.327391 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:25.327365    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b2a682d-272f-4870-92f2-4079ef692531/kube-rbac-proxy-thanos/0.log"
Jul 22 05:20:25.348803 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:25.348786    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_1b2a682d-272f-4870-92f2-4079ef692531/init-config-reloader/0.log"
Jul 22 05:20:25.521591 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:25.521559    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:20:25.621475 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:25.621398    2584 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2mglg_745f3211-0036-4c31-80ca-1513019ea800/konnectivity-agent/0.log" limit=1024
Jul 22 05:20:27.674051 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.674016    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"]
Jul 22 05:20:27.674540 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.674335    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="518ca5f7-70ec-4709-abc1-f776d6c29c99" containerName="maas-api"
Jul 22 05:20:27.674540 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.674348    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="518ca5f7-70ec-4709-abc1-f776d6c29c99" containerName="maas-api"
Jul 22 05:20:27.674540 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.674361    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67d2785f-ddcc-4fc3-83f4-37be69e9d6dc" containerName="maas-api"
Jul 22 05:20:27.674540 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.674369    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="67d2785f-ddcc-4fc3-83f4-37be69e9d6dc" containerName="maas-api"
Jul 22 05:20:27.674540 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.674384    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92339ca4-ef38-4724-bec3-e2cd76a0da1b" containerName="main"
Jul 22 05:20:27.674540 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.674391    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="92339ca4-ef38-4724-bec3-e2cd76a0da1b" containerName="main"
Jul 22 05:20:27.674540 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.674467    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="92339ca4-ef38-4724-bec3-e2cd76a0da1b" containerName="main"
Jul 22 05:20:27.674540 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.674485    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="67d2785f-ddcc-4fc3-83f4-37be69e9d6dc" containerName="maas-api"
Jul 22 05:20:27.674540 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.674495    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="518ca5f7-70ec-4709-abc1-f776d6c29c99" containerName="maas-api"
Jul 22 05:20:27.677686 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.677667    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.679924 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.679902    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-84vmg\"/\"openshift-service-ca.crt\""
Jul 22 05:20:27.680112 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.680003    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-84vmg\"/\"kube-root-ca.crt\""
Jul 22 05:20:27.681013 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.680996    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-84vmg\"/\"default-dockercfg-vt96m\""
Jul 22 05:20:27.686042 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.686016    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"]
Jul 22 05:20:27.736097 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.736062    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-podres\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.736282 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.736115    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-proc\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.736282 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.736212    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-sys\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.736398 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.736291    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-lib-modules\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.736439 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.736402    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8djm6\" (UniqueName: \"kubernetes.io/projected/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-kube-api-access-8djm6\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.836896 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.836856    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-sys\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.837084 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.836906    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-lib-modules\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.837084 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.836980    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djm6\" (UniqueName: \"kubernetes.io/projected/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-kube-api-access-8djm6\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.837084 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.837023    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-sys\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.837084 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.837033    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-podres\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.837226 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.837100    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-proc\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.837226 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.837117    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-podres\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.837226 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.837121    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-lib-modules\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.837226 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.837167    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-proc\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.845295 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.845276    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8djm6\" (UniqueName: \"kubernetes.io/projected/fcbb6aa8-392f-4d8f-95c5-703c4642dfc5-kube-api-access-8djm6\") pod \"perf-node-gather-daemonset-g85dg\" (UID: \"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5\") " pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:27.988113 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:27.988087    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:28.113364 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:28.113336    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"]
Jul 22 05:20:28.115862 ip-10-0-137-249 kubenswrapper[2584]: W0722 05:20:28.115832    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfcbb6aa8_392f_4d8f_95c5_703c4642dfc5.slice/crio-ea84535ad6b56cf4cf3d13882c33496c01607a497bc2211c9ab7a7569d748a62 WatchSource:0}: Error finding container ea84535ad6b56cf4cf3d13882c33496c01607a497bc2211c9ab7a7569d748a62: Status 404 returned error can't find the container with id ea84535ad6b56cf4cf3d13882c33496c01607a497bc2211c9ab7a7569d748a62
Jul 22 05:20:28.547008 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:28.546974    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg" event={"ID":"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5","Type":"ContainerStarted","Data":"551e00126dd5d5fcf3e6c2de09a4b848237860dbf259f7d64cff132782d4abc9"}
Jul 22 05:20:28.547177 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:28.547030    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg" event={"ID":"fcbb6aa8-392f-4d8f-95c5-703c4642dfc5","Type":"ContainerStarted","Data":"ea84535ad6b56cf4cf3d13882c33496c01607a497bc2211c9ab7a7569d748a62"}
Jul 22 05:20:28.547177 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:28.547053    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:28.562446 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:28.562394    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg" podStartSLOduration=1.562379284 podStartE2EDuration="1.562379284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 05:20:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 05:20:28.561316809 +0000 UTC m=+2838.619154370" watchObservedRunningTime="2026-07-22 05:20:28.562379284 +0000 UTC m=+2838.620216858"
Jul 22 05:20:29.924200 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:29.924169    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b6rrs_f471f155-a6e9-4c51-bfa3-b9b382aea7ee/dns/0.log"
Jul 22 05:20:29.943548 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:29.943524    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b6rrs_f471f155-a6e9-4c51-bfa3-b9b382aea7ee/kube-rbac-proxy/0.log"
Jul 22 05:20:30.082782 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:30.082755    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7gtj_cd595fae-bda2-4a84-ae8c-e7b1cc3831f2/dns-node-resolver/0.log"
Jul 22 05:20:30.681612 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:30.681581    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-878j5_40557eca-82bd-4ffc-9164-f813551371c0/node-ca/0.log"
Jul 22 05:20:31.845489 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:31.845462    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d644bdf8d-bqlh8_2e2f25ac-546f-4db3-968b-cdb416ce98c0/kube-auth-proxy/0.log"
Jul 22 05:20:31.986089 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:31.986062    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-hjmn5_b38f5afd-474a-4fdc-9491-b3ad0fb2af89/payload-pre-processing/0.log"
Jul 22 05:20:32.797994 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:32.797966    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bphsr_78c38dbf-a6d5-4a0c-8c9c-ff78a7e5935c/serve-healthcheck-canary/0.log"
Jul 22 05:20:33.313471 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:33.313439    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hkxzs_add770d3-98cf-45c1-a252-78d22865312b/kube-rbac-proxy/0.log"
Jul 22 05:20:33.333191 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:33.333166    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hkxzs_add770d3-98cf-45c1-a252-78d22865312b/exporter/0.log"
Jul 22 05:20:33.353982 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:33.353960    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hkxzs_add770d3-98cf-45c1-a252-78d22865312b/extractor/0.log"
Jul 22 05:20:34.560976 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:34.560927    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-84vmg/perf-node-gather-daemonset-g85dg"
Jul 22 05:20:36.468503 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:36.468463    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5567574457-8xr7v_ea388928-b794-4566-be92-6f7c02c36dfd/manager/0.log"
Jul 22 05:20:36.487564 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:36.487539    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5567574457-8xr7v_ea388928-b794-4566-be92-6f7c02c36dfd/copy-manifests/0.log"
Jul 22 05:20:38.119692 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:38.119664    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f987c9cb4-5x5tv_3b70e0f3-5ca1-4a0c-9bc1-f3548f7304e5/manager/0.log"
Jul 22 05:20:38.864734 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:38.864699    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d644bdf8d-bqlh8_2e2f25ac-546f-4db3-968b-cdb416ce98c0/kube-auth-proxy/0.log"
Jul 22 05:20:38.979224 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:38.979194    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-hjmn5_b38f5afd-474a-4fdc-9491-b3ad0fb2af89/payload-pre-processing/0.log"
Jul 22 05:20:40.406448 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:40.406420    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d644bdf8d-bqlh8_2e2f25ac-546f-4db3-968b-cdb416ce98c0/kube-auth-proxy/0.log"
Jul 22 05:20:40.530096 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:40.530062    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-hjmn5_b38f5afd-474a-4fdc-9491-b3ad0fb2af89/payload-pre-processing/0.log"
Jul 22 05:20:43.244476 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:43.244444    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-6289t_b61cc049-b532-4bc2-9d8c-d238b5a087b6/migrator/0.log"
Jul 22 05:20:43.263551 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:43.263528    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-6289t_b61cc049-b532-4bc2-9d8c-d238b5a087b6/graceful-termination/0.log"
Jul 22 05:20:44.813425 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:44.813398    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9h8p_5bc6449a-edf4-4270-b1db-12524d4e34b0/kube-multus-additional-cni-plugins/0.log"
Jul 22 05:20:44.833065 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:44.833041    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9h8p_5bc6449a-edf4-4270-b1db-12524d4e34b0/egress-router-binary-copy/0.log"
Jul 22 05:20:44.859787 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:44.859759    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9h8p_5bc6449a-edf4-4270-b1db-12524d4e34b0/cni-plugins/0.log"
Jul 22 05:20:44.874897 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:44.874869    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9h8p_5bc6449a-edf4-4270-b1db-12524d4e34b0/bond-cni-plugin/0.log"
Jul 22 05:20:44.894197 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:44.894175    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9h8p_5bc6449a-edf4-4270-b1db-12524d4e34b0/routeoverride-cni/0.log"
Jul 22 05:20:44.915689 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:44.915667    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9h8p_5bc6449a-edf4-4270-b1db-12524d4e34b0/whereabouts-cni-bincopy/0.log"
Jul 22 05:20:44.935265 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:44.935245    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h9h8p_5bc6449a-edf4-4270-b1db-12524d4e34b0/whereabouts-cni/0.log"
Jul 22 05:20:45.118476 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:45.118400    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-clv6p_9aa99ea5-9ae1-4f47-9de0-2428f924d68b/kube-multus/0.log"
Jul 22 05:20:45.211952 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:45.211913    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bvrr4_d6a93089-b6d0-4868-a3a4-0d7579905bbf/network-metrics-daemon/0.log"
Jul 22 05:20:45.230192 ip-10-0-137-249 kubenswrapper[2584]: I0722 05:20:45.230165    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bvrr4_d6a93089-b6d0-4868-a3a4-0d7579905bbf/kube-rbac-proxy/0.log"