Jul 10 02:22:47.346235 ip-10-0-130-224 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.803984    2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810068    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810086    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810090    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810093    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810097    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810100    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810103    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:22:47.894758 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810106    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810109    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810112    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810115    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810120    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810122    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810131    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810134    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810136    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810139    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810142    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810144    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810147    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810150    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810153    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810155    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810158    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810160    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810163    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:22:47.896165 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810166    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:22:47.881310 ip-10-0-130-224 systemd[1]: Started Kubernetes Kubelet.
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810168    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810171    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810173    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810176    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810179    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810182    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810184    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810188    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810191    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810193    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810196    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810198    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810203    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810206    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810210    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810213    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810215    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810219    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:22:47.910626 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810221    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810224    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810227    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810231    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810234    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810237    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810240    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810243    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810245    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810248    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810250    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810253    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810255    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810258    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810261    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810263    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810266    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810268    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810271    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:22:47.913380 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810274    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810276    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810279    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810281    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810284    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810286    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810288    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810291    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810294    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810296    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810299    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810301    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810304    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810307    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810309    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810314    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810317    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810319    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810322    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810324    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:22:47.926737 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810327    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810330    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810334    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810337    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810340    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810343    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810346    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810348    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810352    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810356    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810360    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810363    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810367    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810370    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.810373    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812744    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812757    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812760    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812764    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:22:47.929344 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812767    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812772    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812776    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812779    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812782    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812785    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812789    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812792    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812795    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812798    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812801    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812803    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812806    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812809    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812812    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812814    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812817    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812819    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812823    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:22:47.942712 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812826    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812828    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812831    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812834    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812846    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812849    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812851    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812854    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812857    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812861    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812863    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812866    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812869    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812872    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812875    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812878    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812881    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812883    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812886    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812889    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:22:47.945745 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812891    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812894    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812896    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812899    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812901    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812903    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812906    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812908    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812911    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812914    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812917    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812920    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812922    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812925    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812927    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812930    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812933    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812936    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812938    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812941    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:22:47.959804 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812943    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812947    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812949    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812952    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812954    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812957    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812977    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812981    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812983    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812986    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812991    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812995    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.812999    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813002    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813006    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813010    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813014    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813017    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813019    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:22:48.117403 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813022    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813026    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813029    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813031    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813034    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813037    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813040    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813042    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813045    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813048    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813051    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813053    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813056    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813058    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813061    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813063    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813066    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813543    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813551    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:22:48.118477 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813556    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813564    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813570    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813574    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813577    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813581    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813585    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813589    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813592    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813596    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813600    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813604    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813608    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813612    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813617    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813621    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813624    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813628    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813633    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813637    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813641    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:22:48.119550 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813644    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813648    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813652    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813656    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813659    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813663    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813667    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813671    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813674    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813678    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813682    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813685    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813691    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813696    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813700    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813704    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813707    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813711    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813715    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813719    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:22:48.120649 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813722    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813726    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813729    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813733    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813737    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813741    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813745    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813749    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813753    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813757    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813760    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813764    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813768    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813772    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813775    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813781    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813786    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813789    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813793    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:22:48.121761 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813797    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813800    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813804    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813808    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813811    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813817    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813821    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813825    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813831    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813836    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813841    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813845    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813849    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813854    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813858    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813866    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813871    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813875    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813879    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:22:48.122623 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813883    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813892    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813896    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813900    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813904    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813907    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813911    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813914    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813918    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813922    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813927    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813931    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813935    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813939    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813943    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813946    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813949    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.813953    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814068    2553 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814079    2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814087    2553 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 02:22:48.123499 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814099    2553 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814105    2553 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814110    2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814117    2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814123    2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814128    2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814132    2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814137    2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814142    2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814146    2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814151    2553 flags.go:64] FLAG: --cgroup-root=""
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814155    2553 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814159    2553 flags.go:64] FLAG: --client-ca-file=""
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814164    2553 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814169    2553 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814176    2553 flags.go:64] FLAG: --cluster-domain=""
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814180    2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814185    2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814189    2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814194    2553 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814200    2553 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814206    2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814211    2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 02:22:48.124388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814215    2553 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814220    2553 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814224    2553 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814229    2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814233    2553 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814237    2553 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814245    2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814250    2553 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814254    2553 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814258    2553 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814261    2553 flags.go:64] FLAG: --enable-server="true"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814266    2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814272    2553 flags.go:64] FLAG: --event-burst="100"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814276    2553 flags.go:64] FLAG: --event-qps="50"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814281    2553 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814285    2553 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814290    2553 flags.go:64] FLAG: --eviction-hard=""
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814295    2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814299    2553 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814304    2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814308    2553 flags.go:64] FLAG: --eviction-soft=""
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814313    2553 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814317    2553 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814322    2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814325    2553 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 02:22:48.125488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814330    2553 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814334    2553 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814338    2553 flags.go:64] FLAG: --feature-gates=""
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814343    2553 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814347    2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814353    2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814358    2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814362    2553 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814366    2553 flags.go:64] FLAG: --help="false"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814371    2553 flags.go:64] FLAG: --hostname-override="ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814375    2553 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814379    2553 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814384    2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814390    2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814395    2553 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814399    2553 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814403    2553 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814407    2553 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814411    2553 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814415    2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814419    2553 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814424    2553 flags.go:64] FLAG: --kube-reserved=""
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814428    2553 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814432    2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 02:22:48.126800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814436    2553 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814440    2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814444    2553 flags.go:64] FLAG: --lock-file=""
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814448    2553 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814452    2553 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814457    2553 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814465    2553 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814469    2553 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814474    2553 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814477    2553 flags.go:64] FLAG: --logging-format="text"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814481    2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814486    2553 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814490    2553 flags.go:64] FLAG: --manifest-url=""
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814496    2553 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814501    2553 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814506    2553 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814512    2553 flags.go:64] FLAG: --max-pods="110"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814516    2553 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814520    2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814525    2553 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814529    2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814534    2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814538    2553 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814543    2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814553    2553 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 02:22:48.127901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814558    2553 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814563    2553 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814567    2553 flags.go:64] FLAG: --pod-cidr=""
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814571    2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814579    2553 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814584    2553 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814588    2553 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814592    2553 flags.go:64] FLAG: --port="10250"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814597    2553 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814601    2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0fb2292d557ee7d6b"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814606    2553 flags.go:64] FLAG: --qos-reserved=""
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814611    2553 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814615    2553 flags.go:64] FLAG: --register-node="true"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814620    2553 flags.go:64] FLAG: --register-with-taints=""
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814625    2553 flags.go:64] FLAG: --registry-burst="10"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814630    2553 flags.go:64] FLAG: --registry-qps="5"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814634    2553 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814638    2553 flags.go:64] FLAG: --reserved-memory=""
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814643    2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814648    2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814654    2553 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814658    2553 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814662    2553 flags.go:64] FLAG: --runonce="false"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814666    2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814670    2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 02:22:48.131318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814675    2553 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814679    2553 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814683    2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814687    2553 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814694    2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814698    2553 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814702    2553 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814706    2553 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814710    2553 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814714    2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814719    2553 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814724    2553 flags.go:64] FLAG: --system-cgroups=""
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814728    2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814735    2553 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814739    2553 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814743    2553 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814750    2553 flags.go:64] FLAG: --tls-min-version=""
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814755    2553 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814759    2553 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814763    2553 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814767    2553 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814771    2553 flags.go:64] FLAG: --v="2"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814778    2553 flags.go:64] FLAG: --version="false"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814785    2553 flags.go:64] FLAG: --vmodule=""
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814790    2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 02:22:48.132622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.814795    2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.814958    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.814979    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.814985    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.814988    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.814993    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.814996    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815000    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815003    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815007    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815011    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815017    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815020    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815024    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815027    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815031    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815035    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815039    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815042    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:22:48.139850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815046    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815049    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815053    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815059    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815064    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815070    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815074    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815079    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815083    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815088    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815091    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815096    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815101    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815104    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815112    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815117    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815121    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815124    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815128    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815132    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:22:48.140725 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815137    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815140    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815144    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815148    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815154    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815158    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815162    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815166    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815170    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815173    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815179    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815183    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815187    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815191    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815195    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815199    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815202    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815206    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815210    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815214    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:22:48.141605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815218    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815222    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815226    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815230    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815234    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815239    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815243    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815248    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815251    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815255    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815259    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815263    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815266    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815273    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815278    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815282    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815288    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815292    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815297    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:22:48.142688 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815301    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815304    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815309    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815313    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815316    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815320    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815324    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815328    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815334    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815339    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815342    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815346    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815350    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815353    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815357    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815361    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815365    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815368    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815372    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:22:48.143571 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815377    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815383    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.815386    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.815398    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.822950    2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.822979    2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.822999    2553 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.823004    2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823060    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823065    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823069    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823073    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823076    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823079    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823082    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:22:48.144451 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823085    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823088    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823091    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823094    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823097    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823099    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823102    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823107    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823110    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823113    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823116    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823119    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823122    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823125    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823128    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823130    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823133    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823136    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823138    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823141    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:22:48.145340 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823144    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823147    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823150    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823153    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823155    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823158    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823161    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823164    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823167    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823169    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823172    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823175    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823178    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823181    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823183    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823186    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823190    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823193    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823196    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:22:48.146407 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823199    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823202    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823205    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823208    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823211    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823214    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823217    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823220    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823223    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823225    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823228    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823231    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823234    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823237    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823239    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823242    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823246    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823249    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823251    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823254    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:22:48.147297 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823257    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823260    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823263    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823265    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823268    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823270    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823273    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823276    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823278    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823281    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823284    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823286    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823289    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823291    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823297    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823299    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823304    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823307    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823309    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823312    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:22:48.148170 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823315    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823317    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823320    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823322    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823325    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823327    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823330    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823332    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823335    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823339    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823343    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823346    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823348    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.823354    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 02:22:48.149275 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823469    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823473    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823476    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823479    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823482    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823485    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823487    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823490    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823493    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823495    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823498    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823501    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823505    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823508    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823511    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823515    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823517    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823520    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823522    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 02:22:48.149940 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823525    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823527    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823530    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823533    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823535    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823538    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823542    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823545    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823548    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823551    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823554    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823557    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823560    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823563    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823566    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823568    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823571    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823573    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823576    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823578    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 02:22:48.150827 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823581    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823583    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823586    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823588    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823591    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823596    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823599    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823602    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823606    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823609    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823612    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823615    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823619    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823622    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823625    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823627    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823630    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823633    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823635    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 02:22:48.151716 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823638    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823640    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823642    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823645    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823648    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823651    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823653    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823656    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823659    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823661    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823664    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823667    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823669    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823672    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823674    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823676    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823679    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823681    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823685    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823688    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 02:22:48.152615 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823690    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823694    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823696    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823699    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823701    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823703    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823706    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823709    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823711    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823713    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823716    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823719    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823721    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823724    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823726    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823729    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823732    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823734    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823737    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823739    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 02:22:48.153730 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:47.823742    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 02:22:48.154652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.823747    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 02:22:48.154652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.823867    2553 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 02:22:48.154652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.827351    2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 02:22:48.154652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.828983    2553 server.go:1019] "Starting client certificate rotation"
Jul 10 02:22:48.154652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.829080    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 02:22:48.154652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.829117    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 02:22:48.154652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.831697    2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 02:22:48.154652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.832857    2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 02:22:48.154652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.842622    2553 log.go:25] "Validated CRI v1 runtime API"
Jul 10 02:22:48.154652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.847433    2553 log.go:25] "Validated CRI v1 image API"
Jul 10 02:22:48.154652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.848515    2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 02:22:48.154652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.853402    2553 fs.go:135] Filesystem UUIDs: map[2e6fed20-7b79-473f-aef9-74b521743d72:/dev/nvme0n1p4 7048c166-e7c2-4ffe-9770-9fee2c87b529:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 10 02:22:48.155277 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.853418    2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 02:22:48.155498 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.858497    2553 manager.go:216] Machine: {Timestamp:2026-07-10 02:22:47.85706375 +0000 UTC m=+0.378042050 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095998 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26bd2629a4e3e776b491837b162f3b SystemUUID:ec26bd26-29a4-e3e7-76b4-91837b162f3b BootID:1b6d30df-9aa7-47f9-b81c-ca5f992833a3 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f7:79:0a:90:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f7:79:0a:90:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:3f:73:b0:c5:c5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 02:22:48.155498 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.858600    2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 02:22:48.155498 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.858681    2553 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 02:22:48.155498 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.860592    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 02:22:48.155498 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.862010    2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 02:22:48.155498 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.862045    2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-224.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 02:22:48.155498 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.862922    2553 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.862938    2553 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.862955    2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.862988    2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.864951    2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.869613    2553 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.869724    2553 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.869750    2553 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.869768    2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.869788    2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.869798    2553 kubelet.go:398] "Adding apiserver pod source"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.869807    2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.870176    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.870197    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.872706    2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.875239    2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.875267    2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.875435    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.875448    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.875454    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.875459    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.875469    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.875475    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.876099    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.876106    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.876113    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.876118    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.876132    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.876140    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.876941    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.876948    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.880284    2553 server.go:1268] "Started kubelet"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.880360    2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.880437    2553 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.880369    2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.881943    2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.882507    2553 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:47.886686    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.886753    2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-224.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 02:22:48.156563 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:47.887121    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:47.887723    2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:47.892360    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-224.ec2.internal.18c0cc60a41184da  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-224.ec2.internal,UID:ip-10-0-130-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-224.ec2.internal,},FirstTimestamp:2026-07-10 02:22:47.880254682 +0000 UTC m=+0.401232982,LastTimestamp:2026-07-10 02:22:47.880254682 +0000 UTC m=+0.401232982,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-224.ec2.internal,}"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.893877    2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.893905    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:47.894008    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.894615    2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.894617    2553 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.894671    2553 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.894773    2553 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.894779    2553 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.896095    2553 factory.go:55] Registering systemd factory
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.896108    2553 factory.go:223] Registration of the systemd container factory successfully
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:47.896332    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.896366    2553 factory.go:153] Registering CRI-O factory
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.896383    2553 factory.go:223] Registration of the crio container factory successfully
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:47.896338    2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-224.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.896432    2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.896451    2553 factory.go:103] Registering Raw factory
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.896462    2553 manager.go:1196] Started watching for new ooms in manager
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.896744    2553 manager.go:349] Starting recovery of all containers
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.906660    2553 manager.go:354] Recovery completed
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.910489    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.912192    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.912228    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.912243    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.912849    2553 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.912859    2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.912877    2553 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.912888    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.913813    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.913835    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.913850    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:22:48.306242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.915124    2553 policy_none.go:49] "None policy: Start"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.915137    2553 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.915148    2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.917072    2553 policy_none.go:47] "Start"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.920557    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2nmdj"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:47.922668    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-224.ec2.internal.18c0cc60a5f9244f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-224.ec2.internal,UID:ip-10-0-130-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-224.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-224.ec2.internal,},FirstTimestamp:2026-07-10 02:22:47.912211535 +0000 UTC m=+0.433189836,LastTimestamp:2026-07-10 02:22:47.912211535 +0000 UTC m=+0.433189836,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-224.ec2.internal,}"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.931999    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2nmdj"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:47.933953    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-224.ec2.internal.18c0cc60a5f97fa7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-224.ec2.internal,UID:ip-10-0-130-224.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-224.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-224.ec2.internal,},FirstTimestamp:2026-07-10 02:22:47.912234919 +0000 UTC m=+0.433213219,LastTimestamp:2026-07-10 02:22:47.912234919 +0000 UTC m=+0.433213219,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-224.ec2.internal,}"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.982805    2553 manager.go:337] "Starting Device Plugin manager"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:47.983087    2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.983099    2553 server.go:87] "Starting device plugin registration server"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.983333    2553 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.983345    2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.983553    2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.983641    2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:47.983650    2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:47.984181    2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:47.984228    2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-224.ec2.internal\" not found"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.000884    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.002152    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.002193    2553 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.002222    2553 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.002261    2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.004983    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.084331    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.085415    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.085448    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:22:48.307809 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.085462    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.085486    2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.099890    2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.099916    2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-224.ec2.internal\": node \"ip-10-0-130-224.ec2.internal\" not found"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.102761    2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal"]
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.102824    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.103678    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.103704    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.103737    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.106166    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.106295    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.106323    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.106922    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.106926    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.106948    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.106949    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.106995    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.106972    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.109276    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.109309    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.110045    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.110074    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.110089    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeHasSufficientPID"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.153483    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.179038    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-224.ec2.internal\" not found" node="ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.184101    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-224.ec2.internal\" not found" node="ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.196143    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a952e5b6d4e019797a19f89704bcb1d9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-224.ec2.internal\" (UID: \"a952e5b6d4e019797a19f89704bcb1d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.315657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.196204    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ccf026386246e99d2e23ffb67aaa9db3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal\" (UID: \"ccf026386246e99d2e23ffb67aaa9db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.317219 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.196233    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf026386246e99d2e23ffb67aaa9db3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal\" (UID: \"ccf026386246e99d2e23ffb67aaa9db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.317219 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.257796    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found"
Jul 10 02:22:48.317219 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.297135    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ccf026386246e99d2e23ffb67aaa9db3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal\" (UID: \"ccf026386246e99d2e23ffb67aaa9db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.317219 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.297163    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf026386246e99d2e23ffb67aaa9db3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal\" (UID: \"ccf026386246e99d2e23ffb67aaa9db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.317219 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.297181    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a952e5b6d4e019797a19f89704bcb1d9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-224.ec2.internal\" (UID: \"a952e5b6d4e019797a19f89704bcb1d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.317219 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.297220    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a952e5b6d4e019797a19f89704bcb1d9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-224.ec2.internal\" (UID: \"a952e5b6d4e019797a19f89704bcb1d9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.317219 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.297237    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ccf026386246e99d2e23ffb67aaa9db3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal\" (UID: \"ccf026386246e99d2e23ffb67aaa9db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.317219 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.297246    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ccf026386246e99d2e23ffb67aaa9db3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal\" (UID: \"ccf026386246e99d2e23ffb67aaa9db3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.485116 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.358441    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found"
Jul 10 02:22:48.485116 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.458680    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found"
Jul 10 02:22:48.485116 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.480871    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.491619 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.487816    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:48.662521 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.559452    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found"
Jul 10 02:22:48.662521 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.660456    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found"
Jul 10 02:22:48.855288 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.761715    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found"
Jul 10 02:22:48.855288 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.773661    2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:22:48.855288 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.828307    2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 02:22:48.855288 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.828462    2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 02:22:48.855288 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.828468    2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 02:22:49.032850 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.861862    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found"
Jul 10 02:22:49.032850 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.937250    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 02:17:48 +0000 UTC" deadline="2027-12-20 06:37:21.480997758 +0000 UTC"
Jul 10 02:22:49.032850 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:48.937292    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12676h14m32.54370973s"
Jul 10 02:22:49.032850 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:48.962798    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-224.ec2.internal\" not found"
Jul 10 02:22:49.032850 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.023310    2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:22:49.167863 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.095006    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:49.167863 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.106258    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 02:22:49.167863 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.107154    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal"
Jul 10 02:22:49.167863 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.123162    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 02:22:49.327918 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:49.183901    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda952e5b6d4e019797a19f89704bcb1d9.slice/crio-8600882c51674dedb9a9830c0c3d34fd6151cf205c3abeb0fa9bf6fdc968d10e WatchSource:0}: Error finding container 8600882c51674dedb9a9830c0c3d34fd6151cf205c3abeb0fa9bf6fdc968d10e: Status 404 returned error can't find the container with id 8600882c51674dedb9a9830c0c3d34fd6151cf205c3abeb0fa9bf6fdc968d10e
Jul 10 02:22:49.327918 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:49.184240    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf026386246e99d2e23ffb67aaa9db3.slice/crio-d975cb361c62d8a7f6c24df365fc82d54d28bdf55773700657cb01d2de996e23 WatchSource:0}: Error finding container d975cb361c62d8a7f6c24df365fc82d54d28bdf55773700657cb01d2de996e23: Status 404 returned error can't find the container with id d975cb361c62d8a7f6c24df365fc82d54d28bdf55773700657cb01d2de996e23
Jul 10 02:22:49.327918 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.196212    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 02:22:49.493008 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.412686    2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:22:49.873076 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.871316    2553 apiserver.go:52] "Watching apiserver"
Jul 10 02:22:49.883250 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.881312    2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 02:22:49.883250 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.881805    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal","openshift-network-diagnostics/network-check-target-24tvp","kube-system/global-pull-secret-syncer-lk64x","kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal","openshift-dns/node-resolver-shcs2","openshift-multus/multus-additional-cni-plugins-8fcbt","openshift-multus/multus-mxc72","openshift-multus/network-metrics-daemon-9hsmb","openshift-network-operator/iptables-alerter-657wq","openshift-ovn-kubernetes/ovnkube-node-tjwhh","kube-system/konnectivity-agent-8q8kj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl","openshift-cluster-node-tuning-operator/tuned-n5brp","openshift-image-registry/node-ca-cfmmx"]
Jul 10 02:22:49.885149 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.884559    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8q8kj"
Jul 10 02:22:49.889602 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.887271    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:22:49.889602 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:49.887522    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:22:49.894359 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.890107    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cfmmx"
Jul 10 02:22:49.894359 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.892743    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.901084 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.894758    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 02:22:49.901084 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.895548    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-shcs2"
Jul 10 02:22:49.901084 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.897677    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:49.901084 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.900524    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.902823    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:49.902912    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906103    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-657wq"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906537    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-sysctl-conf\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906566    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-run\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906590    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-sys\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906613    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-host\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906638    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-tuned\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906662    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0eb86958-c22a-4c9f-8a28-394ab957d89d-hosts-file\") pod \"node-resolver-shcs2\" (UID: \"0eb86958-c22a-4c9f-8a28-394ab957d89d\") " pod="openshift-dns/node-resolver-shcs2"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906687    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ecc2d80-ce74-4157-916a-523bcd88e568-agent-certs\") pod \"konnectivity-agent-8q8kj\" (UID: \"8ecc2d80-ce74-4157-916a-523bcd88e568\") " pod="kube-system/konnectivity-agent-8q8kj"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906729    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/285629fb-127f-4594-889c-5ef466d88885-serviceca\") pod \"node-ca-cfmmx\" (UID: \"285629fb-127f-4594-889c-5ef466d88885\") " pod="openshift-image-registry/node-ca-cfmmx"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906763    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-kubernetes\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906790    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-systemd\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906811    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-var-lib-kubelet\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.907791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906834    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctgsh\" (UniqueName: \"kubernetes.io/projected/cc7a2b60-189c-47b9-b320-06f5570cc537-kube-api-access-ctgsh\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906856    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0eb86958-c22a-4c9f-8a28-394ab957d89d-tmp-dir\") pod \"node-resolver-shcs2\" (UID: \"0eb86958-c22a-4c9f-8a28-394ab957d89d\") " pod="openshift-dns/node-resolver-shcs2"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906878    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ecc2d80-ce74-4157-916a-523bcd88e568-konnectivity-ca\") pod \"konnectivity-agent-8q8kj\" (UID: \"8ecc2d80-ce74-4157-916a-523bcd88e568\") " pod="kube-system/konnectivity-agent-8q8kj"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906900    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/285629fb-127f-4594-889c-5ef466d88885-host\") pod \"node-ca-cfmmx\" (UID: \"285629fb-127f-4594-889c-5ef466d88885\") " pod="openshift-image-registry/node-ca-cfmmx"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906923    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbf82\" (UniqueName: \"kubernetes.io/projected/285629fb-127f-4594-889c-5ef466d88885-kube-api-access-mbf82\") pod \"node-ca-cfmmx\" (UID: \"285629fb-127f-4594-889c-5ef466d88885\") " pod="openshift-image-registry/node-ca-cfmmx"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.906945    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-modprobe-d\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.907060    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-sysctl-d\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.907100    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-lib-modules\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.907137    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tjlx\" (UniqueName: \"kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx\") pod \"network-check-target-24tvp\" (UID: \"ade028b3-e160-4c7a-ad9b-57587da84f17\") " pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.907169    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-sysconfig\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.907195    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc7a2b60-189c-47b9-b320-06f5570cc537-tmp\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.907220    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ntdt\" (UniqueName: \"kubernetes.io/projected/0eb86958-c22a-4c9f-8a28-394ab957d89d-kube-api-access-6ntdt\") pod \"node-resolver-shcs2\" (UID: \"0eb86958-c22a-4c9f-8a28-394ab957d89d\") " pod="openshift-dns/node-resolver-shcs2"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.908786    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.911217    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mxc72"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.913609    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:49.913683    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:22:49.971414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.928759    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 02:22:49.972597 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.928980    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 02:22:49.972597 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.929168    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 02:22:49.972597 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.929344    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-t2lcm\""
Jul 10 02:22:49.972597 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.929850    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dhfx6\""
Jul 10 02:22:49.972597 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.930059    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.987578    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.987623    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.988864    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6pxzv\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.989193    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.990671    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.991070    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.991647    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.991834    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.991913    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.991929    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.992183    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.992390    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.992412    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-984g8\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.992434    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.992559    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.992701    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-487wq\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.995698    2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.996093    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.996324    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.996528    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.996570    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.996686    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.996836    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.996889    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2pl9h\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.996840    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.997019    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.997557    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qlpg9\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.997627    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.997556    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-cw7z5\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.997884    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.998086    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 02:22:50.049670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:49.998090    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2lkjl\""
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.005899    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007519    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjlx\" (UniqueName: \"kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx\") pod \"network-check-target-24tvp\" (UID: \"ade028b3-e160-4c7a-ad9b-57587da84f17\") " pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007562    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-sysconfig\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007593    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-run-multus-certs\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007621    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-sysctl-conf\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007646    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-run\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007669    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-sys\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007693    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-tuned\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007719    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0eb86958-c22a-4c9f-8a28-394ab957d89d-hosts-file\") pod \"node-resolver-shcs2\" (UID: \"0eb86958-c22a-4c9f-8a28-394ab957d89d\") " pod="openshift-dns/node-resolver-shcs2"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007744    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ecc2d80-ce74-4157-916a-523bcd88e568-agent-certs\") pod \"konnectivity-agent-8q8kj\" (UID: \"8ecc2d80-ce74-4157-916a-523bcd88e568\") " pod="kube-system/konnectivity-agent-8q8kj"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007767    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-sys-fs\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007793    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-slash\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007821    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/285629fb-127f-4594-889c-5ef466d88885-serviceca\") pod \"node-ca-cfmmx\" (UID: \"285629fb-127f-4594-889c-5ef466d88885\") " pod="openshift-image-registry/node-ca-cfmmx"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007845    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-kubernetes\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.052767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007869    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-multus-cni-dir\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007893    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-run-ovn\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007917    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/285629fb-127f-4594-889c-5ef466d88885-host\") pod \"node-ca-cfmmx\" (UID: \"285629fb-127f-4594-889c-5ef466d88885\") " pod="openshift-image-registry/node-ca-cfmmx"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007945    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-cni-binary-copy\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007973    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmx5l\" (UniqueName: \"kubernetes.io/projected/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-kube-api-access-rmx5l\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007999    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-socket-dir\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008025    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3db8ca5f-40fb-4be3-83ce-77794b9a7a82-host-slash\") pod \"iptables-alerter-657wq\" (UID: \"3db8ca5f-40fb-4be3-83ce-77794b9a7a82\") " pod="openshift-network-operator/iptables-alerter-657wq"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008122    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0eb86958-c22a-4c9f-8a28-394ab957d89d-hosts-file\") pod \"node-resolver-shcs2\" (UID: \"0eb86958-c22a-4c9f-8a28-394ab957d89d\") " pod="openshift-dns/node-resolver-shcs2"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008152    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-kubernetes\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008196    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/285629fb-127f-4594-889c-5ef466d88885-host\") pod \"node-ca-cfmmx\" (UID: \"285629fb-127f-4594-889c-5ef466d88885\") " pod="openshift-image-registry/node-ca-cfmmx"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008225    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ntdt\" (UniqueName: \"kubernetes.io/projected/0eb86958-c22a-4c9f-8a28-394ab957d89d-kube-api-access-6ntdt\") pod \"node-resolver-shcs2\" (UID: \"0eb86958-c22a-4c9f-8a28-394ab957d89d\") " pod="openshift-dns/node-resolver-shcs2"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008253    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-cnibin\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008278    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-os-release\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008302    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-etc-openvswitch\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.056696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008333    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-cnibin\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008360    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008384    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-device-dir\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008428    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-multus-conf-dir\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008453    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-cni-bin\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008476    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-ovnkube-config\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008478    2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008501    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-ovn-node-metrics-cert\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008530    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-systemd\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008556    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ecc2d80-ce74-4157-916a-523bcd88e568-konnectivity-ca\") pod \"konnectivity-agent-8q8kj\" (UID: \"8ecc2d80-ce74-4157-916a-523bcd88e568\") " pod="kube-system/konnectivity-agent-8q8kj"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008583    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008609    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j696m\" (UniqueName: \"kubernetes.io/projected/acc07a04-b6d3-4e2a-8912-c15de0d911d4-kube-api-access-j696m\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008644    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3db8ca5f-40fb-4be3-83ce-77794b9a7a82-iptables-alerter-script\") pod \"iptables-alerter-657wq\" (UID: \"3db8ca5f-40fb-4be3-83ce-77794b9a7a82\") " pod="openshift-network-operator/iptables-alerter-657wq"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.007794    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-sysconfig\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.057633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008669    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnd8b\" (UniqueName: \"kubernetes.io/projected/3db8ca5f-40fb-4be3-83ce-77794b9a7a82-kube-api-access-rnd8b\") pod \"iptables-alerter-657wq\" (UID: \"3db8ca5f-40fb-4be3-83ce-77794b9a7a82\") " pod="openshift-network-operator/iptables-alerter-657wq"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008696    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-sysctl-d\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008719    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fdf20648-a46e-4896-98b6-56734478f76c-kubelet-config\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.009359    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fdf20648-a46e-4896-98b6-56734478f76c-dbus\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.009425    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.009474    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-multus-socket-dir-parent\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.009514    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/acc07a04-b6d3-4e2a-8912-c15de0d911d4-multus-daemon-config\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.009524    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/285629fb-127f-4594-889c-5ef466d88885-serviceca\") pod \"node-ca-cfmmx\" (UID: \"285629fb-127f-4594-889c-5ef466d88885\") " pod="openshift-image-registry/node-ca-cfmmx"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.009547    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-run-openvswitch\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.009589    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-ovnkube-script-lib\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.008577    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" event={"ID":"ccf026386246e99d2e23ffb67aaa9db3","Type":"ContainerStarted","Data":"d975cb361c62d8a7f6c24df365fc82d54d28bdf55773700657cb01d2de996e23"}
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.009620    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc7a2b60-189c-47b9-b320-06f5570cc537-tmp\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.009653    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-system-cni-dir\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.009684    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-run-netns\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.058616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.010121    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-sysctl-conf\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.010181    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-run\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.010227    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-sys\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.010470    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-sysctl-d\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.010723    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-systemd\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011019    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8ecc2d80-ce74-4157-916a-523bcd88e568-konnectivity-ca\") pod \"konnectivity-agent-8q8kj\" (UID: \"8ecc2d80-ce74-4157-916a-523bcd88e568\") " pod="kube-system/konnectivity-agent-8q8kj"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.009750    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-system-cni-dir\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011404    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-hostroot\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011440    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-cni-netd\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011476    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0eb86958-c22a-4c9f-8a28-394ab957d89d-tmp-dir\") pod \"node-resolver-shcs2\" (UID: \"0eb86958-c22a-4c9f-8a28-394ab957d89d\") " pod="openshift-dns/node-resolver-shcs2"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011545    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-registration-dir\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011578    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011611    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-kubelet\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011644    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbf82\" (UniqueName: \"kubernetes.io/projected/285629fb-127f-4594-889c-5ef466d88885-kube-api-access-mbf82\") pod \"node-ca-cfmmx\" (UID: \"285629fb-127f-4594-889c-5ef466d88885\") " pod="openshift-image-registry/node-ca-cfmmx"
Jul 10 02:22:50.061951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011790    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-lib-modules\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011828    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkjkc\" (UniqueName: \"kubernetes.io/projected/f60b30e7-d655-4e5a-be69-2d79bcde96f5-kube-api-access-fkjkc\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011861    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acc07a04-b6d3-4e2a-8912-c15de0d911d4-cni-binary-copy\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011889    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-var-lib-cni-multus\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011896    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-lib-modules\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011915    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-var-lib-kubelet\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011793    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0eb86958-c22a-4c9f-8a28-394ab957d89d-tmp-dir\") pod \"node-resolver-shcs2\" (UID: \"0eb86958-c22a-4c9f-8a28-394ab957d89d\") " pod="openshift-dns/node-resolver-shcs2"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011940    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-run-systemd\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.011970    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-node-log\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012070    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012165    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-run-k8s-cni-cncf-io\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012224    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-etc-kubernetes\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012326    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012363    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-env-overrides\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.062911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012397    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7ks4\" (UniqueName: \"kubernetes.io/projected/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-kube-api-access-x7ks4\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012432    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-host\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012457    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-os-release\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012490    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj6cv\" (UniqueName: \"kubernetes.io/projected/a6c70eaf-2325-49b0-9841-adc56047391a-kube-api-access-bj6cv\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012520    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-systemd-units\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012528    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-host\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012599    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-var-lib-openvswitch\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012631    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-var-lib-kubelet\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012799    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-var-lib-kubelet\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012868    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctgsh\" (UniqueName: \"kubernetes.io/projected/cc7a2b60-189c-47b9-b320-06f5570cc537-kube-api-access-ctgsh\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012906    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.012950    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-run-netns\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.013000    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-log-socket\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.013031    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-modprobe-d\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.063899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.013070    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.013100    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-var-lib-cni-bin\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.013130    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.013793    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-modprobe-d\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.018120    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.018142    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.018162    2553 projected.go:196] Error preparing data for projected volume kube-api-access-4tjlx for pod openshift-network-diagnostics/network-check-target-24tvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.018266    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx podName:ade028b3-e160-4c7a-ad9b-57587da84f17 nodeName:}" failed. No retries permitted until 2026-07-10 02:22:50.518238131 +0000 UTC m=+3.039216435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4tjlx" (UniqueName: "kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx") pod "network-check-target-24tvp" (UID: "ade028b3-e160-4c7a-ad9b-57587da84f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.019298    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc7a2b60-189c-47b9-b320-06f5570cc537-tmp\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.022736    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8ecc2d80-ce74-4157-916a-523bcd88e568-agent-certs\") pod \"konnectivity-agent-8q8kj\" (UID: \"8ecc2d80-ce74-4157-916a-523bcd88e568\") " pod="kube-system/konnectivity-agent-8q8kj"
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.023655    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbf82\" (UniqueName: \"kubernetes.io/projected/285629fb-127f-4594-889c-5ef466d88885-kube-api-access-mbf82\") pod \"node-ca-cfmmx\" (UID: \"285629fb-127f-4594-889c-5ef466d88885\") " pod="openshift-image-registry/node-ca-cfmmx"
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.024175    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cc7a2b60-189c-47b9-b320-06f5570cc537-etc-tuned\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.025362    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal" event={"ID":"a952e5b6d4e019797a19f89704bcb1d9","Type":"ContainerStarted","Data":"8600882c51674dedb9a9830c0c3d34fd6151cf205c3abeb0fa9bf6fdc968d10e"}
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.027371    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctgsh\" (UniqueName: \"kubernetes.io/projected/cc7a2b60-189c-47b9-b320-06f5570cc537-kube-api-access-ctgsh\") pod \"tuned-n5brp\" (UID: \"cc7a2b60-189c-47b9-b320-06f5570cc537\") " pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.032826    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ntdt\" (UniqueName: \"kubernetes.io/projected/0eb86958-c22a-4c9f-8a28-394ab957d89d-kube-api-access-6ntdt\") pod \"node-resolver-shcs2\" (UID: \"0eb86958-c22a-4c9f-8a28-394ab957d89d\") " pod="openshift-dns/node-resolver-shcs2"
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.038966    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dn7gk"
Jul 10 02:22:50.066093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.045675    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dn7gk"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.113729    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-systemd-units\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.113773    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-var-lib-openvswitch\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.113817    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.113843    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-run-netns\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.113861    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-systemd-units\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.113868    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-log-socket\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.113912    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-log-socket\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.113931    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.113964    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-var-lib-cni-bin\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114010    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.114033    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114054    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-run-multus-certs\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114088    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-sys-fs\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.128582 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.114111    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret podName:fdf20648-a46e-4896-98b6-56734478f76c nodeName:}" failed. No retries permitted until 2026-07-10 02:22:50.614089115 +0000 UTC m=+3.135067433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret") pod "global-pull-secret-syncer-lk64x" (UID: "fdf20648-a46e-4896-98b6-56734478f76c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114138    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-slash\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114148    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-sys-fs\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114191    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-slash\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114193    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-run-netns\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114238    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-var-lib-openvswitch\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114426    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-run-ovn-kubernetes\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114474    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-var-lib-cni-bin\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114518    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-run-multus-certs\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114544    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-multus-cni-dir\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114572    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-run-ovn\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114599    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-cni-binary-copy\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114627    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmx5l\" (UniqueName: \"kubernetes.io/projected/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-kube-api-access-rmx5l\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114653    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-socket-dir\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114677    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3db8ca5f-40fb-4be3-83ce-77794b9a7a82-host-slash\") pod \"iptables-alerter-657wq\" (UID: \"3db8ca5f-40fb-4be3-83ce-77794b9a7a82\") " pod="openshift-network-operator/iptables-alerter-657wq"
Jul 10 02:22:50.135304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114704    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-cnibin\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114729    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-os-release\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114755    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-etc-openvswitch\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114789    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-cnibin\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114815    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114839    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-device-dir\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114897    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3db8ca5f-40fb-4be3-83ce-77794b9a7a82-host-slash\") pod \"iptables-alerter-657wq\" (UID: \"3db8ca5f-40fb-4be3-83ce-77794b9a7a82\") " pod="openshift-network-operator/iptables-alerter-657wq"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114910    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-device-dir\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114897    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114939    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-etc-openvswitch\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.114976    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-cnibin\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115000    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115011    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-os-release\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115039    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-multus-conf-dir\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115057    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-run-ovn\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.136479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115065    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-cni-bin\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115087    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-ovnkube-config\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115109    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-ovn-node-metrics-cert\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115133    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115158    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j696m\" (UniqueName: \"kubernetes.io/projected/acc07a04-b6d3-4e2a-8912-c15de0d911d4-kube-api-access-j696m\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115166    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-multus-cni-dir\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115183    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3db8ca5f-40fb-4be3-83ce-77794b9a7a82-iptables-alerter-script\") pod \"iptables-alerter-657wq\" (UID: \"3db8ca5f-40fb-4be3-83ce-77794b9a7a82\") " pod="openshift-network-operator/iptables-alerter-657wq"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115207    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-cnibin\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115211    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnd8b\" (UniqueName: \"kubernetes.io/projected/3db8ca5f-40fb-4be3-83ce-77794b9a7a82-kube-api-access-rnd8b\") pod \"iptables-alerter-657wq\" (UID: \"3db8ca5f-40fb-4be3-83ce-77794b9a7a82\") " pod="openshift-network-operator/iptables-alerter-657wq"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115248    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fdf20648-a46e-4896-98b6-56734478f76c-kubelet-config\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115273    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fdf20648-a46e-4896-98b6-56734478f76c-dbus\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115298    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115322    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-multus-socket-dir-parent\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115345    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/acc07a04-b6d3-4e2a-8912-c15de0d911d4-multus-daemon-config\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.137483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115377    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-run-openvswitch\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115402    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-ovnkube-script-lib\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115429    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-system-cni-dir\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115454    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-cni-bin\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115492    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-multus-conf-dir\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115546    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fdf20648-a46e-4896-98b6-56734478f76c-kubelet-config\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115598    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fdf20648-a46e-4896-98b6-56734478f76c-dbus\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115656    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-multus-socket-dir-parent\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115993    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-system-cni-dir\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116068    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-run-openvswitch\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116251    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-ovnkube-config\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116267    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-cni-binary-copy\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116413    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.115455    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-run-netns\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116441    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-ovnkube-script-lib\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.196066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116467    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-system-cni-dir\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116502    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-hostroot\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116531    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-cni-netd\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116558    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-registration-dir\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116574    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-socket-dir\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116582    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116618    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-kubelet\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116625    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3db8ca5f-40fb-4be3-83ce-77794b9a7a82-iptables-alerter-script\") pod \"iptables-alerter-657wq\" (UID: \"3db8ca5f-40fb-4be3-83ce-77794b9a7a82\") " pod="openshift-network-operator/iptables-alerter-657wq"
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.116653    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116678    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-kubelet\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116689    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-system-cni-dir\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116617    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-run-netns\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116655    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-hostroot\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.116725    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs podName:a6c70eaf-2325-49b0-9841-adc56047391a nodeName:}" failed. No retries permitted until 2026-07-10 02:22:50.616706801 +0000 UTC m=+3.137685105 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs") pod "network-metrics-daemon-9hsmb" (UID: "a6c70eaf-2325-49b0-9841-adc56047391a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:22:50.197386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116651    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkjkc\" (UniqueName: \"kubernetes.io/projected/f60b30e7-d655-4e5a-be69-2d79bcde96f5-kube-api-access-fkjkc\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116743    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-cni-netd\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116753    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-registration-dir\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116762    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acc07a04-b6d3-4e2a-8912-c15de0d911d4-cni-binary-copy\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116788    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-var-lib-cni-multus\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116818    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-var-lib-kubelet\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116849    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-run-systemd\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116877    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-node-log\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116882    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-var-lib-kubelet\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116848    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-var-lib-cni-multus\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116901    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116927    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-run-k8s-cni-cncf-io\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116945    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-run-systemd\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116965    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-node-log\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.116951    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-etc-kubernetes\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.198503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117014    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117017    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-host-run-k8s-cni-cncf-io\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117057    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc07a04-b6d3-4e2a-8912-c15de0d911d4-etc-kubernetes\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117060    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f60b30e7-d655-4e5a-be69-2d79bcde96f5-etc-selinux\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117080    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117079    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-env-overrides\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117120    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7ks4\" (UniqueName: \"kubernetes.io/projected/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-kube-api-access-x7ks4\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117144    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-os-release\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117161    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj6cv\" (UniqueName: \"kubernetes.io/projected/a6c70eaf-2325-49b0-9841-adc56047391a-kube-api-access-bj6cv\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117202    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117283    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-os-release\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117467    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-env-overrides\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.117376    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/acc07a04-b6d3-4e2a-8912-c15de0d911d4-multus-daemon-config\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.118024    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/acc07a04-b6d3-4e2a-8912-c15de0d911d4-cni-binary-copy\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.199451 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.120285    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-ovn-node-metrics-cert\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.200641 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.131674    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmx5l\" (UniqueName: \"kubernetes.io/projected/6dbcad3f-1a69-439e-8a77-08a0a8d1100a-kube-api-access-rmx5l\") pod \"multus-additional-cni-plugins-8fcbt\" (UID: \"6dbcad3f-1a69-439e-8a77-08a0a8d1100a\") " pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.200641 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.133870    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j696m\" (UniqueName: \"kubernetes.io/projected/acc07a04-b6d3-4e2a-8912-c15de0d911d4-kube-api-access-j696m\") pod \"multus-mxc72\" (UID: \"acc07a04-b6d3-4e2a-8912-c15de0d911d4\") " pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.200641 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.136759    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkjkc\" (UniqueName: \"kubernetes.io/projected/f60b30e7-d655-4e5a-be69-2d79bcde96f5-kube-api-access-fkjkc\") pod \"aws-ebs-csi-driver-node-b8nxl\" (UID: \"f60b30e7-d655-4e5a-be69-2d79bcde96f5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.200641 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.138065    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnd8b\" (UniqueName: \"kubernetes.io/projected/3db8ca5f-40fb-4be3-83ce-77794b9a7a82-kube-api-access-rnd8b\") pod \"iptables-alerter-657wq\" (UID: \"3db8ca5f-40fb-4be3-83ce-77794b9a7a82\") " pod="openshift-network-operator/iptables-alerter-657wq"
Jul 10 02:22:50.200641 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.138926    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7ks4\" (UniqueName: \"kubernetes.io/projected/2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e-kube-api-access-x7ks4\") pod \"ovnkube-node-tjwhh\" (UID: \"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e\") " pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.200641 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.141467    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj6cv\" (UniqueName: \"kubernetes.io/projected/a6c70eaf-2325-49b0-9841-adc56047391a-kube-api-access-bj6cv\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:50.202170 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.202093    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8q8kj"
Jul 10 02:22:50.213673 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.213640    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cfmmx"
Jul 10 02:22:50.219109 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:50.219067    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ecc2d80_ce74_4157_916a_523bcd88e568.slice/crio-ef4e8adacac98cbda1a517b4bf26ac52e728ae3aab4ff38bfeedea87c367aaa7 WatchSource:0}: Error finding container ef4e8adacac98cbda1a517b4bf26ac52e728ae3aab4ff38bfeedea87c367aaa7: Status 404 returned error can't find the container with id ef4e8adacac98cbda1a517b4bf26ac52e728ae3aab4ff38bfeedea87c367aaa7
Jul 10 02:22:50.225099 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.225070    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n5brp"
Jul 10 02:22:50.227363 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:50.227335    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod285629fb_127f_4594_889c_5ef466d88885.slice/crio-37a63c88427130818057e1081aed99a273139a36fe3de3562a50b3a604fa9906 WatchSource:0}: Error finding container 37a63c88427130818057e1081aed99a273139a36fe3de3562a50b3a604fa9906: Status 404 returned error can't find the container with id 37a63c88427130818057e1081aed99a273139a36fe3de3562a50b3a604fa9906
Jul 10 02:22:50.231688 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.231487    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-shcs2"
Jul 10 02:22:50.240090 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:50.240060    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc7a2b60_189c_47b9_b320_06f5570cc537.slice/crio-4b474999591f0644b1124a5307b8840fe3283198a0b499bf7d75a81972e3179b WatchSource:0}: Error finding container 4b474999591f0644b1124a5307b8840fe3283198a0b499bf7d75a81972e3179b: Status 404 returned error can't find the container with id 4b474999591f0644b1124a5307b8840fe3283198a0b499bf7d75a81972e3179b
Jul 10 02:22:50.245619 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:50.245588    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb86958_c22a_4c9f_8a28_394ab957d89d.slice/crio-5505c65e90438473904a2c79cdc3e931ffa71c0ef2095133b05e276b938222b6 WatchSource:0}: Error finding container 5505c65e90438473904a2c79cdc3e931ffa71c0ef2095133b05e276b938222b6: Status 404 returned error can't find the container with id 5505c65e90438473904a2c79cdc3e931ffa71c0ef2095133b05e276b938222b6
Jul 10 02:22:50.246521 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.246495    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8fcbt"
Jul 10 02:22:50.254910 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.254640    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl"
Jul 10 02:22:50.260034 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:50.259987    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6dbcad3f_1a69_439e_8a77_08a0a8d1100a.slice/crio-890f4143919cfe332d51942395c647e0cca17e877ad686c0c7193fc12374e68b WatchSource:0}: Error finding container 890f4143919cfe332d51942395c647e0cca17e877ad686c0c7193fc12374e68b: Status 404 returned error can't find the container with id 890f4143919cfe332d51942395c647e0cca17e877ad686c0c7193fc12374e68b
Jul 10 02:22:50.267735 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:50.267701    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60b30e7_d655_4e5a_be69_2d79bcde96f5.slice/crio-e2107aa1f866c8b2d48494b87c6a8ccfaa820f86dd5b7da83503ef17483bea2f WatchSource:0}: Error finding container e2107aa1f866c8b2d48494b87c6a8ccfaa820f86dd5b7da83503ef17483bea2f: Status 404 returned error can't find the container with id e2107aa1f866c8b2d48494b87c6a8ccfaa820f86dd5b7da83503ef17483bea2f
Jul 10 02:22:50.287000 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.286968    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-657wq"
Jul 10 02:22:50.299509 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.299476    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:22:50.303076 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:50.303021    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db8ca5f_40fb_4be3_83ce_77794b9a7a82.slice/crio-03893504eac6544ceb498f02d7514f406632b63d6e546ee3ae8470591812e50b WatchSource:0}: Error finding container 03893504eac6544ceb498f02d7514f406632b63d6e546ee3ae8470591812e50b: Status 404 returned error can't find the container with id 03893504eac6544ceb498f02d7514f406632b63d6e546ee3ae8470591812e50b
Jul 10 02:22:50.309184 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.309148    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mxc72"
Jul 10 02:22:50.310266 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:50.310238    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa2a4ac_bf7e_4b7e_b1ae_322f7886f89e.slice/crio-3ab8f82c7736d15f7866ae26376572dc126152501e8c7b1459a17024d323daab WatchSource:0}: Error finding container 3ab8f82c7736d15f7866ae26376572dc126152501e8c7b1459a17024d323daab: Status 404 returned error can't find the container with id 3ab8f82c7736d15f7866ae26376572dc126152501e8c7b1459a17024d323daab
Jul 10 02:22:50.322909 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:22:50.322880    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc07a04_b6d3_4e2a_8912_c15de0d911d4.slice/crio-33136e154ec2bfef631fa79a275757f57790b9d5dcd8f802e3253f630c9049e4 WatchSource:0}: Error finding container 33136e154ec2bfef631fa79a275757f57790b9d5dcd8f802e3253f630c9049e4: Status 404 returned error can't find the container with id 33136e154ec2bfef631fa79a275757f57790b9d5dcd8f802e3253f630c9049e4
Jul 10 02:22:50.520366 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.520330    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjlx\" (UniqueName: \"kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx\") pod \"network-check-target-24tvp\" (UID: \"ade028b3-e160-4c7a-ad9b-57587da84f17\") " pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:22:50.520558 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.520515    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:22:50.520558 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.520539    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:22:50.520558 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.520553    2553 projected.go:196] Error preparing data for projected volume kube-api-access-4tjlx for pod openshift-network-diagnostics/network-check-target-24tvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:22:50.520687 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.520607    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx podName:ade028b3-e160-4c7a-ad9b-57587da84f17 nodeName:}" failed. No retries permitted until 2026-07-10 02:22:51.520589624 +0000 UTC m=+4.041567937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4tjlx" (UniqueName: "kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx") pod "network-check-target-24tvp" (UID: "ade028b3-e160-4c7a-ad9b-57587da84f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:22:50.621513 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.621430    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:50.621513 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.621483    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:50.621723 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.621606    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:22:50.621723 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.621619    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:22:50.621723 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.621679    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs podName:a6c70eaf-2325-49b0-9841-adc56047391a nodeName:}" failed. No retries permitted until 2026-07-10 02:22:51.621656575 +0000 UTC m=+4.142634865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs") pod "network-metrics-daemon-9hsmb" (UID: "a6c70eaf-2325-49b0-9841-adc56047391a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:22:50.621723 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:50.621698    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret podName:fdf20648-a46e-4896-98b6-56734478f76c nodeName:}" failed. No retries permitted until 2026-07-10 02:22:51.621689855 +0000 UTC m=+4.142668149 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret") pod "global-pull-secret-syncer-lk64x" (UID: "fdf20648-a46e-4896-98b6-56734478f76c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:22:50.998657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:50.998230    2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 02:22:51.003791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.003313    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:22:51.003791 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:51.003456    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:22:51.004021 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.003829    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:51.004021 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:51.003937    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:22:51.031647 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.031605    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl" event={"ID":"f60b30e7-d655-4e5a-be69-2d79bcde96f5","Type":"ContainerStarted","Data":"e2107aa1f866c8b2d48494b87c6a8ccfaa820f86dd5b7da83503ef17483bea2f"}
Jul 10 02:22:51.036630 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.036591    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fcbt" event={"ID":"6dbcad3f-1a69-439e-8a77-08a0a8d1100a","Type":"ContainerStarted","Data":"890f4143919cfe332d51942395c647e0cca17e877ad686c0c7193fc12374e68b"}
Jul 10 02:22:51.041686 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.041651    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cfmmx" event={"ID":"285629fb-127f-4594-889c-5ef466d88885","Type":"ContainerStarted","Data":"37a63c88427130818057e1081aed99a273139a36fe3de3562a50b3a604fa9906"}
Jul 10 02:22:51.043623 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.043586    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mxc72" event={"ID":"acc07a04-b6d3-4e2a-8912-c15de0d911d4","Type":"ContainerStarted","Data":"33136e154ec2bfef631fa79a275757f57790b9d5dcd8f802e3253f630c9049e4"}
Jul 10 02:22:51.049116 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.049085    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-657wq" event={"ID":"3db8ca5f-40fb-4be3-83ce-77794b9a7a82","Type":"ContainerStarted","Data":"03893504eac6544ceb498f02d7514f406632b63d6e546ee3ae8470591812e50b"}
Jul 10 02:22:51.050026 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.049972    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 02:17:50 +0000 UTC" deadline="2027-12-23 16:59:00.554213319 +0000 UTC"
Jul 10 02:22:51.050026 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.050017    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12758h36m9.504202165s"
Jul 10 02:22:51.051616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.051535    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-shcs2" event={"ID":"0eb86958-c22a-4c9f-8a28-394ab957d89d","Type":"ContainerStarted","Data":"5505c65e90438473904a2c79cdc3e931ffa71c0ef2095133b05e276b938222b6"}
Jul 10 02:22:51.053672 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.053643    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n5brp" event={"ID":"cc7a2b60-189c-47b9-b320-06f5570cc537","Type":"ContainerStarted","Data":"4b474999591f0644b1124a5307b8840fe3283198a0b499bf7d75a81972e3179b"}
Jul 10 02:22:51.056251 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.056222    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8q8kj" event={"ID":"8ecc2d80-ce74-4157-916a-523bcd88e568","Type":"ContainerStarted","Data":"ef4e8adacac98cbda1a517b4bf26ac52e728ae3aab4ff38bfeedea87c367aaa7"}
Jul 10 02:22:51.058281 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.058192    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh" event={"ID":"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e","Type":"ContainerStarted","Data":"3ab8f82c7736d15f7866ae26376572dc126152501e8c7b1459a17024d323daab"}
Jul 10 02:22:51.528719 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.528663    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjlx\" (UniqueName: \"kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx\") pod \"network-check-target-24tvp\" (UID: \"ade028b3-e160-4c7a-ad9b-57587da84f17\") " pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:22:51.528912 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:51.528857    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:22:51.528912 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:51.528881    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:22:51.528912 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:51.528894    2553 projected.go:196] Error preparing data for projected volume kube-api-access-4tjlx for pod openshift-network-diagnostics/network-check-target-24tvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:22:51.529114 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:51.528954    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx podName:ade028b3-e160-4c7a-ad9b-57587da84f17 nodeName:}" failed. No retries permitted until 2026-07-10 02:22:53.528936164 +0000 UTC m=+6.049914459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4tjlx" (UniqueName: "kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx") pod "network-check-target-24tvp" (UID: "ade028b3-e160-4c7a-ad9b-57587da84f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:22:51.629402 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.629352    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:51.629588 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:51.629431    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:51.629588 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:51.629580    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:22:51.629701 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:51.629645    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret podName:fdf20648-a46e-4896-98b6-56734478f76c nodeName:}" failed. No retries permitted until 2026-07-10 02:22:53.629626586 +0000 UTC m=+6.150604879 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret") pod "global-pull-secret-syncer-lk64x" (UID: "fdf20648-a46e-4896-98b6-56734478f76c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:22:51.630088 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:51.630062    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:22:51.630166 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:51.630126    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs podName:a6c70eaf-2325-49b0-9841-adc56047391a nodeName:}" failed. No retries permitted until 2026-07-10 02:22:53.630110221 +0000 UTC m=+6.151088515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs") pod "network-metrics-daemon-9hsmb" (UID: "a6c70eaf-2325-49b0-9841-adc56047391a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:22:52.012102 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:52.011511    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:52.012102 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:52.011663    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:22:52.050991 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:52.050894    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 02:17:50 +0000 UTC" deadline="2028-02-12 18:54:47.756156631 +0000 UTC"
Jul 10 02:22:52.050991 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:52.050938    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13984h31m55.705223223s"
Jul 10 02:22:53.003410 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:53.002641    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:53.003410 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:53.002802    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:22:53.003410 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:53.003254    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:22:53.003410 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:53.003358    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:22:53.084064 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:53.083950    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal" event={"ID":"a952e5b6d4e019797a19f89704bcb1d9","Type":"ContainerStarted","Data":"56b5dfff8bfcd94bd86b303f8ec6a126efd244f9b2dd141c40fd87447c51b3ec"}
Jul 10 02:22:53.104752 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:53.104685    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-224.ec2.internal" podStartSLOduration=4.104660842 podStartE2EDuration="4.104660842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:22:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:22:53.10455071 +0000 UTC m=+5.625529039" watchObservedRunningTime="2026-07-10 02:22:53.104660842 +0000 UTC m=+5.625639154"
Jul 10 02:22:53.545834 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:53.545732    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjlx\" (UniqueName: \"kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx\") pod \"network-check-target-24tvp\" (UID: \"ade028b3-e160-4c7a-ad9b-57587da84f17\") " pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:22:53.546030 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:53.545943    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:22:53.546030 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:53.545964    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:22:53.546030 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:53.545978    2553 projected.go:196] Error preparing data for projected volume kube-api-access-4tjlx for pod openshift-network-diagnostics/network-check-target-24tvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:22:53.546221 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:53.546056    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx podName:ade028b3-e160-4c7a-ad9b-57587da84f17 nodeName:}" failed. No retries permitted until 2026-07-10 02:22:57.546037084 +0000 UTC m=+10.067015388 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4tjlx" (UniqueName: "kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx") pod "network-check-target-24tvp" (UID: "ade028b3-e160-4c7a-ad9b-57587da84f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:22:53.646940 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:53.646893    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:53.647168 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:53.646968    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:53.647168 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:53.647133    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:22:53.647293 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:53.647202    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret podName:fdf20648-a46e-4896-98b6-56734478f76c nodeName:}" failed. No retries permitted until 2026-07-10 02:22:57.64718291 +0000 UTC m=+10.168161219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret") pod "global-pull-secret-syncer-lk64x" (UID: "fdf20648-a46e-4896-98b6-56734478f76c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:22:53.647641 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:53.647618    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:22:53.647735 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:53.647677    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs podName:a6c70eaf-2325-49b0-9841-adc56047391a nodeName:}" failed. No retries permitted until 2026-07-10 02:22:57.647661156 +0000 UTC m=+10.168639451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs") pod "network-metrics-daemon-9hsmb" (UID: "a6c70eaf-2325-49b0-9841-adc56047391a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:22:54.003187 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:54.003091    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:54.003367 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:54.003245    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:22:54.090725 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:54.090682    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" event={"ID":"ccf026386246e99d2e23ffb67aaa9db3","Type":"ContainerStarted","Data":"705d0eedbda945dc89462d7d8821933f9a72acb119ce5e638ad499695cfeafce"}
Jul 10 02:22:55.003805 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:55.003328    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:22:55.003805 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:55.003460    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:22:55.003805 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:55.003498    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:55.003805 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:55.003583    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:22:56.007164 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:56.007127    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:56.007757 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:56.007276    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:22:57.003496 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:57.002959    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:57.003496 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:57.003119    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:22:57.003496 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:57.003184    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:22:57.003496 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:57.003269    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:22:57.097493 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:57.097456    2553 generic.go:356] "Generic (PLEG): container finished" podID="ccf026386246e99d2e23ffb67aaa9db3" containerID="705d0eedbda945dc89462d7d8821933f9a72acb119ce5e638ad499695cfeafce" exitCode=0
Jul 10 02:22:57.097827 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:57.097523    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" event={"ID":"ccf026386246e99d2e23ffb67aaa9db3","Type":"ContainerDied","Data":"705d0eedbda945dc89462d7d8821933f9a72acb119ce5e638ad499695cfeafce"}
Jul 10 02:22:57.579817 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:57.579122    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjlx\" (UniqueName: \"kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx\") pod \"network-check-target-24tvp\" (UID: \"ade028b3-e160-4c7a-ad9b-57587da84f17\") " pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:22:57.579817 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:57.579311    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:22:57.579817 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:57.579333    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:22:57.579817 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:57.579347    2553 projected.go:196] Error preparing data for projected volume kube-api-access-4tjlx for pod openshift-network-diagnostics/network-check-target-24tvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:22:57.579817 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:57.579407    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx podName:ade028b3-e160-4c7a-ad9b-57587da84f17 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:05.579388032 +0000 UTC m=+18.100366320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4tjlx" (UniqueName: "kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx") pod "network-check-target-24tvp" (UID: "ade028b3-e160-4c7a-ad9b-57587da84f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:22:57.680353 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:57.680308    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:57.680543 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:57.680391    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:57.680543 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:57.680481    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:22:57.680543 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:57.680522    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:22:57.680702 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:57.680561    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs podName:a6c70eaf-2325-49b0-9841-adc56047391a nodeName:}" failed. No retries permitted until 2026-07-10 02:23:05.68053956 +0000 UTC m=+18.201517847 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs") pod "network-metrics-daemon-9hsmb" (UID: "a6c70eaf-2325-49b0-9841-adc56047391a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:22:57.680702 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:57.680582    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret podName:fdf20648-a46e-4896-98b6-56734478f76c nodeName:}" failed. No retries permitted until 2026-07-10 02:23:05.680572597 +0000 UTC m=+18.201550887 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret") pod "global-pull-secret-syncer-lk64x" (UID: "fdf20648-a46e-4896-98b6-56734478f76c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:22:58.005472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:58.005393    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:22:58.005608 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:58.005498    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:22:59.003467 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:59.003432    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:22:59.003846 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:59.003563    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:22:59.003989 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:22:59.003953    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:22:59.004122 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:22:59.004064    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:00.005974 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:00.005922    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:00.006489 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:00.006073    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:01.002597 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:01.002569    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:01.002714 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:01.002603    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:01.002714 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:01.002679    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:01.002842 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:01.002820    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:02.004197 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.003810    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:02.004197 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:02.004183    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:02.109903 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.109458    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-shcs2" event={"ID":"0eb86958-c22a-4c9f-8a28-394ab957d89d","Type":"ContainerStarted","Data":"5fe461f0f39085ec2d9b2505b71fcb1bfeba69e779287aa93156d022abaf809d"}
Jul 10 02:23:02.111542 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.111504    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n5brp" event={"ID":"cc7a2b60-189c-47b9-b320-06f5570cc537","Type":"ContainerStarted","Data":"f94d4caa8ff6b2c7496f0efa9600139fb6cfc12c683ed36e0eede49621ca1b28"}
Jul 10 02:23:02.113868 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.113839    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8q8kj" event={"ID":"8ecc2d80-ce74-4157-916a-523bcd88e568","Type":"ContainerStarted","Data":"3c393c74b45b0e555d9146a787026d93add2dd327ae442962db8d56aec6b9d07"}
Jul 10 02:23:02.116274 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.116246    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" event={"ID":"ccf026386246e99d2e23ffb67aaa9db3","Type":"ContainerStarted","Data":"e930191060b8deff860622ddd8783bec36c9ff7a3f66dc241e4c31bd94cdc0f6"}
Jul 10 02:23:02.118361 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.118333    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl" event={"ID":"f60b30e7-d655-4e5a-be69-2d79bcde96f5","Type":"ContainerStarted","Data":"d3cb5abb5e9270d3ea331e240b8b1a21fe62b7e7b6ba6336d212762357d2b22e"}
Jul 10 02:23:02.120219 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.120192    2553 generic.go:356] "Generic (PLEG): container finished" podID="6dbcad3f-1a69-439e-8a77-08a0a8d1100a" containerID="045729372ef067721ce0e51ca3ef16fca493e8998bba3f7164992390f046c2de" exitCode=0
Jul 10 02:23:02.120815 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.120793    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fcbt" event={"ID":"6dbcad3f-1a69-439e-8a77-08a0a8d1100a","Type":"ContainerDied","Data":"045729372ef067721ce0e51ca3ef16fca493e8998bba3f7164992390f046c2de"}
Jul 10 02:23:02.122896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.122802    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cfmmx" event={"ID":"285629fb-127f-4594-889c-5ef466d88885","Type":"ContainerStarted","Data":"188397ccacba5236d69d08d60920b13b55be59b09e2a1a46cd57f11d556e1897"}
Jul 10 02:23:02.126223 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.126172    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-shcs2" podStartSLOduration=3.273508491 podStartE2EDuration="14.126154564s" totalImagesPullingTime="10.852646073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:02.125351737 +0000 UTC m=+14.646330047" watchObservedRunningTime="2026-07-10 02:23:02.126154564 +0000 UTC m=+14.647132875"
Jul 10 02:23:02.169466 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.169397    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cfmmx" podStartSLOduration=3.29528796 podStartE2EDuration="14.169377468s" totalImagesPullingTime="10.874089508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:02.142355716 +0000 UTC m=+14.663334025" watchObservedRunningTime="2026-07-10 02:23:02.169377468 +0000 UTC m=+14.690355777"
Jul 10 02:23:02.189608 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.189547    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-224.ec2.internal" podStartSLOduration=13.189525163 podStartE2EDuration="13.189525163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:22:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:02.188677141 +0000 UTC m=+14.709655453" watchObservedRunningTime="2026-07-10 02:23:02.189525163 +0000 UTC m=+14.710503473"
Jul 10 02:23:02.207448 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.207397    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8q8kj" podStartSLOduration=3.325230335 podStartE2EDuration="14.207375715s" totalImagesPullingTime="10.88214538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:02.207153326 +0000 UTC m=+14.728131636" watchObservedRunningTime="2026-07-10 02:23:02.207375715 +0000 UTC m=+14.728354026"
Jul 10 02:23:02.228053 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:02.228007    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n5brp" podStartSLOduration=3.179796971 podStartE2EDuration="14.227991351s" totalImagesPullingTime="11.04819438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:02.227515733 +0000 UTC m=+14.748494042" watchObservedRunningTime="2026-07-10 02:23:02.227991351 +0000 UTC m=+14.748969660"
Jul 10 02:23:03.002983 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:03.002940    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:03.003161 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:03.002994    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:03.003161 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:03.003094    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:03.003255 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:03.003213    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:03.126914 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:03.126850    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-657wq" event={"ID":"3db8ca5f-40fb-4be3-83ce-77794b9a7a82","Type":"ContainerStarted","Data":"75cb1bdcbe56b9fe8aa60e40cb16613fa874fc7818951472dda76b6f087bc8dc"}
Jul 10 02:23:03.144850 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:03.144781    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-657wq" podStartSLOduration=4.340514505 podStartE2EDuration="15.144759597s" totalImagesPullingTime="10.804245092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:03.144359132 +0000 UTC m=+15.665337444" watchObservedRunningTime="2026-07-10 02:23:03.144759597 +0000 UTC m=+15.665737907"
Jul 10 02:23:03.941808 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:03.941765    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8q8kj"
Jul 10 02:23:03.942548 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:03.942519    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8q8kj"
Jul 10 02:23:04.003232 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:04.003182    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:04.003391 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:04.003353    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:04.129499 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:04.129447    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8q8kj"
Jul 10 02:23:04.130157 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:04.130137    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8q8kj"
Jul 10 02:23:05.002669 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:05.002633    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:05.002907 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:05.002633    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:05.002907 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:05.002761    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:05.002907 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:05.002845    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:05.646071 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:05.646042    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjlx\" (UniqueName: \"kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx\") pod \"network-check-target-24tvp\" (UID: \"ade028b3-e160-4c7a-ad9b-57587da84f17\") " pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:05.646650 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:05.646152    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:23:05.646650 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:05.646166    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:23:05.646650 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:05.646175    2553 projected.go:196] Error preparing data for projected volume kube-api-access-4tjlx for pod openshift-network-diagnostics/network-check-target-24tvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:23:05.646650 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:05.646225    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx podName:ade028b3-e160-4c7a-ad9b-57587da84f17 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:21.646208624 +0000 UTC m=+34.167186919 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4tjlx" (UniqueName: "kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx") pod "network-check-target-24tvp" (UID: "ade028b3-e160-4c7a-ad9b-57587da84f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:23:05.747093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:05.747052    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:05.747294 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:05.747142    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:05.747294 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:05.747220    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:23:05.747294 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:05.747244    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:23:05.747434 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:05.747296    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret podName:fdf20648-a46e-4896-98b6-56734478f76c nodeName:}" failed. No retries permitted until 2026-07-10 02:23:21.747274926 +0000 UTC m=+34.268253213 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret") pod "global-pull-secret-syncer-lk64x" (UID: "fdf20648-a46e-4896-98b6-56734478f76c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:23:05.747434 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:05.747318    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs podName:a6c70eaf-2325-49b0-9841-adc56047391a nodeName:}" failed. No retries permitted until 2026-07-10 02:23:21.747308192 +0000 UTC m=+34.268286479 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs") pod "network-metrics-daemon-9hsmb" (UID: "a6c70eaf-2325-49b0-9841-adc56047391a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:23:06.003496 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:06.003414    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:06.003659 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:06.003552    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:07.002851 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:07.002665    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:07.002851 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:07.002834    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:07.003407 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:07.002979    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:07.003407 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:07.003086    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:08.003254 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:08.003224    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:08.003764 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:08.003330    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:09.003266 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:09.003213    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:09.003751 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:09.003351    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:09.003751 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:09.003409    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:09.003751 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:09.003530    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:10.003296 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:10.003258    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:10.003883 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:10.003411    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:11.003012 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:11.002909    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:11.003012 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:11.002975    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:11.003271 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:11.003070    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:11.003271 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:11.003212    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:12.002950 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:12.002912    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:12.003446 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:12.003075    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:12.939187 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:12.939168    2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 02:23:13.000567 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.000485    2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T02:23:12.939184908Z","UUID":"de43ca1b-c767-4674-8b88-3d1249b6c70f","Handler":null,"Name":"","Endpoint":""}
Jul 10 02:23:13.001925 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.001906    2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 02:23:13.002043 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.001943    2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 02:23:13.002433 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.002413    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:13.002433 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.002431    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:13.002571 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:13.002524    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:13.002615 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:13.002583    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:13.150096 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.150062    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mxc72" event={"ID":"acc07a04-b6d3-4e2a-8912-c15de0d911d4","Type":"ContainerStarted","Data":"9e763d9eaf13c2d59398b933a3564bac0ce4a0a72dcda42b1da6c038c24f0310"}
Jul 10 02:23:13.152986 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.152935    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh" event={"ID":"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e","Type":"ContainerStarted","Data":"99d62f3c757fffcfa260042a4ef18dbe1b1ab04f0c00d97fc52ac388f51f8150"}
Jul 10 02:23:13.153149 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.153114    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh" event={"ID":"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e","Type":"ContainerStarted","Data":"d29c0a9e49dcacd550960679622e34fd85defd6722d19be79798332122fda91d"}
Jul 10 02:23:13.153377 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.153353    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh" event={"ID":"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e","Type":"ContainerStarted","Data":"4f79fa1fb836a12ba8a5559d89a9591612e4077f3ba176f5eb705c4f901fdab0"}
Jul 10 02:23:13.153468 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.153434    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh" event={"ID":"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e","Type":"ContainerStarted","Data":"bbc9d431a1c84721db0048f5ef0cb20fc6cd76904578d23e5b2dc3ac634eb817"}
Jul 10 02:23:13.153531 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.153474    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh" event={"ID":"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e","Type":"ContainerStarted","Data":"aeb60d849b12e324f45bfeb63bab0cf4ceb914748bc12d6c872e9047945753a3"}
Jul 10 02:23:13.154847 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.154824    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl" event={"ID":"f60b30e7-d655-4e5a-be69-2d79bcde96f5","Type":"ContainerStarted","Data":"f2493d9799f768a85a04823849b987d7d03453e8879a887bb818c66901b4c0dd"}
Jul 10 02:23:13.156402 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.156383    2553 generic.go:356] "Generic (PLEG): container finished" podID="6dbcad3f-1a69-439e-8a77-08a0a8d1100a" containerID="46d0658d843183d7ee6755af180bca9a7731213b7765856ed92caa7fa8da6d50" exitCode=0
Jul 10 02:23:13.156485 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.156412    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fcbt" event={"ID":"6dbcad3f-1a69-439e-8a77-08a0a8d1100a","Type":"ContainerDied","Data":"46d0658d843183d7ee6755af180bca9a7731213b7765856ed92caa7fa8da6d50"}
Jul 10 02:23:13.168639 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:13.168599    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mxc72" podStartSLOduration=2.317974984 podStartE2EDuration="24.168587094s" totalImagesPullingTime="21.85061211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:13.168442517 +0000 UTC m=+25.689420826" watchObservedRunningTime="2026-07-10 02:23:13.168587094 +0000 UTC m=+25.689565403"
Jul 10 02:23:14.003465 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:14.003425    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:14.003705 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:14.003546    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:14.162114 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:14.162080    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh" event={"ID":"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e","Type":"ContainerStarted","Data":"19c90a2c31c8d82399512730a673b99c594bec288ac1be96a9f08ca9ce72ece1"}
Jul 10 02:23:15.003246 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:15.003164    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:15.003504 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:15.003292    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:15.003504 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:15.003339    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:15.003504 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:15.003427    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:15.165981 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:15.165942    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl" event={"ID":"f60b30e7-d655-4e5a-be69-2d79bcde96f5","Type":"ContainerStarted","Data":"7cabfb3e92053b8ef5ca99f0168f4d685a6ba7bd93d9cce3772fc3d985b91380"}
Jul 10 02:23:15.168061 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:15.168032    2553 generic.go:356] "Generic (PLEG): container finished" podID="6dbcad3f-1a69-439e-8a77-08a0a8d1100a" containerID="bbdcfa0e1566bca79a18a8e75f07e7eeefac3fc35463325be8335b1d7538f855" exitCode=0
Jul 10 02:23:15.168179 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:15.168079    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fcbt" event={"ID":"6dbcad3f-1a69-439e-8a77-08a0a8d1100a","Type":"ContainerDied","Data":"bbdcfa0e1566bca79a18a8e75f07e7eeefac3fc35463325be8335b1d7538f855"}
Jul 10 02:23:15.213693 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:15.213636    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b8nxl" podStartSLOduration=3.767046733 podStartE2EDuration="27.213620031s" totalImagesPullingTime="23.446573298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:22:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:15.185831347 +0000 UTC m=+27.706809655" watchObservedRunningTime="2026-07-10 02:23:15.213620031 +0000 UTC m=+27.734598334"
Jul 10 02:23:16.002895 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:16.002848    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:16.003094 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:16.002999    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:16.173018 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:16.172982    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh" event={"ID":"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e","Type":"ContainerStarted","Data":"9c9202e87909f4480543fa0a02ee952766f45963bda2571eb9c2f7c3650261da"}
Jul 10 02:23:17.003033 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:17.002991    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:17.003033 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:17.003033    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:17.003252 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:17.003102    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:17.003252 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:17.003210    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:17.177926 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:17.177894    2553 generic.go:356] "Generic (PLEG): container finished" podID="6dbcad3f-1a69-439e-8a77-08a0a8d1100a" containerID="74f007c167b0c7d3c1fb58c9ee356b4708b0c63d5dc3caa9797eece120a21c74" exitCode=0
Jul 10 02:23:17.178424 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:17.177935    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fcbt" event={"ID":"6dbcad3f-1a69-439e-8a77-08a0a8d1100a","Type":"ContainerDied","Data":"74f007c167b0c7d3c1fb58c9ee356b4708b0c63d5dc3caa9797eece120a21c74"}
Jul 10 02:23:18.003763 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:18.003581    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:18.003978 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:18.003850    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:18.183981 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:18.183942    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh" event={"ID":"2aa2a4ac-bf7e-4b7e-b1ae-322f7886f89e","Type":"ContainerStarted","Data":"71a6b7d48d179fd8244bb0e5e457bb125bc9db710a1e6e99756ac6f1d642f758"}
Jul 10 02:23:18.184480 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:18.184239    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:23:18.184480 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:18.184322    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:23:18.201974 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:18.201935    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:23:18.215671 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:18.215620    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh" podStartSLOduration=8.310528962 podStartE2EDuration="30.215604943s" totalImagesPullingTime="21.905075981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:18.215151202 +0000 UTC m=+30.736129514" watchObservedRunningTime="2026-07-10 02:23:18.215604943 +0000 UTC m=+30.736583252"
Jul 10 02:23:19.003032 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:19.002993    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:19.003213 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:19.002993    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:19.003213 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:19.003137    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:19.003293 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:19.003209    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:19.186578 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:19.186550    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:23:19.201386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:19.201351    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:23:19.624637 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:19.624605    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9hsmb"]
Jul 10 02:23:19.624856 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:19.624738    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:19.624856 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:19.624833    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:19.628061 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:19.628029    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-24tvp"]
Jul 10 02:23:19.628175 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:19.628134    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:19.628261 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:19.628236    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:19.639125 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:19.639096    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lk64x"]
Jul 10 02:23:19.639255 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:19.639193    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:19.639302 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:19.639284    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:21.002790 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:21.002694    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:21.003236 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:21.002694    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:21.003236 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:21.002805    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:21.003236 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:21.002926    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:21.003236 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:21.002694    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:21.003236 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:21.003070    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:21.661997 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:21.661947    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjlx\" (UniqueName: \"kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx\") pod \"network-check-target-24tvp\" (UID: \"ade028b3-e160-4c7a-ad9b-57587da84f17\") " pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:21.662159 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:21.662121    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 02:23:21.662159 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:21.662144    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 02:23:21.662159 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:21.662156    2553 projected.go:196] Error preparing data for projected volume kube-api-access-4tjlx for pod openshift-network-diagnostics/network-check-target-24tvp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:23:21.662278 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:21.662211    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx podName:ade028b3-e160-4c7a-ad9b-57587da84f17 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:53.662197125 +0000 UTC m=+66.183175415 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4tjlx" (UniqueName: "kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx") pod "network-check-target-24tvp" (UID: "ade028b3-e160-4c7a-ad9b-57587da84f17") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 02:23:21.762629 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:21.762591    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:21.762801 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:21.762643    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:21.762801 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:21.762742    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 02:23:21.762801 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:21.762752    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:23:21.762801 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:21.762802    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret podName:fdf20648-a46e-4896-98b6-56734478f76c nodeName:}" failed. No retries permitted until 2026-07-10 02:23:53.762783528 +0000 UTC m=+66.283761815 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret") pod "global-pull-secret-syncer-lk64x" (UID: "fdf20648-a46e-4896-98b6-56734478f76c") : object "kube-system"/"original-pull-secret" not registered
Jul 10 02:23:21.763018 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:21.762856    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs podName:a6c70eaf-2325-49b0-9841-adc56047391a nodeName:}" failed. No retries permitted until 2026-07-10 02:23:53.762845065 +0000 UTC m=+66.283823367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs") pod "network-metrics-daemon-9hsmb" (UID: "a6c70eaf-2325-49b0-9841-adc56047391a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 02:23:23.003268 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:23.003086    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:23.003694 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:23.003150    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:23.003694 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:23.003360    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:23.003694 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:23.003428    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:23.003694 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:23.003159    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:23.003694 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:23.003571    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:24.201472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:24.201433    2553 generic.go:356] "Generic (PLEG): container finished" podID="6dbcad3f-1a69-439e-8a77-08a0a8d1100a" containerID="88251abbcc6175fe6cbfafd14ba637a69f5176c596b85d6f863c0baab7d8f3a8" exitCode=0
Jul 10 02:23:24.201995 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:24.201491    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fcbt" event={"ID":"6dbcad3f-1a69-439e-8a77-08a0a8d1100a","Type":"ContainerDied","Data":"88251abbcc6175fe6cbfafd14ba637a69f5176c596b85d6f863c0baab7d8f3a8"}
Jul 10 02:23:25.003237 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.003187    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:25.003237 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.003217    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:25.003237 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.003216    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:25.003515 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:25.003292    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lk64x" podUID="fdf20648-a46e-4896-98b6-56734478f76c"
Jul 10 02:23:25.003515 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:25.003393    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9hsmb" podUID="a6c70eaf-2325-49b0-9841-adc56047391a"
Jul 10 02:23:25.003515 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:25.003431    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-24tvp" podUID="ade028b3-e160-4c7a-ad9b-57587da84f17"
Jul 10 02:23:25.206871 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.206830    2553 generic.go:356] "Generic (PLEG): container finished" podID="6dbcad3f-1a69-439e-8a77-08a0a8d1100a" containerID="2ad86ba42a531c9fc0bd941527df56ff836a81eacc2edec5f7b1e861f4040345" exitCode=0
Jul 10 02:23:25.207384 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.206884    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fcbt" event={"ID":"6dbcad3f-1a69-439e-8a77-08a0a8d1100a","Type":"ContainerDied","Data":"2ad86ba42a531c9fc0bd941527df56ff836a81eacc2edec5f7b1e861f4040345"}
Jul 10 02:23:25.765616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.765587    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-224.ec2.internal" event="NodeReady"
Jul 10 02:23:25.765774 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.765702    2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 02:23:25.813069 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.813040    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-clndt"]
Jul 10 02:23:25.824994 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.824918    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2x8wh"]
Jul 10 02:23:25.825420 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.825390    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:25.828402 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.828380    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 02:23:25.828532 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.828415    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qdhtc\""
Jul 10 02:23:25.828532 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.828477    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 02:23:25.838100 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.838041    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-clndt"]
Jul 10 02:23:25.838100 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.838074    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2x8wh"]
Jul 10 02:23:25.838229 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.838177    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2x8wh"
Jul 10 02:23:25.840997 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.840977    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 02:23:25.841119 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.841077    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 02:23:25.841202 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.841183    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c8vpj\""
Jul 10 02:23:25.841258 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.841235    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 02:23:25.995900 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.995859    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n8mt\" (UniqueName: \"kubernetes.io/projected/8c772177-dfc8-4644-b0ea-3373ae628937-kube-api-access-6n8mt\") pod \"ingress-canary-2x8wh\" (UID: \"8c772177-dfc8-4644-b0ea-3373ae628937\") " pod="openshift-ingress-canary/ingress-canary-2x8wh"
Jul 10 02:23:25.996097 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.995924    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88c82cab-f998-4fe1-91de-b6fad16e0241-tmp-dir\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:25.996097 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.996017    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c772177-dfc8-4644-b0ea-3373ae628937-cert\") pod \"ingress-canary-2x8wh\" (UID: \"8c772177-dfc8-4644-b0ea-3373ae628937\") " pod="openshift-ingress-canary/ingress-canary-2x8wh"
Jul 10 02:23:25.996097 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.996057    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88c82cab-f998-4fe1-91de-b6fad16e0241-config-volume\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:25.996097 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.996082    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:25.996226 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:25.996136    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn9pt\" (UniqueName: \"kubernetes.io/projected/88c82cab-f998-4fe1-91de-b6fad16e0241-kube-api-access-rn9pt\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:26.097466 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.097376    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88c82cab-f998-4fe1-91de-b6fad16e0241-config-volume\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:26.097466 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.097417    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:26.097466 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.097446    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn9pt\" (UniqueName: \"kubernetes.io/projected/88c82cab-f998-4fe1-91de-b6fad16e0241-kube-api-access-rn9pt\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:26.097466 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.097468    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n8mt\" (UniqueName: \"kubernetes.io/projected/8c772177-dfc8-4644-b0ea-3373ae628937-kube-api-access-6n8mt\") pod \"ingress-canary-2x8wh\" (UID: \"8c772177-dfc8-4644-b0ea-3373ae628937\") " pod="openshift-ingress-canary/ingress-canary-2x8wh"
Jul 10 02:23:26.097779 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.097502    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88c82cab-f998-4fe1-91de-b6fad16e0241-tmp-dir\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:26.097779 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.097530    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c772177-dfc8-4644-b0ea-3373ae628937-cert\") pod \"ingress-canary-2x8wh\" (UID: \"8c772177-dfc8-4644-b0ea-3373ae628937\") " pod="openshift-ingress-canary/ingress-canary-2x8wh"
Jul 10 02:23:26.097779 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:26.097687    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:23:26.097779 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:26.097754    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls podName:88c82cab-f998-4fe1-91de-b6fad16e0241 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:26.597736352 +0000 UTC m=+39.118714650 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls") pod "dns-default-clndt" (UID: "88c82cab-f998-4fe1-91de-b6fad16e0241") : secret "dns-default-metrics-tls" not found
Jul 10 02:23:26.098015 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.097900    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88c82cab-f998-4fe1-91de-b6fad16e0241-tmp-dir\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:26.098119 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.098100    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/88c82cab-f998-4fe1-91de-b6fad16e0241-config-volume\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:26.101679 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.101653    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c772177-dfc8-4644-b0ea-3373ae628937-cert\") pod \"ingress-canary-2x8wh\" (UID: \"8c772177-dfc8-4644-b0ea-3373ae628937\") " pod="openshift-ingress-canary/ingress-canary-2x8wh"
Jul 10 02:23:26.109533 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.109504    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn9pt\" (UniqueName: \"kubernetes.io/projected/88c82cab-f998-4fe1-91de-b6fad16e0241-kube-api-access-rn9pt\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:26.109705 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.109684    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n8mt\" (UniqueName: \"kubernetes.io/projected/8c772177-dfc8-4644-b0ea-3373ae628937-kube-api-access-6n8mt\") pod \"ingress-canary-2x8wh\" (UID: \"8c772177-dfc8-4644-b0ea-3373ae628937\") " pod="openshift-ingress-canary/ingress-canary-2x8wh"
Jul 10 02:23:26.146760 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.146724    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2x8wh"
Jul 10 02:23:26.213398 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.213364    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8fcbt" event={"ID":"6dbcad3f-1a69-439e-8a77-08a0a8d1100a","Type":"ContainerStarted","Data":"59b434e8c753f06c608a054953000ef80910107ae1d2bc3370974291bdc0258c"}
Jul 10 02:23:26.241005 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.239622    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8fcbt" podStartSLOduration=7.819134486 podStartE2EDuration="38.239601675s" totalImagesPullingTime="30.420467189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:22:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:26.238399238 +0000 UTC m=+38.759377547" watchObservedRunningTime="2026-07-10 02:23:26.239601675 +0000 UTC m=+38.760579988"
Jul 10 02:23:26.320362 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.320161    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2x8wh"]
Jul 10 02:23:26.324026 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:23:26.323990    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c772177_dfc8_4644_b0ea_3373ae628937.slice/crio-3b9e1130d874b2e8516d1d1218c1bfc658c02abdd4ebb489b365ae2e9fcfa273 WatchSource:0}: Error finding container 3b9e1130d874b2e8516d1d1218c1bfc658c02abdd4ebb489b365ae2e9fcfa273: Status 404 returned error can't find the container with id 3b9e1130d874b2e8516d1d1218c1bfc658c02abdd4ebb489b365ae2e9fcfa273
Jul 10 02:23:26.405661 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.405543    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:26.506737 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.506701    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:26.601916 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:26.601875    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:26.602110 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:26.602023    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:23:26.602110 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:26.602100    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls podName:88c82cab-f998-4fe1-91de-b6fad16e0241 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:27.602087014 +0000 UTC m=+40.123065305 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls") pod "dns-default-clndt" (UID: "88c82cab-f998-4fe1-91de-b6fad16e0241") : secret "dns-default-metrics-tls" not found
Jul 10 02:23:27.002557 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:27.002517    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:27.002744 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:27.002540    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:27.002744 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:27.002541    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:27.006285 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:27.006065    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 02:23:27.006285 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:27.006104    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 02:23:27.006285 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:27.006132    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gcczx\""
Jul 10 02:23:27.006285 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:27.006066    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 02:23:27.006285 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:27.006066    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 02:23:27.006616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:27.006427    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4r7lb\""
Jul 10 02:23:27.217375 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:27.217333    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2x8wh" event={"ID":"8c772177-dfc8-4644-b0ea-3373ae628937","Type":"ContainerStarted","Data":"3b9e1130d874b2e8516d1d1218c1bfc658c02abdd4ebb489b365ae2e9fcfa273"}
Jul 10 02:23:27.609497 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:27.609463    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:27.609686 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:27.609649    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:23:27.609740 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:27.609729    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls podName:88c82cab-f998-4fe1-91de-b6fad16e0241 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:29.609705499 +0000 UTC m=+42.130683786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls") pod "dns-default-clndt" (UID: "88c82cab-f998-4fe1-91de-b6fad16e0241") : secret "dns-default-metrics-tls" not found
Jul 10 02:23:28.299586 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.299541    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wqst5"]
Jul 10 02:23:28.330710 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.330680    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"]
Jul 10 02:23:28.330887 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.330825    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wqst5"
Jul 10 02:23:28.334127 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.334036    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 10 02:23:28.334127 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.334107    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-5t748\""
Jul 10 02:23:28.334315 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.334107    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 10 02:23:28.346519 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.346452    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wqst5"]
Jul 10 02:23:28.346646 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.346541    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:28.346713 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.346559    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"]
Jul 10 02:23:28.351186 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.351164    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 02:23:28.351317 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.351165    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 10 02:23:28.351523 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.351487    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 02:23:28.351523 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.351519    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2s7gn\""
Jul 10 02:23:28.351672 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.351634    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 10 02:23:28.397641 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.397606    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"]
Jul 10 02:23:28.416491 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.416450    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vxzb\" (UniqueName: \"kubernetes.io/projected/3a2b6ad9-2ee6-40b0-95d2-eb27870f9380-kube-api-access-4vxzb\") pod \"volume-data-source-validator-78495597f6-wqst5\" (UID: \"3a2b6ad9-2ee6-40b0-95d2-eb27870f9380\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wqst5"
Jul 10 02:23:28.420892 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.420865    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-xx87v"]
Jul 10 02:23:28.421051 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.421009    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:23:28.424344 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.424320    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 10 02:23:28.425300 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.425280    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wcd8m\""
Jul 10 02:23:28.425416 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.425326    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 10 02:23:28.440907 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.440881    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"]
Jul 10 02:23:28.441084 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.440920    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-xx87v"]
Jul 10 02:23:28.441084 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.441028    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.448486 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.448453    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 10 02:23:28.450067 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.450035    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 10 02:23:28.450067 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.450044    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 10 02:23:28.450238 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.450142    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-72kfm\""
Jul 10 02:23:28.450318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.450307    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 10 02:23:28.451198 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.451179    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 10 02:23:28.494574 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.494528    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54684b4666-zv2d2"]
Jul 10 02:23:28.513681 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.513231    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.515783 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.515542    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54684b4666-zv2d2"]
Jul 10 02:23:28.518782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.516958    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtfff\" (UniqueName: \"kubernetes.io/projected/80c914fd-447b-4090-b638-7709ffac5eb4-kube-api-access-dtfff\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:28.518782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.517074    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vxzb\" (UniqueName: \"kubernetes.io/projected/3a2b6ad9-2ee6-40b0-95d2-eb27870f9380-kube-api-access-4vxzb\") pod \"volume-data-source-validator-78495597f6-wqst5\" (UID: \"3a2b6ad9-2ee6-40b0-95d2-eb27870f9380\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wqst5"
Jul 10 02:23:28.518782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.517106    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/80c914fd-447b-4090-b638-7709ffac5eb4-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:28.518782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.517134    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lnqv7\""
Jul 10 02:23:28.518782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.517146    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6666af78-fb87-4de2-83e3-a60d1c902d1a-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8lgvq\" (UID: \"6666af78-fb87-4de2-83e3-a60d1c902d1a\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:23:28.518782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.517179    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8lgvq\" (UID: \"6666af78-fb87-4de2-83e3-a60d1c902d1a\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:23:28.518782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.517239    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:28.518782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.517448    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 02:23:28.518782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.517681    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 10 02:23:28.518782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.517701    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 10 02:23:28.518782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.518385    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 10 02:23:28.518782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.518651    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 02:23:28.519440 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.518987    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 10 02:23:28.529601 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.529571    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vxzb\" (UniqueName: \"kubernetes.io/projected/3a2b6ad9-2ee6-40b0-95d2-eb27870f9380-kube-api-access-4vxzb\") pod \"volume-data-source-validator-78495597f6-wqst5\" (UID: \"3a2b6ad9-2ee6-40b0-95d2-eb27870f9380\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wqst5"
Jul 10 02:23:28.560299 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.560215    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:28.618247 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618208    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8lgvq\" (UID: \"6666af78-fb87-4de2-83e3-a60d1c902d1a\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:23:28.618402 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618258    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.618402 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618300    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/602ea76a-cc86-439b-b144-893cb6d217de-trusted-ca\") pod \"console-operator-7866497494-xx87v\" (UID: \"602ea76a-cc86-439b-b144-893cb6d217de\") " pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.618402 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618336    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:28.618402 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:28.618361    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 02:23:28.618616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618394    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.618616 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:28.618415    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 02:23:28.618616 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:28.618439    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert podName:6666af78-fb87-4de2-83e3-a60d1c902d1a nodeName:}" failed. No retries permitted until 2026-07-10 02:23:29.118417902 +0000 UTC m=+41.639396212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8lgvq" (UID: "6666af78-fb87-4de2-83e3-a60d1c902d1a") : secret "networking-console-plugin-cert" not found
Jul 10 02:23:28.618616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618456    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-stats-auth\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.618616 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:28.618471    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls podName:80c914fd-447b-4090-b638-7709ffac5eb4 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:29.118456118 +0000 UTC m=+41.639434405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-m98mv" (UID: "80c914fd-447b-4090-b638-7709ffac5eb4") : secret "cluster-monitoring-operator-tls" not found
Jul 10 02:23:28.618616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618500    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/602ea76a-cc86-439b-b144-893cb6d217de-config\") pod \"console-operator-7866497494-xx87v\" (UID: \"602ea76a-cc86-439b-b144-893cb6d217de\") " pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.618616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618539    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtfff\" (UniqueName: \"kubernetes.io/projected/80c914fd-447b-4090-b638-7709ffac5eb4-kube-api-access-dtfff\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:28.618616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618567    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/602ea76a-cc86-439b-b144-893cb6d217de-serving-cert\") pod \"console-operator-7866497494-xx87v\" (UID: \"602ea76a-cc86-439b-b144-893cb6d217de\") " pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.618616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618583    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x726m\" (UniqueName: \"kubernetes.io/projected/602ea76a-cc86-439b-b144-893cb6d217de-kube-api-access-x726m\") pod \"console-operator-7866497494-xx87v\" (UID: \"602ea76a-cc86-439b-b144-893cb6d217de\") " pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.618616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618602    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b6fb\" (UniqueName: \"kubernetes.io/projected/449265a9-3f9e-4ef4-aec7-3439a8a67b57-kube-api-access-9b6fb\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.619119 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618631    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/80c914fd-447b-4090-b638-7709ffac5eb4-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:28.619119 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618648    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-default-certificate\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.619119 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.618749    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6666af78-fb87-4de2-83e3-a60d1c902d1a-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8lgvq\" (UID: \"6666af78-fb87-4de2-83e3-a60d1c902d1a\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:23:28.619377 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.619357    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6666af78-fb87-4de2-83e3-a60d1c902d1a-nginx-conf\") pod \"networking-console-plugin-6cf856758c-8lgvq\" (UID: \"6666af78-fb87-4de2-83e3-a60d1c902d1a\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:23:28.619473 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.619453    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/80c914fd-447b-4090-b638-7709ffac5eb4-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:28.627595 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.627571    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtfff\" (UniqueName: \"kubernetes.io/projected/80c914fd-447b-4090-b638-7709ffac5eb4-kube-api-access-dtfff\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:28.643405 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.643358    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wqst5"
Jul 10 02:23:28.672383 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.672353    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:28.719795 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.719762    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/602ea76a-cc86-439b-b144-893cb6d217de-serving-cert\") pod \"console-operator-7866497494-xx87v\" (UID: \"602ea76a-cc86-439b-b144-893cb6d217de\") " pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.719944 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.719810    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x726m\" (UniqueName: \"kubernetes.io/projected/602ea76a-cc86-439b-b144-893cb6d217de-kube-api-access-x726m\") pod \"console-operator-7866497494-xx87v\" (UID: \"602ea76a-cc86-439b-b144-893cb6d217de\") " pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.719944 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.719843    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b6fb\" (UniqueName: \"kubernetes.io/projected/449265a9-3f9e-4ef4-aec7-3439a8a67b57-kube-api-access-9b6fb\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.719944 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.719879    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-default-certificate\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.719944 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.719928    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.720175 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:28.720110    2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 02:23:28.720175 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:28.720171    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs podName:449265a9-3f9e-4ef4-aec7-3439a8a67b57 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:29.220150585 +0000 UTC m=+41.741128886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs") pod "router-default-54684b4666-zv2d2" (UID: "449265a9-3f9e-4ef4-aec7-3439a8a67b57") : secret "router-metrics-certs-default" not found
Jul 10 02:23:28.720284 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.720243    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/602ea76a-cc86-439b-b144-893cb6d217de-trusted-ca\") pod \"console-operator-7866497494-xx87v\" (UID: \"602ea76a-cc86-439b-b144-893cb6d217de\") " pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.720359 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.720342    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.720419 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.720392    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-stats-auth\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.720475 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.720423    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/602ea76a-cc86-439b-b144-893cb6d217de-config\") pod \"console-operator-7866497494-xx87v\" (UID: \"602ea76a-cc86-439b-b144-893cb6d217de\") " pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.720574 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:28.720551    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle podName:449265a9-3f9e-4ef4-aec7-3439a8a67b57 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:29.22053428 +0000 UTC m=+41.741512594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle") pod "router-default-54684b4666-zv2d2" (UID: "449265a9-3f9e-4ef4-aec7-3439a8a67b57") : configmap references non-existent config key: service-ca.crt
Jul 10 02:23:28.721154 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.721129    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/602ea76a-cc86-439b-b144-893cb6d217de-config\") pod \"console-operator-7866497494-xx87v\" (UID: \"602ea76a-cc86-439b-b144-893cb6d217de\") " pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.721520 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.721321    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/602ea76a-cc86-439b-b144-893cb6d217de-trusted-ca\") pod \"console-operator-7866497494-xx87v\" (UID: \"602ea76a-cc86-439b-b144-893cb6d217de\") " pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.723027 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.723007    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-stats-auth\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.723102 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.723041    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/602ea76a-cc86-439b-b144-893cb6d217de-serving-cert\") pod \"console-operator-7866497494-xx87v\" (UID: \"602ea76a-cc86-439b-b144-893cb6d217de\") " pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.723239 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.723220    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-default-certificate\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.732880 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.732857    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b6fb\" (UniqueName: \"kubernetes.io/projected/449265a9-3f9e-4ef4-aec7-3439a8a67b57-kube-api-access-9b6fb\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:28.733029 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.732879    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x726m\" (UniqueName: \"kubernetes.io/projected/602ea76a-cc86-439b-b144-893cb6d217de-kube-api-access-x726m\") pod \"console-operator-7866497494-xx87v\" (UID: \"602ea76a-cc86-439b-b144-893cb6d217de\") " pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.752303 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.752271    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:28.758847 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.758802    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:28.788129 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.788102    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wqst5"]
Jul 10 02:23:28.790665 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:23:28.790641    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2b6ad9_2ee6_40b0_95d2_eb27870f9380.slice/crio-88572c9a57a65d31dc70864f94d21ee4ab3e5113eac27808d0afda65b02492b1 WatchSource:0}: Error finding container 88572c9a57a65d31dc70864f94d21ee4ab3e5113eac27808d0afda65b02492b1: Status 404 returned error can't find the container with id 88572c9a57a65d31dc70864f94d21ee4ab3e5113eac27808d0afda65b02492b1
Jul 10 02:23:28.890787 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:28.890754    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-xx87v"]
Jul 10 02:23:28.962904 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:23:28.962876    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod602ea76a_cc86_439b_b144_893cb6d217de.slice/crio-bc6a33d7f6872cce99046778763332bada6021753bd6a20c64e45b3af23ca48e WatchSource:0}: Error finding container bc6a33d7f6872cce99046778763332bada6021753bd6a20c64e45b3af23ca48e: Status 404 returned error can't find the container with id bc6a33d7f6872cce99046778763332bada6021753bd6a20c64e45b3af23ca48e
Jul 10 02:23:29.124141 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.124112    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8lgvq\" (UID: \"6666af78-fb87-4de2-83e3-a60d1c902d1a\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:23:29.124342 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.124171    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:29.124342 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:29.124260    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 02:23:29.124342 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:29.124293    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 02:23:29.124342 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:29.124334    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert podName:6666af78-fb87-4de2-83e3-a60d1c902d1a nodeName:}" failed. No retries permitted until 2026-07-10 02:23:30.124315755 +0000 UTC m=+42.645294045 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8lgvq" (UID: "6666af78-fb87-4de2-83e3-a60d1c902d1a") : secret "networking-console-plugin-cert" not found
Jul 10 02:23:29.124342 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:29.124348    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls podName:80c914fd-447b-4090-b638-7709ffac5eb4 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:30.12434212 +0000 UTC m=+42.645320406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-m98mv" (UID: "80c914fd-447b-4090-b638-7709ffac5eb4") : secret "cluster-monitoring-operator-tls" not found
Jul 10 02:23:29.223987 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.223935    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2x8wh" event={"ID":"8c772177-dfc8-4644-b0ea-3373ae628937","Type":"ContainerStarted","Data":"6d2e2c4e94fb2cefb2368ca913ba62a22d50db9c5a9a08bf8f807b350617d29a"}
Jul 10 02:23:29.224529 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.224507    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:29.224647 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.224561    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:29.224701 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:29.224659    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle podName:449265a9-3f9e-4ef4-aec7-3439a8a67b57 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:30.224646413 +0000 UTC m=+42.745624716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle") pod "router-default-54684b4666-zv2d2" (UID: "449265a9-3f9e-4ef4-aec7-3439a8a67b57") : configmap references non-existent config key: service-ca.crt
Jul 10 02:23:29.224701 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:29.224664    2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 02:23:29.224792 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:29.224724    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs podName:449265a9-3f9e-4ef4-aec7-3439a8a67b57 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:30.224708404 +0000 UTC m=+42.745686694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs") pod "router-default-54684b4666-zv2d2" (UID: "449265a9-3f9e-4ef4-aec7-3439a8a67b57") : secret "router-metrics-certs-default" not found
Jul 10 02:23:29.225214 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.225190    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xx87v" event={"ID":"602ea76a-cc86-439b-b144-893cb6d217de","Type":"ContainerStarted","Data":"bc6a33d7f6872cce99046778763332bada6021753bd6a20c64e45b3af23ca48e"}
Jul 10 02:23:29.226243 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.226224    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wqst5" event={"ID":"3a2b6ad9-2ee6-40b0-95d2-eb27870f9380","Type":"ContainerStarted","Data":"88572c9a57a65d31dc70864f94d21ee4ab3e5113eac27808d0afda65b02492b1"}
Jul 10 02:23:29.242696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.242638    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2x8wh" podStartSLOduration=1.579034713 podStartE2EDuration="4.24261711s" totalImagesPullingTime="2.663582397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:29.242241871 +0000 UTC m=+41.763220182" watchObservedRunningTime="2026-07-10 02:23:29.24261711 +0000 UTC m=+41.763595420"
Jul 10 02:23:29.553940 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.553901    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:29.618115 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.618080    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:29.628220 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.628189    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:29.628369 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:29.628337    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:23:29.628410 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:29.628393    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls podName:88c82cab-f998-4fe1-91de-b6fad16e0241 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:33.628376993 +0000 UTC m=+46.149355299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls") pod "dns-default-clndt" (UID: "88c82cab-f998-4fe1-91de-b6fad16e0241") : secret "dns-default-metrics-tls" not found
Jul 10 02:23:29.684940 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.684880    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:29.783376 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:29.783342    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:30.132057 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:30.132003    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8lgvq\" (UID: \"6666af78-fb87-4de2-83e3-a60d1c902d1a\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:23:30.132253 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:30.132097    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:30.132253 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:30.132155    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 02:23:30.132253 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:30.132234    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert podName:6666af78-fb87-4de2-83e3-a60d1c902d1a nodeName:}" failed. No retries permitted until 2026-07-10 02:23:32.13221285 +0000 UTC m=+44.653191141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8lgvq" (UID: "6666af78-fb87-4de2-83e3-a60d1c902d1a") : secret "networking-console-plugin-cert" not found
Jul 10 02:23:30.132419 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:30.132255    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 02:23:30.132419 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:30.132315    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls podName:80c914fd-447b-4090-b638-7709ffac5eb4 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:32.132297967 +0000 UTC m=+44.653276254 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-m98mv" (UID: "80c914fd-447b-4090-b638-7709ffac5eb4") : secret "cluster-monitoring-operator-tls" not found
Jul 10 02:23:30.233077 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:30.233044    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:30.233227 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:30.233099    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:30.233227 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:30.233186    2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 02:23:30.233326 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:30.233239    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle podName:449265a9-3f9e-4ef4-aec7-3439a8a67b57 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:32.233222784 +0000 UTC m=+44.754201077 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle") pod "router-default-54684b4666-zv2d2" (UID: "449265a9-3f9e-4ef4-aec7-3439a8a67b57") : configmap references non-existent config key: service-ca.crt
Jul 10 02:23:30.233326 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:30.233265    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs podName:449265a9-3f9e-4ef4-aec7-3439a8a67b57 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:32.23325465 +0000 UTC m=+44.754232954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs") pod "router-default-54684b4666-zv2d2" (UID: "449265a9-3f9e-4ef4-aec7-3439a8a67b57") : secret "router-metrics-certs-default" not found
Jul 10 02:23:31.733289 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:31.732045    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:31.832511 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:31.832481    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:32.152375 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:32.152315    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8lgvq\" (UID: \"6666af78-fb87-4de2-83e3-a60d1c902d1a\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:23:32.152510 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:32.152424    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:32.152510 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:32.152473    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 02:23:32.152647 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:32.152533    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 02:23:32.152647 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:32.152540    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert podName:6666af78-fb87-4de2-83e3-a60d1c902d1a nodeName:}" failed. No retries permitted until 2026-07-10 02:23:36.152523607 +0000 UTC m=+48.673501913 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8lgvq" (UID: "6666af78-fb87-4de2-83e3-a60d1c902d1a") : secret "networking-console-plugin-cert" not found
Jul 10 02:23:32.152647 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:32.152607    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls podName:80c914fd-447b-4090-b638-7709ffac5eb4 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:36.152591266 +0000 UTC m=+48.673569552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-m98mv" (UID: "80c914fd-447b-4090-b638-7709ffac5eb4") : secret "cluster-monitoring-operator-tls" not found
Jul 10 02:23:32.236246 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:32.236201    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xx87v" event={"ID":"602ea76a-cc86-439b-b144-893cb6d217de","Type":"ContainerStarted","Data":"5b335e951d1af56091e9cc24b3eaa9ee5b5174d656ff1624d74c8a7b128ff01a"}
Jul 10 02:23:32.237625 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:32.237597    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wqst5" event={"ID":"3a2b6ad9-2ee6-40b0-95d2-eb27870f9380","Type":"ContainerStarted","Data":"d743296674230b8521a1bb1e0d80da84afeae91f5a23216adddd047a200b6393"}
Jul 10 02:23:32.253797 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:32.253762    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:32.253984 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:32.253830    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:32.253984 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:32.253929    2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 02:23:32.254061 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:32.253990    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle podName:449265a9-3f9e-4ef4-aec7-3439a8a67b57 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:36.253958038 +0000 UTC m=+48.774936326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle") pod "router-default-54684b4666-zv2d2" (UID: "449265a9-3f9e-4ef4-aec7-3439a8a67b57") : configmap references non-existent config key: service-ca.crt
Jul 10 02:23:32.254061 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:32.254007    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs podName:449265a9-3f9e-4ef4-aec7-3439a8a67b57 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:36.253999219 +0000 UTC m=+48.774977505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs") pod "router-default-54684b4666-zv2d2" (UID: "449265a9-3f9e-4ef4-aec7-3439a8a67b57") : secret "router-metrics-certs-default" not found
Jul 10 02:23:32.255841 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:32.255785    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-wqst5" podStartSLOduration=1.480915783 podStartE2EDuration="4.255769416s" totalImagesPullingTime="2.774853633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:32.255023333 +0000 UTC m=+44.776001643" watchObservedRunningTime="2026-07-10 02:23:32.255769416 +0000 UTC m=+44.776747703"
Jul 10 02:23:32.361443 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:32.361256    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:32.864335 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:32.864303    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:33.241477 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:33.241397    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/0.log"
Jul 10 02:23:33.241477 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:33.241436    2553 generic.go:356] "Generic (PLEG): container finished" podID="602ea76a-cc86-439b-b144-893cb6d217de" containerID="5b335e951d1af56091e9cc24b3eaa9ee5b5174d656ff1624d74c8a7b128ff01a" exitCode=255
Jul 10 02:23:33.241697 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:33.241537    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xx87v" event={"ID":"602ea76a-cc86-439b-b144-893cb6d217de","Type":"ContainerDied","Data":"5b335e951d1af56091e9cc24b3eaa9ee5b5174d656ff1624d74c8a7b128ff01a"}
Jul 10 02:23:33.241769 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:33.241754    2553 scope.go:117] "RemoveContainer" containerID="5b335e951d1af56091e9cc24b3eaa9ee5b5174d656ff1624d74c8a7b128ff01a"
Jul 10 02:23:33.528051 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:33.527948    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:33.633811 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:33.633777    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:33.669041 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:33.669004    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:33.669233 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:33.669177    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:23:33.669293 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:33.669255    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls podName:88c82cab-f998-4fe1-91de-b6fad16e0241 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:41.669234086 +0000 UTC m=+54.190212374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls") pod "dns-default-clndt" (UID: "88c82cab-f998-4fe1-91de-b6fad16e0241") : secret "dns-default-metrics-tls" not found
Jul 10 02:23:33.734873 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:33.734830    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:34.245719 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.245691    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/1.log"
Jul 10 02:23:34.246139 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.246094    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/0.log"
Jul 10 02:23:34.246139 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.246126    2553 generic.go:356] "Generic (PLEG): container finished" podID="602ea76a-cc86-439b-b144-893cb6d217de" containerID="964c6b26e3f3e4bc750beea8a7081dc3451dcc69198c8d8f9d5c728983b175a9" exitCode=255
Jul 10 02:23:34.246206 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.246183    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xx87v" event={"ID":"602ea76a-cc86-439b-b144-893cb6d217de","Type":"ContainerDied","Data":"964c6b26e3f3e4bc750beea8a7081dc3451dcc69198c8d8f9d5c728983b175a9"}
Jul 10 02:23:34.246252 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.246239    2553 scope.go:117] "RemoveContainer" containerID="5b335e951d1af56091e9cc24b3eaa9ee5b5174d656ff1624d74c8a7b128ff01a"
Jul 10 02:23:34.246456 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.246433    2553 scope.go:117] "RemoveContainer" containerID="964c6b26e3f3e4bc750beea8a7081dc3451dcc69198c8d8f9d5c728983b175a9"
Jul 10 02:23:34.246622 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:34.246600    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xx87v_openshift-console-operator(602ea76a-cc86-439b-b144-893cb6d217de)\"" pod="openshift-console-operator/console-operator-7866497494-xx87v" podUID="602ea76a-cc86-439b-b144-893cb6d217de"
Jul 10 02:23:34.407256 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.407223    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2bpbm"]
Jul 10 02:23:34.412069 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.412041    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:34.430704 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.430671    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2bpbm"]
Jul 10 02:23:34.430880 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.430780    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.433407 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.433385    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 02:23:34.433853 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.433836    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 02:23:34.433956 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.433943    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 02:23:34.434410 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.434395    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 02:23:34.434503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.434484    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pfnlm\""
Jul 10 02:23:34.492251 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.492219    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:34.576534 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.576501    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f75d5d7c-a255-473b-ae97-a105df6d4db8-data-volume\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.576648 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.576543    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.576648 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.576599    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmjgq\" (UniqueName: \"kubernetes.io/projected/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-api-access-tmjgq\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.576648 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.576619    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f75d5d7c-a255-473b-ae97-a105df6d4db8-crio-socket\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.576648 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.576643    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.678015 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.677981    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmjgq\" (UniqueName: \"kubernetes.io/projected/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-api-access-tmjgq\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.678015 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.678019    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f75d5d7c-a255-473b-ae97-a105df6d4db8-crio-socket\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.678186 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.678132    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.678237 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.678208    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f75d5d7c-a255-473b-ae97-a105df6d4db8-crio-socket\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.678237 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.678225    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f75d5d7c-a255-473b-ae97-a105df6d4db8-data-volume\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.678322 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:34.678254    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 02:23:34.678322 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.678267    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.678322 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:34.678313    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm podName:f75d5d7c-a255-473b-ae97-a105df6d4db8 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:35.178294468 +0000 UTC m=+47.699272767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2bpbm" (UID: "f75d5d7c-a255-473b-ae97-a105df6d4db8") : configmap "kube-rbac-proxy" not found
Jul 10 02:23:34.678452 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:34.678360    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 02:23:34.678452 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:34.678411    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls podName:f75d5d7c-a255-473b-ae97-a105df6d4db8 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:35.178390204 +0000 UTC m=+47.699368491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2bpbm" (UID: "f75d5d7c-a255-473b-ae97-a105df6d4db8") : secret "insights-runtime-extractor-tls" not found
Jul 10 02:23:34.678534 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.678494    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f75d5d7c-a255-473b-ae97-a105df6d4db8-data-volume\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:34.688343 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:34.688320    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmjgq\" (UniqueName: \"kubernetes.io/projected/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-api-access-tmjgq\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:35.093240 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:35.093210    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:35.159589 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:35.159557    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:35.182872 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:35.182826    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:35.183064 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:35.183005    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:35.183064 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:35.183009    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 02:23:35.183200 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:35.183103    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls podName:f75d5d7c-a255-473b-ae97-a105df6d4db8 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:36.183080087 +0000 UTC m=+48.704058394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2bpbm" (UID: "f75d5d7c-a255-473b-ae97-a105df6d4db8") : secret "insights-runtime-extractor-tls" not found
Jul 10 02:23:35.183200 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:35.183105    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 02:23:35.183200 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:35.183144    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm podName:f75d5d7c-a255-473b-ae97-a105df6d4db8 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:36.183133625 +0000 UTC m=+48.704111914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2bpbm" (UID: "f75d5d7c-a255-473b-ae97-a105df6d4db8") : configmap "kube-rbac-proxy" not found
Jul 10 02:23:35.250392 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:35.250361    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/1.log"
Jul 10 02:23:35.250793 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:35.250687    2553 scope.go:117] "RemoveContainer" containerID="964c6b26e3f3e4bc750beea8a7081dc3451dcc69198c8d8f9d5c728983b175a9"
Jul 10 02:23:35.250950 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:35.250843    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xx87v_openshift-console-operator(602ea76a-cc86-439b-b144-893cb6d217de)\"" pod="openshift-console-operator/console-operator-7866497494-xx87v" podUID="602ea76a-cc86-439b-b144-893cb6d217de"
Jul 10 02:23:35.665180 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:35.665147    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:35.752655 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:35.752623    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:36.103612 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.103586    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:36.166861 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.166821    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:36.191122 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.191092    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:36.191246 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.191168    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8lgvq\" (UID: \"6666af78-fb87-4de2-83e3-a60d1c902d1a\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:23:36.191246 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:36.191219    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 02:23:36.191246 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.191222    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:36.191387 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.191263    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:36.191387 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:36.191279    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm podName:f75d5d7c-a255-473b-ae97-a105df6d4db8 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:38.191261653 +0000 UTC m=+50.712239954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2bpbm" (UID: "f75d5d7c-a255-473b-ae97-a105df6d4db8") : configmap "kube-rbac-proxy" not found
Jul 10 02:23:36.191387 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:36.191337    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 02:23:36.191516 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:36.191397    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 02:23:36.191516 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:36.191412    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert podName:6666af78-fb87-4de2-83e3-a60d1c902d1a nodeName:}" failed. No retries permitted until 2026-07-10 02:23:44.191391974 +0000 UTC m=+56.712370262 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8lgvq" (UID: "6666af78-fb87-4de2-83e3-a60d1c902d1a") : secret "networking-console-plugin-cert" not found
Jul 10 02:23:36.191516 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:36.191345    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 02:23:36.191516 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:36.191437    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls podName:80c914fd-447b-4090-b638-7709ffac5eb4 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:44.191424964 +0000 UTC m=+56.712403251 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-m98mv" (UID: "80c914fd-447b-4090-b638-7709ffac5eb4") : secret "cluster-monitoring-operator-tls" not found
Jul 10 02:23:36.191516 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:36.191508    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls podName:f75d5d7c-a255-473b-ae97-a105df6d4db8 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:38.191493981 +0000 UTC m=+50.712472273 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2bpbm" (UID: "f75d5d7c-a255-473b-ae97-a105df6d4db8") : secret "insights-runtime-extractor-tls" not found
Jul 10 02:23:36.291885 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.291845    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:36.292354 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.292004    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:36.292354 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:36.292040    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle podName:449265a9-3f9e-4ef4-aec7-3439a8a67b57 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:44.292024218 +0000 UTC m=+56.813002505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle") pod "router-default-54684b4666-zv2d2" (UID: "449265a9-3f9e-4ef4-aec7-3439a8a67b57") : configmap references non-existent config key: service-ca.crt
Jul 10 02:23:36.292354 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:36.292113    2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 02:23:36.292354 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:36.292167    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs podName:449265a9-3f9e-4ef4-aec7-3439a8a67b57 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:44.292152371 +0000 UTC m=+56.813130660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs") pod "router-default-54684b4666-zv2d2" (UID: "449265a9-3f9e-4ef4-aec7-3439a8a67b57") : secret "router-metrics-certs-default" not found
Jul 10 02:23:36.381415 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.381332    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:36.481647 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.481615    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:36.567684 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.567659    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-shcs2_0eb86958-c22a-4c9f-8a28-394ab957d89d/dns-node-resolver/0.log"
Jul 10 02:23:36.699231 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.699150    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:36.796062 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:36.796030    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:37.167810 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:37.167785    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cfmmx_285629fb-127f-4594-889c-5ef466d88885/node-ca/0.log"
Jul 10 02:23:37.474401 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:37.474325    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:37.544194 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:37.544163    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:37.969748 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:37.969718    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2x8wh_8c772177-dfc8-4644-b0ea-3373ae628937/serve-healthcheck-canary/0.log"
Jul 10 02:23:38.035336 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:38.035303    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:38.137071 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:38.137037    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:38.207171 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:38.207137    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:38.207324 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:38.207201    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:38.207324 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:38.207270    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 02:23:38.207324 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:38.207281    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 02:23:38.207324 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:38.207322    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm podName:f75d5d7c-a255-473b-ae97-a105df6d4db8 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:42.207308784 +0000 UTC m=+54.728287070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2bpbm" (UID: "f75d5d7c-a255-473b-ae97-a105df6d4db8") : configmap "kube-rbac-proxy" not found
Jul 10 02:23:38.207470 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:38.207335    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls podName:f75d5d7c-a255-473b-ae97-a105df6d4db8 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:42.207328718 +0000 UTC m=+54.728307005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2bpbm" (UID: "f75d5d7c-a255-473b-ae97-a105df6d4db8") : secret "insights-runtime-extractor-tls" not found
Jul 10 02:23:38.753254 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:38.753214    2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:38.753653 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:38.753296    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:38.753653 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:38.753628    2553 scope.go:117] "RemoveContainer" containerID="964c6b26e3f3e4bc750beea8a7081dc3451dcc69198c8d8f9d5c728983b175a9"
Jul 10 02:23:38.753776 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:38.753762    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-xx87v_openshift-console-operator(602ea76a-cc86-439b-b144-893cb6d217de)\"" pod="openshift-console-operator/console-operator-7866497494-xx87v" podUID="602ea76a-cc86-439b-b144-893cb6d217de"
Jul 10 02:23:39.205637 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:39.205608    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:41.498979 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:41.498929    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:41.735534 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:41.735498    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:41.735691 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:41.735669    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 02:23:41.735774 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:41.735750    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls podName:88c82cab-f998-4fe1-91de-b6fad16e0241 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:57.735730032 +0000 UTC m=+70.256708319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls") pod "dns-default-clndt" (UID: "88c82cab-f998-4fe1-91de-b6fad16e0241") : secret "dns-default-metrics-tls" not found
Jul 10 02:23:42.239475 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:42.239421    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:42.239751 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:42.239549    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 02:23:42.239751 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:42.239561    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:42.239751 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:42.239619    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm podName:f75d5d7c-a255-473b-ae97-a105df6d4db8 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:50.239600128 +0000 UTC m=+62.760578448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2bpbm" (UID: "f75d5d7c-a255-473b-ae97-a105df6d4db8") : configmap "kube-rbac-proxy" not found
Jul 10 02:23:42.239751 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:42.239687    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 02:23:42.239751 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:42.239728    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls podName:f75d5d7c-a255-473b-ae97-a105df6d4db8 nodeName:}" failed. No retries permitted until 2026-07-10 02:23:50.239716432 +0000 UTC m=+62.760694739 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2bpbm" (UID: "f75d5d7c-a255-473b-ae97-a105df6d4db8") : secret "insights-runtime-extractor-tls" not found
Jul 10 02:23:42.650286 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:42.650260    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:42.751170 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:42.751140    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:42.851295 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:42.851263    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:42.952023 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:42.951935    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:43.947235 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:43.947202    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:44.257946 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:44.257841    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8lgvq\" (UID: \"6666af78-fb87-4de2-83e3-a60d1c902d1a\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:23:44.257946 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:44.257918    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:23:44.258153 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:44.258008    2553 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 10 02:23:44.258153 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:44.258021    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 02:23:44.258153 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:44.258079    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls podName:80c914fd-447b-4090-b638-7709ffac5eb4 nodeName:}" failed. No retries permitted until 2026-07-10 02:24:00.258063194 +0000 UTC m=+72.779041481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-m98mv" (UID: "80c914fd-447b-4090-b638-7709ffac5eb4") : secret "cluster-monitoring-operator-tls" not found
Jul 10 02:23:44.258153 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:44.258091    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert podName:6666af78-fb87-4de2-83e3-a60d1c902d1a nodeName:}" failed. No retries permitted until 2026-07-10 02:24:00.258085321 +0000 UTC m=+72.779063607 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-8lgvq" (UID: "6666af78-fb87-4de2-83e3-a60d1c902d1a") : secret "networking-console-plugin-cert" not found
Jul 10 02:23:44.348178 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:44.348144    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:44.359243 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:44.359213    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:44.359344 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:44.359280    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:23:44.359405 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:44.359373    2553 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 10 02:23:44.359457 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:44.359448    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs podName:449265a9-3f9e-4ef4-aec7-3439a8a67b57 nodeName:}" failed. No retries permitted until 2026-07-10 02:24:00.35943174 +0000 UTC m=+72.880410027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs") pod "router-default-54684b4666-zv2d2" (UID: "449265a9-3f9e-4ef4-aec7-3439a8a67b57") : secret "router-metrics-certs-default" not found
Jul 10 02:23:44.359511 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:44.359463    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle podName:449265a9-3f9e-4ef4-aec7-3439a8a67b57 nodeName:}" failed. No retries permitted until 2026-07-10 02:24:00.359456296 +0000 UTC m=+72.880434583 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle") pod "router-default-54684b4666-zv2d2" (UID: "449265a9-3f9e-4ef4-aec7-3439a8a67b57") : configmap references non-existent config key: service-ca.crt
Jul 10 02:23:44.545644 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:44.545607    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:44.749273 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:44.749240    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:44.950588 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:44.950516    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:45.179741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:45.179712    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:46.095531 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:46.095491    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:46.192582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:46.192550    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:46.342584 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:46.342553    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:46.442132 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:46.442051    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:46.545060 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:46.545026    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:46.747777 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:46.747693    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:46.948500 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:46.948470    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:47.020746 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:47.020666    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:47.545605 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:47.545572    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:48.141706 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:48.141672    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:48.346281 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:48.346246    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:48.541850 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:48.541822    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:48.741232 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:48.741197    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:48.948650 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:48.947583    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:49.008072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:49.008035    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:50.137857 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:50.137825    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:50.308153 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:50.308117    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:50.308326 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:50.308211    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:50.308326 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:50.308280    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 02:23:50.308396 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:50.308345    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls podName:f75d5d7c-a255-473b-ae97-a105df6d4db8 nodeName:}" failed. No retries permitted until 2026-07-10 02:24:06.308329253 +0000 UTC m=+78.829307753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2bpbm" (UID: "f75d5d7c-a255-473b-ae97-a105df6d4db8") : secret "insights-runtime-extractor-tls" not found
Jul 10 02:23:50.308752 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:50.308733    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f75d5d7c-a255-473b-ae97-a105df6d4db8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:23:50.345927 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:50.345890    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:50.544156 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:50.544128    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:50.764361 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:50.764330    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:50.943745 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:50.943657    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:51.202824 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:51.202751    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tjwhh"
Jul 10 02:23:52.143409 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:52.143371    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:52.341887 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:52.341853    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:52.472981 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:52.472880    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:52.572612 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:52.572579    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:52.672979 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:52.672931    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:52.772913 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:52.772847    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:52.939914 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:52.939884    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:53.003566 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.003539    2553 scope.go:117] "RemoveContainer" containerID="964c6b26e3f3e4bc750beea8a7081dc3451dcc69198c8d8f9d5c728983b175a9"
Jul 10 02:23:53.294271 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.294196    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:23:53.294625 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.294611    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/1.log"
Jul 10 02:23:53.294680 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.294642    2553 generic.go:356] "Generic (PLEG): container finished" podID="602ea76a-cc86-439b-b144-893cb6d217de" containerID="609927a5420fecb68146879c1836d51e2abfd2a2e0cc448bea1529b7b82cebd8" exitCode=255
Jul 10 02:23:53.294715 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.294695    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xx87v" event={"ID":"602ea76a-cc86-439b-b144-893cb6d217de","Type":"ContainerDied","Data":"609927a5420fecb68146879c1836d51e2abfd2a2e0cc448bea1529b7b82cebd8"}
Jul 10 02:23:53.294749 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.294741    2553 scope.go:117] "RemoveContainer" containerID="964c6b26e3f3e4bc750beea8a7081dc3451dcc69198c8d8f9d5c728983b175a9"
Jul 10 02:23:53.295088 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.295072    2553 scope.go:117] "RemoveContainer" containerID="609927a5420fecb68146879c1836d51e2abfd2a2e0cc448bea1529b7b82cebd8"
Jul 10 02:23:53.295250 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:53.295231    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-xx87v_openshift-console-operator(602ea76a-cc86-439b-b144-893cb6d217de)\"" pod="openshift-console-operator/console-operator-7866497494-xx87v" podUID="602ea76a-cc86-439b-b144-893cb6d217de"
Jul 10 02:23:53.340141 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.340078    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:23:53.737919 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.737828    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tjlx\" (UniqueName: \"kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx\") pod \"network-check-target-24tvp\" (UID: \"ade028b3-e160-4c7a-ad9b-57587da84f17\") " pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:53.740723 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.740702    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 02:23:53.750660 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.750640    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 02:23:53.761291 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.761258    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tjlx\" (UniqueName: \"kubernetes.io/projected/ade028b3-e160-4c7a-ad9b-57587da84f17-kube-api-access-4tjlx\") pod \"network-check-target-24tvp\" (UID: \"ade028b3-e160-4c7a-ad9b-57587da84f17\") " pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:53.838581 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.838545    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:53.838773 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.838591    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:53.841484 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.841466    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 02:23:53.842282 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.842266    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 02:23:53.851426 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.851405    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6c70eaf-2325-49b0-9841-adc56047391a-metrics-certs\") pod \"network-metrics-daemon-9hsmb\" (UID: \"a6c70eaf-2325-49b0-9841-adc56047391a\") " pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:53.851517 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:53.851451    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fdf20648-a46e-4896-98b6-56734478f76c-original-pull-secret\") pod \"global-pull-secret-syncer-lk64x\" (UID: \"fdf20648-a46e-4896-98b6-56734478f76c\") " pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:54.015180 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:54.015088    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lk64x"
Jul 10 02:23:54.025135 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:54.025112    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4r7lb\""
Jul 10 02:23:54.030946 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:54.030925    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gcczx\""
Jul 10 02:23:54.032833 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:54.032819    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:54.039159 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:54.039146    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9hsmb"
Jul 10 02:23:54.199575 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:23:54.199543    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf20648_a46e_4896_98b6_56734478f76c.slice/crio-35f6568f82178ccdf09181dcd3535992a40d0a1b1bf10d06f38465c42fd102f2 WatchSource:0}: Error finding container 35f6568f82178ccdf09181dcd3535992a40d0a1b1bf10d06f38465c42fd102f2: Status 404 returned error can't find the container with id 35f6568f82178ccdf09181dcd3535992a40d0a1b1bf10d06f38465c42fd102f2
Jul 10 02:23:54.207091 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:54.207069    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lk64x"]
Jul 10 02:23:54.214777 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:54.214752    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-24tvp"]
Jul 10 02:23:54.217385 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:23:54.217363    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podade028b3_e160_4c7a_ad9b_57587da84f17.slice/crio-6623c6d6f05bf2d56db6db1cfe01ee6e928cc18aad73970b0e8e41fa8dacb030 WatchSource:0}: Error finding container 6623c6d6f05bf2d56db6db1cfe01ee6e928cc18aad73970b0e8e41fa8dacb030: Status 404 returned error can't find the container with id 6623c6d6f05bf2d56db6db1cfe01ee6e928cc18aad73970b0e8e41fa8dacb030
Jul 10 02:23:54.249677 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:54.249643    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9hsmb"]
Jul 10 02:23:54.252621 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:23:54.252589    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c70eaf_2325_49b0_9841_adc56047391a.slice/crio-17cf3b8eb8b4d657ddb3614bdb39f0c7c8cc0ab5545e9d52c686583d1984ad3f WatchSource:0}: Error finding container 17cf3b8eb8b4d657ddb3614bdb39f0c7c8cc0ab5545e9d52c686583d1984ad3f: Status 404 returned error can't find the container with id 17cf3b8eb8b4d657ddb3614bdb39f0c7c8cc0ab5545e9d52c686583d1984ad3f
Jul 10 02:23:54.298361 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:54.298325    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lk64x" event={"ID":"fdf20648-a46e-4896-98b6-56734478f76c","Type":"ContainerStarted","Data":"35f6568f82178ccdf09181dcd3535992a40d0a1b1bf10d06f38465c42fd102f2"}
Jul 10 02:23:54.299817 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:54.299798    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:23:54.301014 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:54.300988    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-24tvp" event={"ID":"ade028b3-e160-4c7a-ad9b-57587da84f17","Type":"ContainerStarted","Data":"6623c6d6f05bf2d56db6db1cfe01ee6e928cc18aad73970b0e8e41fa8dacb030"}
Jul 10 02:23:54.302022 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:54.302003    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9hsmb" event={"ID":"a6c70eaf-2325-49b0-9841-adc56047391a","Type":"ContainerStarted","Data":"17cf3b8eb8b4d657ddb3614bdb39f0c7c8cc0ab5545e9d52c686583d1984ad3f"}
Jul 10 02:23:56.309702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:56.309660    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9hsmb" event={"ID":"a6c70eaf-2325-49b0-9841-adc56047391a","Type":"ContainerStarted","Data":"3843db740280984c281e797ef0bf8d619553786b7f06667b9981f4278e439f7c"}
Jul 10 02:23:56.310183 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:56.309721    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9hsmb" event={"ID":"a6c70eaf-2325-49b0-9841-adc56047391a","Type":"ContainerStarted","Data":"f125bbec97043575abb3b021d7b0ec995e3e48897f3f80760f11365d3c05ae7b"}
Jul 10 02:23:56.329155 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:56.329097    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9hsmb" podStartSLOduration=66.936505259 podStartE2EDuration="1m8.329074215s" totalImagesPullingTime="1.392568956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:56.329038333 +0000 UTC m=+68.850016653" watchObservedRunningTime="2026-07-10 02:23:56.329074215 +0000 UTC m=+68.850052526"
Jul 10 02:23:57.773020 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:57.772977    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:57.775648 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:57.775617    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/88c82cab-f998-4fe1-91de-b6fad16e0241-metrics-tls\") pod \"dns-default-clndt\" (UID: \"88c82cab-f998-4fe1-91de-b6fad16e0241\") " pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:57.937675 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:57.937632    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qdhtc\""
Jul 10 02:23:57.945105 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:57.945074    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-clndt"
Jul 10 02:23:58.752989 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:58.752943    2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:58.753182 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:58.753019    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:23:58.753386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:58.753369    2553 scope.go:117] "RemoveContainer" containerID="609927a5420fecb68146879c1836d51e2abfd2a2e0cc448bea1529b7b82cebd8"
Jul 10 02:23:58.753583 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:23:58.753563    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-xx87v_openshift-console-operator(602ea76a-cc86-439b-b144-893cb6d217de)\"" pod="openshift-console-operator/console-operator-7866497494-xx87v" podUID="602ea76a-cc86-439b-b144-893cb6d217de"
Jul 10 02:23:59.215357 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:59.215327    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-clndt"]
Jul 10 02:23:59.218949 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:23:59.218925    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c82cab_f998_4fe1_91de_b6fad16e0241.slice/crio-65e2a80d733ffa942377688d0c562690352b28fc6b41838ccfb1013e9430ddec WatchSource:0}: Error finding container 65e2a80d733ffa942377688d0c562690352b28fc6b41838ccfb1013e9430ddec: Status 404 returned error can't find the container with id 65e2a80d733ffa942377688d0c562690352b28fc6b41838ccfb1013e9430ddec
Jul 10 02:23:59.326234 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:59.326185    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-24tvp" event={"ID":"ade028b3-e160-4c7a-ad9b-57587da84f17","Type":"ContainerStarted","Data":"4ce7798c063953745149ebd494cf708d954e85d0790315f33422e800304ce20e"}
Jul 10 02:23:59.326437 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:59.326330    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:23:59.327430 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:59.327401    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-clndt" event={"ID":"88c82cab-f998-4fe1-91de-b6fad16e0241","Type":"ContainerStarted","Data":"65e2a80d733ffa942377688d0c562690352b28fc6b41838ccfb1013e9430ddec"}
Jul 10 02:23:59.328987 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:59.328944    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lk64x" event={"ID":"fdf20648-a46e-4896-98b6-56734478f76c","Type":"ContainerStarted","Data":"1ac8031a83948af79c75d489a16b1eacc7820aee00cf0430b4e82b0e3d1d37ca"}
Jul 10 02:23:59.346570 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:59.346473    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-24tvp" podStartSLOduration=66.478898442 podStartE2EDuration="1m11.346458705s" totalImagesPullingTime="4.867560263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:59.345847926 +0000 UTC m=+71.866826234" watchObservedRunningTime="2026-07-10 02:23:59.346458705 +0000 UTC m=+71.867437014"
Jul 10 02:23:59.363881 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:23:59.363829    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lk64x" podStartSLOduration=65.466147368 podStartE2EDuration="1m10.36381472s" totalImagesPullingTime="4.897667352s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:23:59.362955895 +0000 UTC m=+71.883934204" watchObservedRunningTime="2026-07-10 02:23:59.36381472 +0000 UTC m=+71.884793028"
Jul 10 02:24:00.293185 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.293146    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:24:00.293718 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.293243    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8lgvq\" (UID: \"6666af78-fb87-4de2-83e3-a60d1c902d1a\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:24:00.296423 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.296395    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/80c914fd-447b-4090-b638-7709ffac5eb4-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-m98mv\" (UID: \"80c914fd-447b-4090-b638-7709ffac5eb4\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:24:00.296423 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.296409    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6666af78-fb87-4de2-83e3-a60d1c902d1a-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-8lgvq\" (UID: \"6666af78-fb87-4de2-83e3-a60d1c902d1a\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:24:00.394666 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.394626    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:24:00.394843 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.394705    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:24:00.395467 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.395439    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/449265a9-3f9e-4ef4-aec7-3439a8a67b57-service-ca-bundle\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:24:00.397341 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.397319    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/449265a9-3f9e-4ef4-aec7-3439a8a67b57-metrics-certs\") pod \"router-default-54684b4666-zv2d2\" (UID: \"449265a9-3f9e-4ef4-aec7-3439a8a67b57\") " pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:24:00.461336 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.461302    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-2s7gn\""
Jul 10 02:24:00.468575 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.468547    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"
Jul 10 02:24:00.534685 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.534656    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wcd8m\""
Jul 10 02:24:00.543032 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.542994    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"
Jul 10 02:24:00.628436 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.628410    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lnqv7\""
Jul 10 02:24:00.635869 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.635840    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:24:00.760379 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.760348    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv"]
Jul 10 02:24:00.763418 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:00.763382    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80c914fd_447b_4090_b638_7709ffac5eb4.slice/crio-72877cda3a5f94866d9560d304b90ff2451acbd7d9892beddf7afed89b8fbeb9 WatchSource:0}: Error finding container 72877cda3a5f94866d9560d304b90ff2451acbd7d9892beddf7afed89b8fbeb9: Status 404 returned error can't find the container with id 72877cda3a5f94866d9560d304b90ff2451acbd7d9892beddf7afed89b8fbeb9
Jul 10 02:24:00.768167 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.768145    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-8lgvq"]
Jul 10 02:24:00.770449 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:00.770423    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6666af78_fb87_4de2_83e3_a60d1c902d1a.slice/crio-66f930b5d6bb7d42ad82c575d86ecb6b5135f2f6c0203dc8dee5da02acc6047a WatchSource:0}: Error finding container 66f930b5d6bb7d42ad82c575d86ecb6b5135f2f6c0203dc8dee5da02acc6047a: Status 404 returned error can't find the container with id 66f930b5d6bb7d42ad82c575d86ecb6b5135f2f6c0203dc8dee5da02acc6047a
Jul 10 02:24:00.805770 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:00.805694    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54684b4666-zv2d2"]
Jul 10 02:24:00.810553 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:00.810526    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod449265a9_3f9e_4ef4_aec7_3439a8a67b57.slice/crio-b7df57d1c9aa06884bd87765cbe33103b7acc5ab204e78638ef6397ec99c39b0 WatchSource:0}: Error finding container b7df57d1c9aa06884bd87765cbe33103b7acc5ab204e78638ef6397ec99c39b0: Status 404 returned error can't find the container with id b7df57d1c9aa06884bd87765cbe33103b7acc5ab204e78638ef6397ec99c39b0
Jul 10 02:24:01.337132 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.337098    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54684b4666-zv2d2" event={"ID":"449265a9-3f9e-4ef4-aec7-3439a8a67b57","Type":"ContainerStarted","Data":"c76e3c17382ad917a90083293c15231e48046530447427f7294c1013fe037b46"}
Jul 10 02:24:01.337512 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.337153    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54684b4666-zv2d2" event={"ID":"449265a9-3f9e-4ef4-aec7-3439a8a67b57","Type":"ContainerStarted","Data":"b7df57d1c9aa06884bd87765cbe33103b7acc5ab204e78638ef6397ec99c39b0"}
Jul 10 02:24:01.338820 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.338789    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-clndt" event={"ID":"88c82cab-f998-4fe1-91de-b6fad16e0241","Type":"ContainerStarted","Data":"a850eb18087e51ef4f347eeef5ac263d3eef28829dca2677e3304618374393cf"}
Jul 10 02:24:01.338977 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.338844    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-clndt" event={"ID":"88c82cab-f998-4fe1-91de-b6fad16e0241","Type":"ContainerStarted","Data":"a109120bfdbf178232d70f53afc062143f749e1b4f37b71934b13ae8a569843f"}
Jul 10 02:24:01.338977 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.338919    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-clndt"
Jul 10 02:24:01.339945 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.339923    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv" event={"ID":"80c914fd-447b-4090-b638-7709ffac5eb4","Type":"ContainerStarted","Data":"72877cda3a5f94866d9560d304b90ff2451acbd7d9892beddf7afed89b8fbeb9"}
Jul 10 02:24:01.341169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.341141    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq" event={"ID":"6666af78-fb87-4de2-83e3-a60d1c902d1a","Type":"ContainerStarted","Data":"66f930b5d6bb7d42ad82c575d86ecb6b5135f2f6c0203dc8dee5da02acc6047a"}
Jul 10 02:24:01.359948 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.359902    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54684b4666-zv2d2" podStartSLOduration=33.359883378 podStartE2EDuration="33.359883378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:23:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:01.358911842 +0000 UTC m=+73.879890152" watchObservedRunningTime="2026-07-10 02:24:01.359883378 +0000 UTC m=+73.880861689"
Jul 10 02:24:01.379341 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.379283    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-clndt" podStartSLOduration=34.942903685 podStartE2EDuration="36.379263321s" totalImagesPullingTime="1.436359636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:01.3789579 +0000 UTC m=+73.899936209" watchObservedRunningTime="2026-07-10 02:24:01.379263321 +0000 UTC m=+73.900241632"
Jul 10 02:24:01.636768 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.636673    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:24:01.639711 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.639681    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:24:01.884801 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.884767    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"]
Jul 10 02:24:01.890879 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.890808    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:01.893997 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.893688    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 10 02:24:01.893997 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.893746    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 10 02:24:01.893997 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.893801    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 10 02:24:01.893997 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.893749    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 10 02:24:01.906877 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:01.904330    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"]
Jul 10 02:24:02.003428 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.003390    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:02.007549 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.007514    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78b69aa5-d016-4bbb-ab57-841df4c9970c-klusterlet-config\") pod \"klusterlet-addon-workmgr-778754d76-64trp\" (UID: \"78b69aa5-d016-4bbb-ab57-841df4c9970c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:02.007717 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.007578    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftcxf\" (UniqueName: \"kubernetes.io/projected/78b69aa5-d016-4bbb-ab57-841df4c9970c-kube-api-access-ftcxf\") pod \"klusterlet-addon-workmgr-778754d76-64trp\" (UID: \"78b69aa5-d016-4bbb-ab57-841df4c9970c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:02.007717 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.007685    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78b69aa5-d016-4bbb-ab57-841df4c9970c-tmp\") pod \"klusterlet-addon-workmgr-778754d76-64trp\" (UID: \"78b69aa5-d016-4bbb-ab57-841df4c9970c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:02.088034 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.087988    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:02.108757 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.108716    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftcxf\" (UniqueName: \"kubernetes.io/projected/78b69aa5-d016-4bbb-ab57-841df4c9970c-kube-api-access-ftcxf\") pod \"klusterlet-addon-workmgr-778754d76-64trp\" (UID: \"78b69aa5-d016-4bbb-ab57-841df4c9970c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:02.108945 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.108792    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78b69aa5-d016-4bbb-ab57-841df4c9970c-tmp\") pod \"klusterlet-addon-workmgr-778754d76-64trp\" (UID: \"78b69aa5-d016-4bbb-ab57-841df4c9970c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:02.108945 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.108836    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78b69aa5-d016-4bbb-ab57-841df4c9970c-klusterlet-config\") pod \"klusterlet-addon-workmgr-778754d76-64trp\" (UID: \"78b69aa5-d016-4bbb-ab57-841df4c9970c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:02.109257 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.109233    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78b69aa5-d016-4bbb-ab57-841df4c9970c-tmp\") pod \"klusterlet-addon-workmgr-778754d76-64trp\" (UID: \"78b69aa5-d016-4bbb-ab57-841df4c9970c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:02.111752 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.111720    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78b69aa5-d016-4bbb-ab57-841df4c9970c-klusterlet-config\") pod \"klusterlet-addon-workmgr-778754d76-64trp\" (UID: \"78b69aa5-d016-4bbb-ab57-841df4c9970c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:02.118444 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.118419    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftcxf\" (UniqueName: \"kubernetes.io/projected/78b69aa5-d016-4bbb-ab57-841df4c9970c-kube-api-access-ftcxf\") pod \"klusterlet-addon-workmgr-778754d76-64trp\" (UID: \"78b69aa5-d016-4bbb-ab57-841df4c9970c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:02.187396 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.187304    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:02.209860 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.209817    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:02.290188 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.290150    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:02.346466 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.346430    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:24:02.347855 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.347831    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54684b4666-zv2d2"
Jul 10 02:24:02.391640 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.391578    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:02.489246 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.489211    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:02.781715 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:02.781675    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"]
Jul 10 02:24:02.784639 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:02.784608    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78b69aa5_d016_4bbb_ab57_841df4c9970c.slice/crio-3c53e031e0004eac32433d09ca72a38e3468d0a722af7d47ed5773951a1f63ce WatchSource:0}: Error finding container 3c53e031e0004eac32433d09ca72a38e3468d0a722af7d47ed5773951a1f63ce: Status 404 returned error can't find the container with id 3c53e031e0004eac32433d09ca72a38e3468d0a722af7d47ed5773951a1f63ce
Jul 10 02:24:03.102988 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.102895    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:03.199958 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.199924    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:03.268448 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.268415    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd"]
Jul 10 02:24:03.271155 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.271140    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd"
Jul 10 02:24:03.273854 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.273832    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-j8jk7\""
Jul 10 02:24:03.273999 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.273835    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 10 02:24:03.296061 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.296031    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd"]
Jul 10 02:24:03.302052 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.302021    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:03.352102 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.352065    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv" event={"ID":"80c914fd-447b-4090-b638-7709ffac5eb4","Type":"ContainerStarted","Data":"9eb62874de830aaad33970d662307f8f337004a797eea0ba0326750608cb4b1d"}
Jul 10 02:24:03.353648 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.353574    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq" event={"ID":"6666af78-fb87-4de2-83e3-a60d1c902d1a","Type":"ContainerStarted","Data":"98059ec66774a4c469029d0916f090e6be08a967ae9fea51e337ff8df425fb1e"}
Jul 10 02:24:03.354687 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.354668    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp" event={"ID":"78b69aa5-d016-4bbb-ab57-841df4c9970c","Type":"ContainerStarted","Data":"3c53e031e0004eac32433d09ca72a38e3468d0a722af7d47ed5773951a1f63ce"}
Jul 10 02:24:03.392359 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.392309    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-m98mv" podStartSLOduration=33.4890168 podStartE2EDuration="35.392292708s" totalImagesPullingTime="1.903275908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:03.388689361 +0000 UTC m=+75.909667670" watchObservedRunningTime="2026-07-10 02:24:03.392292708 +0000 UTC m=+75.913271016"
Jul 10 02:24:03.411828 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.411777    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-8lgvq" podStartSLOduration=33.55647079 podStartE2EDuration="35.411760712s" totalImagesPullingTime="1.855289922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:03.411263772 +0000 UTC m=+75.932242081" watchObservedRunningTime="2026-07-10 02:24:03.411760712 +0000 UTC m=+75.932739021"
Jul 10 02:24:03.418342 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.418308    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:03.420574 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.420543    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/70e7b402-c43e-4927-b28c-bdca448d1a0c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-6rvzd\" (UID: \"70e7b402-c43e-4927-b28c-bdca448d1a0c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd"
Jul 10 02:24:03.516439 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.516402    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:03.521515 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.521478    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/70e7b402-c43e-4927-b28c-bdca448d1a0c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-6rvzd\" (UID: \"70e7b402-c43e-4927-b28c-bdca448d1a0c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd"
Jul 10 02:24:03.524555 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.524518    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/70e7b402-c43e-4927-b28c-bdca448d1a0c-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-6rvzd\" (UID: \"70e7b402-c43e-4927-b28c-bdca448d1a0c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd"
Jul 10 02:24:03.579795 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.579580    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd"
Jul 10 02:24:03.605060 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.604982    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:03.747688 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.747653    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd"]
Jul 10 02:24:03.751605 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:03.751572    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e7b402_c43e_4927_b28c_bdca448d1a0c.slice/crio-33cdca107c0cc96b3232dcd25ea1c058f8607a0e728e4de0d463c71672574818 WatchSource:0}: Error finding container 33cdca107c0cc96b3232dcd25ea1c058f8607a0e728e4de0d463c71672574818: Status 404 returned error can't find the container with id 33cdca107c0cc96b3232dcd25ea1c058f8607a0e728e4de0d463c71672574818
Jul 10 02:24:03.957117 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:03.957033    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:04.022860 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:04.022791    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:04.362240 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:04.362201    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd" event={"ID":"70e7b402-c43e-4927-b28c-bdca448d1a0c","Type":"ContainerStarted","Data":"33cdca107c0cc96b3232dcd25ea1c058f8607a0e728e4de0d463c71672574818"}
Jul 10 02:24:06.345808 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:06.345754    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:24:06.348399 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:06.348367    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f75d5d7c-a255-473b-ae97-a105df6d4db8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2bpbm\" (UID: \"f75d5d7c-a255-473b-ae97-a105df6d4db8\") " pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:24:06.544032 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:06.544006    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pfnlm\""
Jul 10 02:24:06.550182 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:06.550163    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2bpbm"
Jul 10 02:24:06.693454 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:06.693276    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2bpbm"]
Jul 10 02:24:06.696051 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:06.696021    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf75d5d7c_a255_473b_ae97_a105df6d4db8.slice/crio-edbee20c544bc4c8dc177af8661676c0bf0524067127b1b67f5a867bfed201a5 WatchSource:0}: Error finding container edbee20c544bc4c8dc177af8661676c0bf0524067127b1b67f5a867bfed201a5: Status 404 returned error can't find the container with id edbee20c544bc4c8dc177af8661676c0bf0524067127b1b67f5a867bfed201a5
Jul 10 02:24:07.376464 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:07.376080    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp" event={"ID":"78b69aa5-d016-4bbb-ab57-841df4c9970c","Type":"ContainerStarted","Data":"61cdb9123083f52ab5cec2c03d309db53068005385f0b152cf100faaa6e41a32"}
Jul 10 02:24:07.377065 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:07.376578    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:07.378658 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:07.378501    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp"
Jul 10 02:24:07.382851 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:07.379191    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd" event={"ID":"70e7b402-c43e-4927-b28c-bdca448d1a0c","Type":"ContainerStarted","Data":"1de4fd587e3d994ab1e1be3279044cc770f860c736069508b3d19c7e348116b1"}
Jul 10 02:24:07.382851 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:07.380746    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd"
Jul 10 02:24:07.383055 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:07.382903    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2bpbm" event={"ID":"f75d5d7c-a255-473b-ae97-a105df6d4db8","Type":"ContainerStarted","Data":"edbee20c544bc4c8dc177af8661676c0bf0524067127b1b67f5a867bfed201a5"}
Jul 10 02:24:07.386946 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:07.386914    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd"
Jul 10 02:24:07.396693 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:07.396341    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-778754d76-64trp" podStartSLOduration=2.673330592 podStartE2EDuration="6.396321793s" totalImagesPullingTime="3.722991201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:24:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:07.394800206 +0000 UTC m=+79.915778517" watchObservedRunningTime="2026-07-10 02:24:07.396321793 +0000 UTC m=+79.917300104"
Jul 10 02:24:07.412701 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:07.412655    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-6rvzd" podStartSLOduration=1.672814007 podStartE2EDuration="4.412640439s" totalImagesPullingTime="2.739826432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:24:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:07.41162301 +0000 UTC m=+79.932601320" watchObservedRunningTime="2026-07-10 02:24:07.412640439 +0000 UTC m=+79.933618742"
Jul 10 02:24:08.288568 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.288528    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:08.326275 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.326234    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xmgr5"]
Jul 10 02:24:08.330088 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.330064    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.332863 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.332830    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 02:24:08.333918 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.333889    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 10 02:24:08.334069 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.333919    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5zvks\""
Jul 10 02:24:08.334069 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.333959    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 10 02:24:08.342136 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.342107    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xmgr5"]
Jul 10 02:24:08.367587 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.367536    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:08.463691 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.463647    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7aa07ae-4662-4645-b00b-647a1f0118b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xmgr5\" (UID: \"c7aa07ae-4662-4645-b00b-647a1f0118b3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.463691 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.463693    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvk6r\" (UniqueName: \"kubernetes.io/projected/c7aa07ae-4662-4645-b00b-647a1f0118b3-kube-api-access-pvk6r\") pod \"prometheus-operator-64785b6675-xmgr5\" (UID: \"c7aa07ae-4662-4645-b00b-647a1f0118b3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.464214 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.463764    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7aa07ae-4662-4645-b00b-647a1f0118b3-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xmgr5\" (UID: \"c7aa07ae-4662-4645-b00b-647a1f0118b3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.464214 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.463878    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7aa07ae-4662-4645-b00b-647a1f0118b3-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xmgr5\" (UID: \"c7aa07ae-4662-4645-b00b-647a1f0118b3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.475336 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.475308    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:08.564609 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.564515    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7aa07ae-4662-4645-b00b-647a1f0118b3-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xmgr5\" (UID: \"c7aa07ae-4662-4645-b00b-647a1f0118b3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.564609 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.564575    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7aa07ae-4662-4645-b00b-647a1f0118b3-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xmgr5\" (UID: \"c7aa07ae-4662-4645-b00b-647a1f0118b3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.564839 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.564624    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7aa07ae-4662-4645-b00b-647a1f0118b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xmgr5\" (UID: \"c7aa07ae-4662-4645-b00b-647a1f0118b3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.564839 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.564645    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvk6r\" (UniqueName: \"kubernetes.io/projected/c7aa07ae-4662-4645-b00b-647a1f0118b3-kube-api-access-pvk6r\") pod \"prometheus-operator-64785b6675-xmgr5\" (UID: \"c7aa07ae-4662-4645-b00b-647a1f0118b3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.565508 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.565463    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7aa07ae-4662-4645-b00b-647a1f0118b3-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xmgr5\" (UID: \"c7aa07ae-4662-4645-b00b-647a1f0118b3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.567410 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.567369    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c7aa07ae-4662-4645-b00b-647a1f0118b3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xmgr5\" (UID: \"c7aa07ae-4662-4645-b00b-647a1f0118b3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.567521 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.567467    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7aa07ae-4662-4645-b00b-647a1f0118b3-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xmgr5\" (UID: \"c7aa07ae-4662-4645-b00b-647a1f0118b3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.574009 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.573979    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvk6r\" (UniqueName: \"kubernetes.io/projected/c7aa07ae-4662-4645-b00b-647a1f0118b3-kube-api-access-pvk6r\") pod \"prometheus-operator-64785b6675-xmgr5\" (UID: \"c7aa07ae-4662-4645-b00b-647a1f0118b3\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:08.639847 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:08.639812    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5"
Jul 10 02:24:10.003572 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:10.003539    2553 scope.go:117] "RemoveContainer" containerID="609927a5420fecb68146879c1836d51e2abfd2a2e0cc448bea1529b7b82cebd8"
Jul 10 02:24:10.004074 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:24:10.003769    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-xx87v_openshift-console-operator(602ea76a-cc86-439b-b144-893cb6d217de)\"" pod="openshift-console-operator/console-operator-7866497494-xx87v" podUID="602ea76a-cc86-439b-b144-893cb6d217de"
Jul 10 02:24:10.639781 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:10.639753    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xmgr5"]
Jul 10 02:24:10.642506 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:10.642484    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7aa07ae_4662_4645_b00b_647a1f0118b3.slice/crio-bd8627839b636b31709cb5f14831c4c78c553a707127d6c093a621756b553d09 WatchSource:0}: Error finding container bd8627839b636b31709cb5f14831c4c78c553a707127d6c093a621756b553d09: Status 404 returned error can't find the container with id bd8627839b636b31709cb5f14831c4c78c553a707127d6c093a621756b553d09
Jul 10 02:24:11.348849 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:11.348816    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-clndt"
Jul 10 02:24:11.400125 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:11.400078    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5" event={"ID":"c7aa07ae-4662-4645-b00b-647a1f0118b3","Type":"ContainerStarted","Data":"bd8627839b636b31709cb5f14831c4c78c553a707127d6c093a621756b553d09"}
Jul 10 02:24:11.402274 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:11.402243    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2bpbm" event={"ID":"f75d5d7c-a255-473b-ae97-a105df6d4db8","Type":"ContainerStarted","Data":"9f7630272972e29ae37a40eeda346650a4eded816719912a2407fedc704c3578"}
Jul 10 02:24:11.402414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:11.402307    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2bpbm" event={"ID":"f75d5d7c-a255-473b-ae97-a105df6d4db8","Type":"ContainerStarted","Data":"a8390b34d0dd8292e00b365d59a49c3326078dc770994cdd684a36e9e7e446fb"}
Jul 10 02:24:12.154840 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:12.154755    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:12.408616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:12.408524    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5" event={"ID":"c7aa07ae-4662-4645-b00b-647a1f0118b3","Type":"ContainerStarted","Data":"aa01527abe2a43911980c3367aee1645958cc3123d45ee52569178c7bfdab7f4"}
Jul 10 02:24:12.408616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:12.408600    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5" event={"ID":"c7aa07ae-4662-4645-b00b-647a1f0118b3","Type":"ContainerStarted","Data":"345950aa966054eed8f64a5d92c4513d0324eec37c83dcad5fce9c2f3b38913f"}
Jul 10 02:24:12.428147 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:12.428062    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-xmgr5" podStartSLOduration=3.280989669 podStartE2EDuration="4.428040847s" totalImagesPullingTime="1.147051178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:12.427090245 +0000 UTC m=+84.948068558" watchObservedRunningTime="2026-07-10 02:24:12.428040847 +0000 UTC m=+84.949019157"
Jul 10 02:24:14.423509 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.423467    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2bpbm" event={"ID":"f75d5d7c-a255-473b-ae97-a105df6d4db8","Type":"ContainerStarted","Data":"21a262e04861fa5f504916c4425e7d4065614a08063319d2c899992ea0925a97"}
Jul 10 02:24:14.438671 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.438629    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:14.450806 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.450759    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2bpbm" podStartSLOduration=33.403617463 podStartE2EDuration="40.450744894s" totalImagesPullingTime="7.047127431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 02:23:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:14.449078462 +0000 UTC m=+86.970056774" watchObservedRunningTime="2026-07-10 02:24:14.450744894 +0000 UTC m=+86.971723203"
Jul 10 02:24:14.692399 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.692288    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:14.706167 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.706139    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"]
Jul 10 02:24:14.709438 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.709422    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.712605 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.712582    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-ftmtf\""
Jul 10 02:24:14.712732 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.712629    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 10 02:24:14.712732 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.712585    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 10 02:24:14.724150 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.724125    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"]
Jul 10 02:24:14.760398 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.760368    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m4tk9"]
Jul 10 02:24:14.763583 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.763566    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:14.766340 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.766317    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 02:24:14.766491 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.766363    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 02:24:14.766491 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.766423    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d22qb\""
Jul 10 02:24:14.766699 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.766683    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 02:24:14.794099 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.794067    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:14.815250 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.815213    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af6b9938-3fc8-43a2-956c-3b4c11648538-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-6x5jb\" (UID: \"af6b9938-3fc8-43a2-956c-3b4c11648538\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.815411 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.815273    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af6b9938-3fc8-43a2-956c-3b4c11648538-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-6x5jb\" (UID: \"af6b9938-3fc8-43a2-956c-3b4c11648538\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.815411 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.815299    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af6b9938-3fc8-43a2-956c-3b4c11648538-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-6x5jb\" (UID: \"af6b9938-3fc8-43a2-956c-3b4c11648538\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.815411 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.815350    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk9zc\" (UniqueName: \"kubernetes.io/projected/af6b9938-3fc8-43a2-956c-3b4c11648538-kube-api-access-xk9zc\") pod \"openshift-state-metrics-84bd68b896-6x5jb\" (UID: \"af6b9938-3fc8-43a2-956c-3b4c11648538\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.891531 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.891496    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:14.916649 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.916613    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-accelerators-collector-config\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:14.916821 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.916660    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af6b9938-3fc8-43a2-956c-3b4c11648538-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-6x5jb\" (UID: \"af6b9938-3fc8-43a2-956c-3b4c11648538\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.916821 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.916690    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:14.916821 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.916758    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-textfile\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:14.916821 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.916796    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-tls\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:14.916998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.916839    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-metrics-client-ca\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:14.916998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.916861    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx9q2\" (UniqueName: \"kubernetes.io/projected/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-kube-api-access-qx9q2\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:14.916998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.916892    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af6b9938-3fc8-43a2-956c-3b4c11648538-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-6x5jb\" (UID: \"af6b9938-3fc8-43a2-956c-3b4c11648538\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.916998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.916908    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-sys\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:14.916998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.916939    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-root\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:14.916998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.916987    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af6b9938-3fc8-43a2-956c-3b4c11648538-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-6x5jb\" (UID: \"af6b9938-3fc8-43a2-956c-3b4c11648538\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.917247 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.917007    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-wtmp\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:14.917247 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.917028    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk9zc\" (UniqueName: \"kubernetes.io/projected/af6b9938-3fc8-43a2-956c-3b4c11648538-kube-api-access-xk9zc\") pod \"openshift-state-metrics-84bd68b896-6x5jb\" (UID: \"af6b9938-3fc8-43a2-956c-3b4c11648538\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.922893 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.919476    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/af6b9938-3fc8-43a2-956c-3b4c11648538-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-6x5jb\" (UID: \"af6b9938-3fc8-43a2-956c-3b4c11648538\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.922893 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.919814    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/af6b9938-3fc8-43a2-956c-3b4c11648538-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-6x5jb\" (UID: \"af6b9938-3fc8-43a2-956c-3b4c11648538\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.922893 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.920324    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/af6b9938-3fc8-43a2-956c-3b4c11648538-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-6x5jb\" (UID: \"af6b9938-3fc8-43a2-956c-3b4c11648538\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.928258 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.928228    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk9zc\" (UniqueName: \"kubernetes.io/projected/af6b9938-3fc8-43a2-956c-3b4c11648538-kube-api-access-xk9zc\") pod \"openshift-state-metrics-84bd68b896-6x5jb\" (UID: \"af6b9938-3fc8-43a2-956c-3b4c11648538\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:14.988182 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:14.988090    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:15.018303 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018273    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"
Jul 10 02:24:15.018501 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018478    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-textfile\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.018572 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018519    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-tls\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.018572 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018536    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-metrics-client-ca\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.018572 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018551    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx9q2\" (UniqueName: \"kubernetes.io/projected/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-kube-api-access-qx9q2\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.018572 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018569    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-sys\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.018761 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018585    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-root\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.018761 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018606    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-wtmp\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.018761 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018649    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-accelerators-collector-config\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.018761 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018679    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-sys\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.018761 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018688    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.018761 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018698    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-root\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.019089 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:24:15.018759    2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 10 02:24:15.019089 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:24:15.018839    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-tls podName:b892cbd4-5541-4cfc-a363-d9dbeeb6d323 nodeName:}" failed. No retries permitted until 2026-07-10 02:24:15.518819181 +0000 UTC m=+88.039797494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-tls") pod "node-exporter-m4tk9" (UID: "b892cbd4-5541-4cfc-a363-d9dbeeb6d323") : secret "node-exporter-tls" not found
Jul 10 02:24:15.019089 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018875    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-textfile\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.019089 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.018922    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-wtmp\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.019234 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.019201    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-metrics-client-ca\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.019287 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.019261    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-accelerators-collector-config\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.021049 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.021030    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.035479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.035456    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx9q2\" (UniqueName: \"kubernetes.io/projected/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-kube-api-access-qx9q2\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.126212 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.126180    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:15.154954 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.154901    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb"]
Jul 10 02:24:15.157579 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:15.157549    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf6b9938_3fc8_43a2_956c_3b4c11648538.slice/crio-09c26c14c27666c787500bdc8fc45360621c3bc2cc957078f60391f2d41f4bc3 WatchSource:0}: Error finding container 09c26c14c27666c787500bdc8fc45360621c3bc2cc957078f60391f2d41f4bc3: Status 404 returned error can't find the container with id 09c26c14c27666c787500bdc8fc45360621c3bc2cc957078f60391f2d41f4bc3
Jul 10 02:24:15.228155 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.228132    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:15.326899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.326867    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:15.428843 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.428807    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb" event={"ID":"af6b9938-3fc8-43a2-956c-3b4c11648538","Type":"ContainerStarted","Data":"042d8d0160eb2cdc7cdede1b6de9bff8f51937f5057ab0617eb68a3101be3161"}
Jul 10 02:24:15.429245 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.428864    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb" event={"ID":"af6b9938-3fc8-43a2-956c-3b4c11648538","Type":"ContainerStarted","Data":"64ac73266d0eaa44902b83e59b0d699376d43749166c16e25da0428cd7154703"}
Jul 10 02:24:15.429245 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.428888    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb" event={"ID":"af6b9938-3fc8-43a2-956c-3b4c11648538","Type":"ContainerStarted","Data":"09c26c14c27666c787500bdc8fc45360621c3bc2cc957078f60391f2d41f4bc3"}
Jul 10 02:24:15.443001 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.442951    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:15.524221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.524136    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-tls\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.526453 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.526431    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b892cbd4-5541-4cfc-a363-d9dbeeb6d323-node-exporter-tls\") pod \"node-exporter-m4tk9\" (UID: \"b892cbd4-5541-4cfc-a363-d9dbeeb6d323\") " pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.542364 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.542335    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:15.673344 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.673308    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m4tk9"
Jul 10 02:24:15.684225 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:15.684187    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb892cbd4_5541_4cfc_a363_d9dbeeb6d323.slice/crio-957a2e91e91627f441477ff199e65430ea26ac71574e9eb18ef5ce2bb7291b4f WatchSource:0}: Error finding container 957a2e91e91627f441477ff199e65430ea26ac71574e9eb18ef5ce2bb7291b4f: Status 404 returned error can't find the container with id 957a2e91e91627f441477ff199e65430ea26ac71574e9eb18ef5ce2bb7291b4f
Jul 10 02:24:15.689291 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.689227    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:15.790191 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.790163    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:24:15.791255 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.790729    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:15.794371 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.794298    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.800746 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.800724    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 02:24:15.801295 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.801272    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 02:24:15.801412 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.801308    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 02:24:15.801486 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.801279    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 02:24:15.803213 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.803194    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 02:24:15.804089 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.804064    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 02:24:15.812357 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.812330    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lwz96\""
Jul 10 02:24:15.812510 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.812423    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 02:24:15.813075 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.812872    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 02:24:15.822167 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.821930    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 02:24:15.823959 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.823883    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:24:15.916778 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.916745    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:15.927078 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927039    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cqr7\" (UniqueName: \"kubernetes.io/projected/1f486b66-c9c9-4cd1-a258-ea893f5036f3-kube-api-access-4cqr7\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.927222 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927099    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.927222 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927158    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.927222 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927198    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f486b66-c9c9-4cd1-a258-ea893f5036f3-config-out\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.927361 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927227    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.927361 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927254    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f486b66-c9c9-4cd1-a258-ea893f5036f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.927361 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927338    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f486b66-c9c9-4cd1-a258-ea893f5036f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.927452 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927387    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.927452 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927421    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-web-config\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.927452 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927445    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f486b66-c9c9-4cd1-a258-ea893f5036f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.927541 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927470    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.927541 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927504    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f486b66-c9c9-4cd1-a258-ea893f5036f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:15.927541 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:15.927526    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.028928 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.028892    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f486b66-c9c9-4cd1-a258-ea893f5036f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.029110 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.028944    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.029110 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.028997    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-web-config\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.029110 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.029024    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f486b66-c9c9-4cd1-a258-ea893f5036f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.029110 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.029050    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.029110 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.029080    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f486b66-c9c9-4cd1-a258-ea893f5036f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.029110 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.029101    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.029410 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.029365    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f486b66-c9c9-4cd1-a258-ea893f5036f3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.030500 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.029691    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cqr7\" (UniqueName: \"kubernetes.io/projected/1f486b66-c9c9-4cd1-a258-ea893f5036f3-kube-api-access-4cqr7\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.030500 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.029767    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.030500 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.029806    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.030500 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.029834    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f486b66-c9c9-4cd1-a258-ea893f5036f3-config-out\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.030500 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.029858    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.030500 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.029870    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f486b66-c9c9-4cd1-a258-ea893f5036f3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.030500 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.029887    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f486b66-c9c9-4cd1-a258-ea893f5036f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.030919 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.030857    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f486b66-c9c9-4cd1-a258-ea893f5036f3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.034178 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.033753    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.034178 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.034145    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f486b66-c9c9-4cd1-a258-ea893f5036f3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.034998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.034634    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f486b66-c9c9-4cd1-a258-ea893f5036f3-config-out\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.034998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.034852    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-web-config\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.034998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.034935    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.035555 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.035320    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.035555 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.035525    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.035686 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.035580    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.036046 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.036029    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.040142 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.040124    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cqr7\" (UniqueName: \"kubernetes.io/projected/1f486b66-c9c9-4cd1-a258-ea893f5036f3-kube-api-access-4cqr7\") pod \"alertmanager-main-0\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.107288 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.107214    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:24:16.363450 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.363352    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:24:16.365868 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:16.365843    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f486b66_c9c9_4cd1_a258_ea893f5036f3.slice/crio-d0774a2964adbf41d0589ab2d56ec1d907b5648d52a0299355e6dc09d20f5adb WatchSource:0}: Error finding container d0774a2964adbf41d0589ab2d56ec1d907b5648d52a0299355e6dc09d20f5adb: Status 404 returned error can't find the container with id d0774a2964adbf41d0589ab2d56ec1d907b5648d52a0299355e6dc09d20f5adb
Jul 10 02:24:16.436680 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.436645    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb" event={"ID":"af6b9938-3fc8-43a2-956c-3b4c11648538","Type":"ContainerStarted","Data":"d63d4d2df0248f0fb229d0bf916441c38507f7b02b32300c497be5396369e703"}
Jul 10 02:24:16.437900 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.437875    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4tk9" event={"ID":"b892cbd4-5541-4cfc-a363-d9dbeeb6d323","Type":"ContainerStarted","Data":"957a2e91e91627f441477ff199e65430ea26ac71574e9eb18ef5ce2bb7291b4f"}
Jul 10 02:24:16.439049 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.439025    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerStarted","Data":"d0774a2964adbf41d0589ab2d56ec1d907b5648d52a0299355e6dc09d20f5adb"}
Jul 10 02:24:16.457552 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:16.457502    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-6x5jb" podStartSLOduration=1.4807658830000001 podStartE2EDuration="2.45748298s" totalImagesPullingTime="976.717097ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:16.456303905 +0000 UTC m=+88.977282254" watchObservedRunningTime="2026-07-10 02:24:16.45748298 +0000 UTC m=+88.978461289"
Jul 10 02:24:17.446016 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:17.445957    2553 generic.go:356] "Generic (PLEG): container finished" podID="b892cbd4-5541-4cfc-a363-d9dbeeb6d323" containerID="cfdf208d9e762241ca0feeb21882af67edf1634cd88da8fdbd3f8b1468c80b25" exitCode=0
Jul 10 02:24:17.446016 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:17.445999    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4tk9" event={"ID":"b892cbd4-5541-4cfc-a363-d9dbeeb6d323","Type":"ContainerDied","Data":"cfdf208d9e762241ca0feeb21882af67edf1634cd88da8fdbd3f8b1468c80b25"}
Jul 10 02:24:17.691892 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:17.691862    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:17.775943 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:17.775849    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:17.935988 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:17.935935    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:18.411668 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:18.411615    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:18.451779 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:18.451748    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4tk9" event={"ID":"b892cbd4-5541-4cfc-a363-d9dbeeb6d323","Type":"ContainerStarted","Data":"d7365b8438feba6dfa7b1b645d6f519b5bd9cb80634903df6938f012942f53d7"}
Jul 10 02:24:18.452218 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:18.451799    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4tk9" event={"ID":"b892cbd4-5541-4cfc-a363-d9dbeeb6d323","Type":"ContainerStarted","Data":"6b09be15e631b247f74acb8b84807e5a97a4fb5ad41debcf51a0da7b1f5f19f2"}
Jul 10 02:24:18.453407 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:18.453382    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerID="51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013" exitCode=0
Jul 10 02:24:18.453524 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:18.453461    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerDied","Data":"51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013"}
Jul 10 02:24:18.489535 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:18.489483    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m4tk9" podStartSLOduration=3.25475817 podStartE2EDuration="4.48946688s" totalImagesPullingTime="1.162101958s" totalInitContainerRuntime="72.606752ms" isStatefulPod=true podCreationTimestamp="2026-07-10 02:24:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:18.48847934 +0000 UTC m=+91.009457686" watchObservedRunningTime="2026-07-10 02:24:18.48946688 +0000 UTC m=+91.010445189"
Jul 10 02:24:19.467052 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.467013    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"]
Jul 10 02:24:19.470534 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.470509    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"
Jul 10 02:24:19.471101 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.471060    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:19.473083 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.473056    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 10 02:24:19.473227 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.473211    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ws9kc\""
Jul 10 02:24:19.480980 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.480903    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"]
Jul 10 02:24:19.592595 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.592561    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:19.664372 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.664343    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdhc7\" (UniqueName: \"kubernetes.io/projected/59fe58e3-26b6-4687-978d-0f0624ff5851-kube-api-access-kdhc7\") pod \"monitoring-plugin-5f68df7f58-6gt5k\" (UID: \"59fe58e3-26b6-4687-978d-0f0624ff5851\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"
Jul 10 02:24:19.664566 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.664405    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59fe58e3-26b6-4687-978d-0f0624ff5851-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6gt5k\" (UID: \"59fe58e3-26b6-4687-978d-0f0624ff5851\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"
Jul 10 02:24:19.705319 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.705285    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:19.765553 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.765466    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59fe58e3-26b6-4687-978d-0f0624ff5851-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6gt5k\" (UID: \"59fe58e3-26b6-4687-978d-0f0624ff5851\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"
Jul 10 02:24:19.765553 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.765548    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdhc7\" (UniqueName: \"kubernetes.io/projected/59fe58e3-26b6-4687-978d-0f0624ff5851-kube-api-access-kdhc7\") pod \"monitoring-plugin-5f68df7f58-6gt5k\" (UID: \"59fe58e3-26b6-4687-978d-0f0624ff5851\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"
Jul 10 02:24:19.767952 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.767929    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/59fe58e3-26b6-4687-978d-0f0624ff5851-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-6gt5k\" (UID: \"59fe58e3-26b6-4687-978d-0f0624ff5851\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"
Jul 10 02:24:19.770686 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.770653    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:19.775179 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.775159    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdhc7\" (UniqueName: \"kubernetes.io/projected/59fe58e3-26b6-4687-978d-0f0624ff5851-kube-api-access-kdhc7\") pod \"monitoring-plugin-5f68df7f58-6gt5k\" (UID: \"59fe58e3-26b6-4687-978d-0f0624ff5851\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"
Jul 10 02:24:19.780926 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.780907    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"
Jul 10 02:24:19.928521 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.928472    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"]
Jul 10 02:24:19.944519 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.944473    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6676bd8587-rhddh"]
Jul 10 02:24:19.949392 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.949366    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:19.955028 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.955005    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 10 02:24:19.955169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.955048    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 10 02:24:19.955169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.955120    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 10 02:24:19.955466 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.955448    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 10 02:24:19.955777 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.955759    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ccp5w\""
Jul 10 02:24:19.955863 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.955786    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 10 02:24:19.960370 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.960354    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 10 02:24:19.965905 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:19.965882    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6676bd8587-rhddh"]
Jul 10 02:24:20.068470 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.068430    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c438d76f-473b-45aa-b8b8-1f3817389b3a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.068470 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.068476    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c438d76f-473b-45aa-b8b8-1f3817389b3a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.068786 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.068506    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c438d76f-473b-45aa-b8b8-1f3817389b3a-federate-client-tls\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.068786 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.068528    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c438d76f-473b-45aa-b8b8-1f3817389b3a-metrics-client-ca\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.068786 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.068583    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c438d76f-473b-45aa-b8b8-1f3817389b3a-telemeter-client-tls\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.068786 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.068630    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c438d76f-473b-45aa-b8b8-1f3817389b3a-serving-certs-ca-bundle\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.068786 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.068727    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c438d76f-473b-45aa-b8b8-1f3817389b3a-secret-telemeter-client\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.069006 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.068788    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpn7p\" (UniqueName: \"kubernetes.io/projected/c438d76f-473b-45aa-b8b8-1f3817389b3a-kube-api-access-mpn7p\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.170472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.169958    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c438d76f-473b-45aa-b8b8-1f3817389b3a-secret-telemeter-client\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.170472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.170051    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpn7p\" (UniqueName: \"kubernetes.io/projected/c438d76f-473b-45aa-b8b8-1f3817389b3a-kube-api-access-mpn7p\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.170472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.170104    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c438d76f-473b-45aa-b8b8-1f3817389b3a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.170472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.170136    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c438d76f-473b-45aa-b8b8-1f3817389b3a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.170472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.170191    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c438d76f-473b-45aa-b8b8-1f3817389b3a-federate-client-tls\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.170472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.170213    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c438d76f-473b-45aa-b8b8-1f3817389b3a-metrics-client-ca\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.170472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.170243    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c438d76f-473b-45aa-b8b8-1f3817389b3a-telemeter-client-tls\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.170472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.170271    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c438d76f-473b-45aa-b8b8-1f3817389b3a-serving-certs-ca-bundle\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.171115 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.171059    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c438d76f-473b-45aa-b8b8-1f3817389b3a-metrics-client-ca\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.171251 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.171120    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c438d76f-473b-45aa-b8b8-1f3817389b3a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.171411 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.171367    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c438d76f-473b-45aa-b8b8-1f3817389b3a-serving-certs-ca-bundle\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.173258 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.173213    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c438d76f-473b-45aa-b8b8-1f3817389b3a-telemeter-client-tls\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.173363 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.173270    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c438d76f-473b-45aa-b8b8-1f3817389b3a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.173363 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.173350    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c438d76f-473b-45aa-b8b8-1f3817389b3a-federate-client-tls\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.173820 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.173792    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c438d76f-473b-45aa-b8b8-1f3817389b3a-secret-telemeter-client\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.179765 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.179739    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpn7p\" (UniqueName: \"kubernetes.io/projected/c438d76f-473b-45aa-b8b8-1f3817389b3a-kube-api-access-mpn7p\") pod \"telemeter-client-6676bd8587-rhddh\" (UID: \"c438d76f-473b-45aa-b8b8-1f3817389b3a\") " pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.202877 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:20.202842    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59fe58e3_26b6_4687_978d_0f0624ff5851.slice/crio-af7f9861c0df019fca8b456615a26a9b0ab3161d1bf025cfae1d862bf0a5ace5 WatchSource:0}: Error finding container af7f9861c0df019fca8b456615a26a9b0ab3161d1bf025cfae1d862bf0a5ace5: Status 404 returned error can't find the container with id af7f9861c0df019fca8b456615a26a9b0ab3161d1bf025cfae1d862bf0a5ace5
Jul 10 02:24:20.261954 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.261930    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh"
Jul 10 02:24:20.450304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.450274    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6676bd8587-rhddh"]
Jul 10 02:24:20.453405 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:20.453368    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc438d76f_473b_45aa_b8b8_1f3817389b3a.slice/crio-a87d61cf0f35c732647642a757c76aeb4e799b8f0ee7e7cdd04b7e8fe0e6df90 WatchSource:0}: Error finding container a87d61cf0f35c732647642a757c76aeb4e799b8f0ee7e7cdd04b7e8fe0e6df90: Status 404 returned error can't find the container with id a87d61cf0f35c732647642a757c76aeb4e799b8f0ee7e7cdd04b7e8fe0e6df90
Jul 10 02:24:20.463928 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.463898    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerStarted","Data":"6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053"}
Jul 10 02:24:20.464078 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.464043    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerStarted","Data":"d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc"}
Jul 10 02:24:20.464078 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.464077    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerStarted","Data":"a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1"}
Jul 10 02:24:20.465095 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.465069    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k" event={"ID":"59fe58e3-26b6-4687-978d-0f0624ff5851","Type":"ContainerStarted","Data":"af7f9861c0df019fca8b456615a26a9b0ab3161d1bf025cfae1d862bf0a5ace5"}
Jul 10 02:24:20.466381 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.466350    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh" event={"ID":"c438d76f-473b-45aa-b8b8-1f3817389b3a","Type":"ContainerStarted","Data":"a87d61cf0f35c732647642a757c76aeb4e799b8f0ee7e7cdd04b7e8fe0e6df90"}
Jul 10 02:24:20.543858 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.543833    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:20.644826 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.644782    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:20.982311 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.982229    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:24:20.988171 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.988135    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:20.991067 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.990121    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:20.993199 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.993172    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 02:24:20.993869 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.993846    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 02:24:20.995202 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.995151    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 02:24:20.995202 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.995184    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 02:24:20.995390 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.995246    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 02:24:20.995492 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.995424    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 02:24:20.995765 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.995715    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 02:24:20.995844 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.995151    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jwdw4\""
Jul 10 02:24:20.996454 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.996095    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 02:24:20.996454 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.996287    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 02:24:20.996454 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.996346    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 02:24:20.996664 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.996591    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-65b638e7m649f\""
Jul 10 02:24:20.998411 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.998393    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 02:24:20.998712 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.998696    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 02:24:21.001183 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:20.998864    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 02:24:21.001473 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.000611    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 02:24:21.001710 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.000669    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 02:24:21.007108 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.006160    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:24:21.181723 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.181688    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.181723 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.181729    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.181998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.181763    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.181998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.181832    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.181998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.181866    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.181998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.181911    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7f356de-d116-4319-b1d2-c1e7cafcd186-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.181989    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182041    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-web-config\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182108    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182135    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182163    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182188    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7f356de-d116-4319-b1d2-c1e7cafcd186-config-out\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182505 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182229    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182505 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182256    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-config\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182505 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182281    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182505 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182307    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182505 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182341    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182505 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182364    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182505 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182392    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.182505 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.182414    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qwpv\" (UniqueName: \"kubernetes.io/projected/c7f356de-d116-4319-b1d2-c1e7cafcd186-kube-api-access-6qwpv\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283325 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283238    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283325 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283287    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-config\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283325 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283318    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283344    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283376    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283401    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283419    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283434    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qwpv\" (UniqueName: \"kubernetes.io/projected/c7f356de-d116-4319-b1d2-c1e7cafcd186-kube-api-access-6qwpv\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283461    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283484    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283528    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283570    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283592    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.283654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283639    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7f356de-d116-4319-b1d2-c1e7cafcd186-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.284336 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283662    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.284336 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283685    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-web-config\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.284336 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283732    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.284336 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283756    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.284336 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283779    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.284336 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.283807    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7f356de-d116-4319-b1d2-c1e7cafcd186-config-out\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.284596 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.284564    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.288726 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.285683    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.288726 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.287778    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.288726 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.288161    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.288726 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.288421    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.293007 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.292657    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.294563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.294024    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.296706 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.295817    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.296706 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.296492    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.296706 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.296505    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.296916 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.296793    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7f356de-d116-4319-b1d2-c1e7cafcd186-config-out\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.297540 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.297491    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.297659 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.297563    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.297932 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.297904    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.299068 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.298443    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-config\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.299068 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.298820    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qwpv\" (UniqueName: \"kubernetes.io/projected/c7f356de-d116-4319-b1d2-c1e7cafcd186-kube-api-access-6qwpv\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.299068 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.299026    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.301162 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.300538    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.301882 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.301468    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7f356de-d116-4319-b1d2-c1e7cafcd186-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.302499 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.302455    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-web-config\") pod \"prometheus-k8s-0\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.310789 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.310461    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:21.482393 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.482352    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerStarted","Data":"3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593"}
Jul 10 02:24:21.482563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.482444    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerStarted","Data":"53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa"}
Jul 10 02:24:21.700929 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:21.700889    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:24:21.946015 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:24:21.945931    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7f356de_d116_4319_b1d2_c1e7cafcd186.slice/crio-ce537b69a725129b10897924e3d1b89c32a7072a0e7e31203b001ec5f5bf3418 WatchSource:0}: Error finding container ce537b69a725129b10897924e3d1b89c32a7072a0e7e31203b001ec5f5bf3418: Status 404 returned error can't find the container with id ce537b69a725129b10897924e3d1b89c32a7072a0e7e31203b001ec5f5bf3418
Jul 10 02:24:22.474195 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:22.474164    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:22.489505 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:22.489476    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerStarted","Data":"ce537b69a725129b10897924e3d1b89c32a7072a0e7e31203b001ec5f5bf3418"}
Jul 10 02:24:22.573892 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:22.573863    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:23.495020 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:23.494952    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k" event={"ID":"59fe58e3-26b6-4687-978d-0f0624ff5851","Type":"ContainerStarted","Data":"64c0a1a8df94986c876d07b903d3656368041b9066102ed14d66e4a92ba8065e"}
Jul 10 02:24:23.495464 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:23.495146    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"
Jul 10 02:24:23.500360 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:23.500327    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh" event={"ID":"c438d76f-473b-45aa-b8b8-1f3817389b3a","Type":"ContainerStarted","Data":"768a6f8a46daaee5a43b9171e461226b18970f77691384dcb14a346157696653"}
Jul 10 02:24:23.500519 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:23.500389    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh" event={"ID":"c438d76f-473b-45aa-b8b8-1f3817389b3a","Type":"ContainerStarted","Data":"64e2f2c017043cfb3f532d52898252bb05e0ec3f03d52aa212bf30a817254ab0"}
Jul 10 02:24:23.500519 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:23.500417    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh" event={"ID":"c438d76f-473b-45aa-b8b8-1f3817389b3a","Type":"ContainerStarted","Data":"81d927e52c425d25273af6f9bc4b0f8bb173a0ed3e80c2b842b469dd899a748f"}
Jul 10 02:24:23.502515 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:23.502488    2553 generic.go:356] "Generic (PLEG): container finished" podID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerID="f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260" exitCode=0
Jul 10 02:24:23.502640 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:23.502571    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerDied","Data":"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"}
Jul 10 02:24:23.503111 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:23.503092    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k"
Jul 10 02:24:23.506091 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:23.506057    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerStarted","Data":"c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d"}
Jul 10 02:24:23.512834 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:23.512792    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-6gt5k" podStartSLOduration=2.274282819 podStartE2EDuration="4.512777425s" totalImagesPullingTime="2.238494606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:23.512365276 +0000 UTC m=+96.033343585" watchObservedRunningTime="2026-07-10 02:24:23.512777425 +0000 UTC m=+96.033755813"
Jul 10 02:24:23.544189 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:23.544127    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.66005934 podStartE2EDuration="8.544107478s" totalImagesPullingTime="4.868984518s" totalInitContainerRuntime="15.06362ms" isStatefulPod=false podCreationTimestamp="2026-07-10 02:24:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:23.542726661 +0000 UTC m=+96.063704974" watchObservedRunningTime="2026-07-10 02:24:23.544107478 +0000 UTC m=+96.065085788"
Jul 10 02:24:23.619621 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:23.619566    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6676bd8587-rhddh" podStartSLOduration=2.62901468 podStartE2EDuration="4.619545242s" totalImagesPullingTime="1.990530562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:24:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:23.615665462 +0000 UTC m=+96.136643770" watchObservedRunningTime="2026-07-10 02:24:23.619545242 +0000 UTC m=+96.140523553"
Jul 10 02:24:24.002840 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:24.002808    2553 scope.go:117] "RemoveContainer" containerID="609927a5420fecb68146879c1836d51e2abfd2a2e0cc448bea1529b7b82cebd8"
Jul 10 02:24:24.514020 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:24.513992    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:24:24.514514 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:24.514128    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-xx87v" event={"ID":"602ea76a-cc86-439b-b144-893cb6d217de","Type":"ContainerStarted","Data":"ec9663e1da9d989115da63e748a069c7a2fa3fe959b44dcdcd298805eb1f302e"}
Jul 10 02:24:24.515150 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:24.515123    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:24:24.550945 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:24.550890    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-xx87v" podStartSLOduration=53.411010963 podStartE2EDuration="56.550868365s" totalImagesPullingTime="3.139857402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:24.550034389 +0000 UTC m=+97.071012780" watchObservedRunningTime="2026-07-10 02:24:24.550868365 +0000 UTC m=+97.071846674"
Jul 10 02:24:24.799539 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:24.799504    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-xx87v"
Jul 10 02:24:25.026487 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:25.026452    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:25.107813 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:25.107732    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:25.283786 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:25.283746    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:25.454474 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:25.454387    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:25.519267 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:25.519232    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:25.744760 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:25.744678    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:25.816385 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:25.816351    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:25.889803 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:25.889741    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:25.992020 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:25.991948    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:26.095892 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:26.095854    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:26.194439 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:26.194396    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:26.674690 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:26.674655    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:26.880358 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:26.880304    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:27.119464 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:27.119432    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:27.530158 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:27.530120    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerStarted","Data":"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"}
Jul 10 02:24:27.530327 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:27.530195    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerStarted","Data":"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"}
Jul 10 02:24:28.290318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:28.290282    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:28.354992 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:28.354903    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:29.495306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:29.495258    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:29.542195 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:29.542165    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerStarted","Data":"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"}
Jul 10 02:24:29.542340 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:29.542226    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerStarted","Data":"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"}
Jul 10 02:24:29.542340 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:29.542256    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerStarted","Data":"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"}
Jul 10 02:24:29.542340 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:29.542280    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerStarted","Data":"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"}
Jul 10 02:24:29.553993 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:29.553947    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:29.572326 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:29.572270    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.102769941 podStartE2EDuration="9.572250691s" totalImagesPullingTime="5.450738476s" totalInitContainerRuntime="18.742274ms" isStatefulPod=false podCreationTimestamp="2026-07-10 02:24:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:24:29.570869568 +0000 UTC m=+102.091847877" watchObservedRunningTime="2026-07-10 02:24:29.572250691 +0000 UTC m=+102.093229004"
Jul 10 02:24:29.639704 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:29.639597    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:29.695894 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:29.695860    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:30.335505 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:30.335470    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-24tvp"
Jul 10 02:24:31.311349 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:31.311294    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:24:32.138172 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:32.138141    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:32.206222 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:32.206189    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:35.106311 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:35.106270    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:35.206608 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:35.206558    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:37.486553 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:37.486515    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:37.584897 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:37.584866    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:38.719629 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:38.719591    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:38.792563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:38.792532    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:40.500527 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:40.500482    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:40.598756 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:40.598720    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:44.705471 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:44.705417    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:44.810803 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:44.810748    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:51.302378 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:51.302340    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:51.372100 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:51.372057    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:52.487134 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:52.487100    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:52.580221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:52.580173    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:55.963831 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:55.963797    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:56.066389 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:56.066313    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:56.134104 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:56.134074    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:59.317186 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:59.317151    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:59.418196 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:59.418169    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:24:59.497557 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:24:59.497526    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:07.483192 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:07.483154    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:07.554177 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:07.554143    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:15.946815 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:15.946781    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:21.311754 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:21.311715    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:21.327944 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:21.327917    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:21.779975 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:21.779889    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:30.858141 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:30.858105    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:30.923114 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:30.923078    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:32.328340 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:32.328297    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:35.219953 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.219917    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:25:35.220463 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.220205    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="alertmanager" containerID="cri-o://a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1" gracePeriod=120
Jul 10 02:25:35.220463 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.220311    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="prom-label-proxy" containerID="cri-o://c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d" gracePeriod=120
Jul 10 02:25:35.220463 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.220363    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="config-reloader" containerID="cri-o://d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc" gracePeriod=120
Jul 10 02:25:35.220463 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.220362    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="kube-rbac-proxy-web" containerID="cri-o://6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053" gracePeriod=120
Jul 10 02:25:35.220463 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.220294    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="kube-rbac-proxy-metric" containerID="cri-o://3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593" gracePeriod=120
Jul 10 02:25:35.220463 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.220447    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="kube-rbac-proxy" containerID="cri-o://53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa" gracePeriod=120
Jul 10 02:25:35.824104 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.824071    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerID="c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d" exitCode=0
Jul 10 02:25:35.824104 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.824097    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerID="53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa" exitCode=0
Jul 10 02:25:35.824104 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.824105    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerID="d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc" exitCode=0
Jul 10 02:25:35.824104 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.824110    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerID="a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1" exitCode=0
Jul 10 02:25:35.824405 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.824144    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerDied","Data":"c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d"}
Jul 10 02:25:35.824405 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.824208    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerDied","Data":"53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa"}
Jul 10 02:25:35.824405 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.824234    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerDied","Data":"d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc"}
Jul 10 02:25:35.824405 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:35.824260    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerDied","Data":"a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1"}
Jul 10 02:25:36.482093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.482068    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.558514 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558483    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-web-config\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.558700 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558544    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy-web\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.558700 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558575    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.558700 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558608    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4cqr7\" (UniqueName: \"kubernetes.io/projected/1f486b66-c9c9-4cd1-a258-ea893f5036f3-kube-api-access-4cqr7\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.558700 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558633    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-main-tls\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.558700 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558656    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f486b66-c9c9-4cd1-a258-ea893f5036f3-tls-assets\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.558700 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558687    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f486b66-c9c9-4cd1-a258-ea893f5036f3-alertmanager-main-db\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.559036 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558747    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.559036 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558778    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-cluster-tls-config\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.559036 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558815    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-config-volume\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.559036 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558855    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f486b66-c9c9-4cd1-a258-ea893f5036f3-metrics-client-ca\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.559036 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558901    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f486b66-c9c9-4cd1-a258-ea893f5036f3-config-out\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.559263 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.558953    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f486b66-c9c9-4cd1-a258-ea893f5036f3-alertmanager-trusted-ca-bundle\") pod \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\" (UID: \"1f486b66-c9c9-4cd1-a258-ea893f5036f3\") "
Jul 10 02:25:36.559930 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.559637    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f486b66-c9c9-4cd1-a258-ea893f5036f3-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:25:36.559930 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.559682    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f486b66-c9c9-4cd1-a258-ea893f5036f3-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:25:36.561718 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.561683    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f486b66-c9c9-4cd1-a258-ea893f5036f3-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:25:36.563938 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.563903    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:36.564101 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.564073    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:36.564343 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.564269    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f486b66-c9c9-4cd1-a258-ea893f5036f3-kube-api-access-4cqr7" (OuterVolumeSpecName: "kube-api-access-4cqr7") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "kube-api-access-4cqr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:25:36.564433 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.564376    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:36.564594 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.564558    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-config-volume" (OuterVolumeSpecName: "config-volume") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:36.564784 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.564754    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f486b66-c9c9-4cd1-a258-ea893f5036f3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:25:36.565252 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.565224    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:36.566274 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.566246    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f486b66-c9c9-4cd1-a258-ea893f5036f3-config-out" (OuterVolumeSpecName: "config-out") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:25:36.567825 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.567802    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:36.575954 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.575922    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-web-config" (OuterVolumeSpecName: "web-config") pod "1f486b66-c9c9-4cd1-a258-ea893f5036f3" (UID: "1f486b66-c9c9-4cd1-a258-ea893f5036f3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:36.660479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660439    2553 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-config-volume\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.660479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660474    2553 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f486b66-c9c9-4cd1-a258-ea893f5036f3-metrics-client-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.660479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660490    2553 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f486b66-c9c9-4cd1-a258-ea893f5036f3-config-out\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.660741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660505    2553 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f486b66-c9c9-4cd1-a258-ea893f5036f3-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.660741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660518    2553 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-web-config\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.660741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660530    2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.660741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660541    2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.660741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660555    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4cqr7\" (UniqueName: \"kubernetes.io/projected/1f486b66-c9c9-4cd1-a258-ea893f5036f3-kube-api-access-4cqr7\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.660741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660568    2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-main-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.660741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660578    2553 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f486b66-c9c9-4cd1-a258-ea893f5036f3-tls-assets\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.660741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660589    2553 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f486b66-c9c9-4cd1-a258-ea893f5036f3-alertmanager-main-db\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.660741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660600    2553 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.660741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.660611    2553 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f486b66-c9c9-4cd1-a258-ea893f5036f3-cluster-tls-config\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:36.832097 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.832008    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerID="3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593" exitCode=0
Jul 10 02:25:36.832097 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.832037    2553 generic.go:356] "Generic (PLEG): container finished" podID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerID="6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053" exitCode=0
Jul 10 02:25:36.832097 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.832082    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.832097 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.832086    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerDied","Data":"3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593"}
Jul 10 02:25:36.832348 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.832158    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerDied","Data":"6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053"}
Jul 10 02:25:36.832348 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.832188    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f486b66-c9c9-4cd1-a258-ea893f5036f3","Type":"ContainerDied","Data":"d0774a2964adbf41d0589ab2d56ec1d907b5648d52a0299355e6dc09d20f5adb"}
Jul 10 02:25:36.832348 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.832224    2553 scope.go:117] "RemoveContainer" containerID="c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d"
Jul 10 02:25:36.840591 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.840573    2553 scope.go:117] "RemoveContainer" containerID="3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593"
Jul 10 02:25:36.847791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.847774    2553 scope.go:117] "RemoveContainer" containerID="53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa"
Jul 10 02:25:36.854433 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.854414    2553 scope.go:117] "RemoveContainer" containerID="6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053"
Jul 10 02:25:36.857976 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.857937    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:25:36.862609 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.862581    2553 scope.go:117] "RemoveContainer" containerID="d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc"
Jul 10 02:25:36.863730 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.863712    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:25:36.870309 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.870293    2553 scope.go:117] "RemoveContainer" containerID="a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1"
Jul 10 02:25:36.877938 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.877918    2553 scope.go:117] "RemoveContainer" containerID="51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013"
Jul 10 02:25:36.884926 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.884909    2553 scope.go:117] "RemoveContainer" containerID="c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d"
Jul 10 02:25:36.885285 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:36.885233    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d\": container with ID starting with c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d not found: ID does not exist" containerID="c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d"
Jul 10 02:25:36.885332 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.885294    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d"} err="failed to get container status \"c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d\": rpc error: code = NotFound desc = could not find container \"c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d\": container with ID starting with c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d not found: ID does not exist"
Jul 10 02:25:36.885332 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.885327    2553 scope.go:117] "RemoveContainer" containerID="3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593"
Jul 10 02:25:36.885571 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:36.885555    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593\": container with ID starting with 3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593 not found: ID does not exist" containerID="3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593"
Jul 10 02:25:36.885613 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.885577    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593"} err="failed to get container status \"3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593\": rpc error: code = NotFound desc = could not find container \"3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593\": container with ID starting with 3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593 not found: ID does not exist"
Jul 10 02:25:36.885613 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.885593    2553 scope.go:117] "RemoveContainer" containerID="53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa"
Jul 10 02:25:36.885800 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:36.885785    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa\": container with ID starting with 53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa not found: ID does not exist" containerID="53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa"
Jul 10 02:25:36.885839 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.885803    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa"} err="failed to get container status \"53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa\": rpc error: code = NotFound desc = could not find container \"53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa\": container with ID starting with 53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa not found: ID does not exist"
Jul 10 02:25:36.885839 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.885815    2553 scope.go:117] "RemoveContainer" containerID="6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053"
Jul 10 02:25:36.886035 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:36.886019    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053\": container with ID starting with 6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053 not found: ID does not exist" containerID="6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053"
Jul 10 02:25:36.886090 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.886038    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053"} err="failed to get container status \"6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053\": rpc error: code = NotFound desc = could not find container \"6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053\": container with ID starting with 6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053 not found: ID does not exist"
Jul 10 02:25:36.886090 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.886051    2553 scope.go:117] "RemoveContainer" containerID="d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc"
Jul 10 02:25:36.886318 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:36.886303    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc\": container with ID starting with d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc not found: ID does not exist" containerID="d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc"
Jul 10 02:25:36.886359 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.886323    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc"} err="failed to get container status \"d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc\": rpc error: code = NotFound desc = could not find container \"d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc\": container with ID starting with d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc not found: ID does not exist"
Jul 10 02:25:36.886359 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.886340    2553 scope.go:117] "RemoveContainer" containerID="a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1"
Jul 10 02:25:36.886563 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:36.886547    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1\": container with ID starting with a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1 not found: ID does not exist" containerID="a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1"
Jul 10 02:25:36.886603 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.886567    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1"} err="failed to get container status \"a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1\": rpc error: code = NotFound desc = could not find container \"a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1\": container with ID starting with a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1 not found: ID does not exist"
Jul 10 02:25:36.886603 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.886581    2553 scope.go:117] "RemoveContainer" containerID="51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013"
Jul 10 02:25:36.886789 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:36.886775    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013\": container with ID starting with 51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013 not found: ID does not exist" containerID="51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013"
Jul 10 02:25:36.886827 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.886794    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013"} err="failed to get container status \"51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013\": rpc error: code = NotFound desc = could not find container \"51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013\": container with ID starting with 51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013 not found: ID does not exist"
Jul 10 02:25:36.886827 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.886807    2553 scope.go:117] "RemoveContainer" containerID="c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d"
Jul 10 02:25:36.887030 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.887014    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d"} err="failed to get container status \"c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d\": rpc error: code = NotFound desc = could not find container \"c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d\": container with ID starting with c89167e78a5ebbe18c29366cff47183a8808202cec4ea37bd92b0ac5a2dbad6d not found: ID does not exist"
Jul 10 02:25:36.887070 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.887032    2553 scope.go:117] "RemoveContainer" containerID="3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593"
Jul 10 02:25:36.887273 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.887251    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593"} err="failed to get container status \"3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593\": rpc error: code = NotFound desc = could not find container \"3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593\": container with ID starting with 3aa1fc2a1478eb1e7f6c95732d062a7b0ea8c8edbd8fa1f9defc73cad9be3593 not found: ID does not exist"
Jul 10 02:25:36.887318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.887275    2553 scope.go:117] "RemoveContainer" containerID="53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa"
Jul 10 02:25:36.887499 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.887480    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa"} err="failed to get container status \"53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa\": rpc error: code = NotFound desc = could not find container \"53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa\": container with ID starting with 53069c910ec50044cd9df7d2f271a87221ed27867085e295e52dfebae2f967aa not found: ID does not exist"
Jul 10 02:25:36.887542 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.887499    2553 scope.go:117] "RemoveContainer" containerID="6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053"
Jul 10 02:25:36.887747 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.887727    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053"} err="failed to get container status \"6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053\": rpc error: code = NotFound desc = could not find container \"6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053\": container with ID starting with 6ffe43212d6eacd0b2c234abfa2cd46cb1aacaa62e6eeb85ab6c6e14f7e40053 not found: ID does not exist"
Jul 10 02:25:36.887826 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.887749    2553 scope.go:117] "RemoveContainer" containerID="d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc"
Jul 10 02:25:36.888045 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.888018    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc"} err="failed to get container status \"d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc\": rpc error: code = NotFound desc = could not find container \"d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc\": container with ID starting with d33a6995e24d8a8c250b8f369e4072a5a5a90c18ec6ec4678cf2c1168a8238bc not found: ID does not exist"
Jul 10 02:25:36.888045 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.888042    2553 scope.go:117] "RemoveContainer" containerID="a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1"
Jul 10 02:25:36.888415 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.888369    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1"} err="failed to get container status \"a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1\": rpc error: code = NotFound desc = could not find container \"a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1\": container with ID starting with a13b877225c2508948d69d819a7f69dbc6f0bf4fffb6ca21ee75322eae9056c1 not found: ID does not exist"
Jul 10 02:25:36.888415 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.888395    2553 scope.go:117] "RemoveContainer" containerID="51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013"
Jul 10 02:25:36.888695 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.888662    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013"} err="failed to get container status \"51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013\": rpc error: code = NotFound desc = could not find container \"51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013\": container with ID starting with 51513309f309416eed46fdc23aca7083389418b12e1f04e582c2b40436971013 not found: ID does not exist"
Jul 10 02:25:36.898171 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898149    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:25:36.898454 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898443    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="kube-rbac-proxy"
Jul 10 02:25:36.898502 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898457    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="kube-rbac-proxy"
Jul 10 02:25:36.898502 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898467    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="config-reloader"
Jul 10 02:25:36.898502 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898473    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="config-reloader"
Jul 10 02:25:36.898502 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898481    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="init-config-reloader"
Jul 10 02:25:36.898502 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898486    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="init-config-reloader"
Jul 10 02:25:36.898502 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898493    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="prom-label-proxy"
Jul 10 02:25:36.898502 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898498    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="prom-label-proxy"
Jul 10 02:25:36.898702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898517    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="alertmanager"
Jul 10 02:25:36.898702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898523    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="alertmanager"
Jul 10 02:25:36.898702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898529    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="kube-rbac-proxy-metric"
Jul 10 02:25:36.898702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898533    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="kube-rbac-proxy-metric"
Jul 10 02:25:36.898702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898544    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="kube-rbac-proxy-web"
Jul 10 02:25:36.898702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898549    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="kube-rbac-proxy-web"
Jul 10 02:25:36.898702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898592    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="kube-rbac-proxy"
Jul 10 02:25:36.898702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898599    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="alertmanager"
Jul 10 02:25:36.898702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898604    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="config-reloader"
Jul 10 02:25:36.898702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898612    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="kube-rbac-proxy-metric"
Jul 10 02:25:36.898702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898619    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="prom-label-proxy"
Jul 10 02:25:36.898702 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.898623    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" containerName="kube-rbac-proxy-web"
Jul 10 02:25:36.903610 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.903588    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.906567 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.906546    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 10 02:25:36.906670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.906546    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 10 02:25:36.907550 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.907533    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 10 02:25:36.907649 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.907535    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 10 02:25:36.907921 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.907893    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-lwz96\""
Jul 10 02:25:36.908064 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.907928    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 10 02:25:36.908260 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.908243    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 10 02:25:36.908337 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.908326    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 10 02:25:36.908393 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.908333    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 10 02:25:36.918812 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.915814    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 10 02:25:36.923929 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.923898    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:25:36.963240 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963202    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.963240 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963250    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.963488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963275    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.963488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963315    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-config-out\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.963488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963342    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhq8k\" (UniqueName: \"kubernetes.io/projected/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-kube-api-access-bhq8k\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.963488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963373    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.963488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963400    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.963488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963419    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.963488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963436    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-web-config\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.963488 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963485    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.963760 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963519    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.963760 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963540    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:36.963760 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:36.963602    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.064538 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064478    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.064538 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064542    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.064804 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064588    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.064804 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064615    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.064804 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064635    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-config-out\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.064804 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064656    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhq8k\" (UniqueName: \"kubernetes.io/projected/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-kube-api-access-bhq8k\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.064804 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064687    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.064804 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064710    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.064804 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064735    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.064804 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064764    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-web-config\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.065231 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064813    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.065231 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064860    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.065231 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.064891    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.065409 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.065380    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.065680 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.065651    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.065793 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.065776    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.067699 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.067673    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-config-out\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.067808 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.067774    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.067808 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.067797    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.068033 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.068006    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-config-volume\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.068033 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.068029    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.068379 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.068358    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.068467 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.068449    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-web-config\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.068574 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.068556    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.069587 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.069568    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.073475 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.073449    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhq8k\" (UniqueName: \"kubernetes.io/projected/7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38-kube-api-access-bhq8k\") pod \"alertmanager-main-0\" (UID: \"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.213929 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.213842    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 10 02:25:37.367185 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.367144    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 10 02:25:37.368718 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:25:37.368692    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8b5a6c_2aca_4aa0_a7f6_a4b83cef3a38.slice/crio-5e76dced0fd06f7ec47c4a8b7e9b0d7d12fcd215dc02922503495640daaee71f WatchSource:0}: Error finding container 5e76dced0fd06f7ec47c4a8b7e9b0d7d12fcd215dc02922503495640daaee71f: Status 404 returned error can't find the container with id 5e76dced0fd06f7ec47c4a8b7e9b0d7d12fcd215dc02922503495640daaee71f
Jul 10 02:25:37.838378 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.838346    2553 generic.go:356] "Generic (PLEG): container finished" podID="7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38" containerID="d25e340e42eb56ca7bc697e8732a31c523c751e25ffd294cb1dac8595a001584" exitCode=0
Jul 10 02:25:37.838736 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.838429    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38","Type":"ContainerDied","Data":"d25e340e42eb56ca7bc697e8732a31c523c751e25ffd294cb1dac8595a001584"}
Jul 10 02:25:37.838736 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:37.838497    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38","Type":"ContainerStarted","Data":"5e76dced0fd06f7ec47c4a8b7e9b0d7d12fcd215dc02922503495640daaee71f"}
Jul 10 02:25:38.008204 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:38.008172    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f486b66-c9c9-4cd1-a258-ea893f5036f3" path="/var/lib/kubelet/pods/1f486b66-c9c9-4cd1-a258-ea893f5036f3/volumes"
Jul 10 02:25:38.845232 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:38.845195    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38","Type":"ContainerStarted","Data":"752d5442695daaa83aa80fcbaddc5b346bafec1b918ea1c06c2b026d526ee559"}
Jul 10 02:25:38.845616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:38.845286    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38","Type":"ContainerStarted","Data":"5a53eb2ca531fbe439f88488b241eb8b98adb9aa36d98d9440f3cb2dd33407ee"}
Jul 10 02:25:38.845616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:38.845312    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38","Type":"ContainerStarted","Data":"87ee1b14c6aa46b977b3d053471dfc8617f10ac338d5b18e7a5c96e526a3831a"}
Jul 10 02:25:38.845616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:38.845340    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38","Type":"ContainerStarted","Data":"385f35e623105d6bfe5474a38979340f1c6d5a18b5af7cf3fb2b79299aa7cb38"}
Jul 10 02:25:38.845616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:38.845363    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38","Type":"ContainerStarted","Data":"b5fe45d7b5402ad7919c95370125b4c6877068eae997c961758b25d542d6d713"}
Jul 10 02:25:38.845616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:38.845386    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38","Type":"ContainerStarted","Data":"9100488d1baabad67744da220bb4a74191455802b0c2df3b6522bf4406946080"}
Jul 10 02:25:38.884722 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:38.884652    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8682998 podStartE2EDuration="2.884630074s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.330274ms" isStatefulPod=false podCreationTimestamp="2026-07-10 02:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:25:38.883428302 +0000 UTC m=+171.404406612" watchObservedRunningTime="2026-07-10 02:25:38.884630074 +0000 UTC m=+171.405608384"
Jul 10 02:25:39.521312 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.521268    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:25:39.521701 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.521646    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="prometheus" containerID="cri-o://0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71" gracePeriod=600
Jul 10 02:25:39.521815 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.521734    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276" gracePeriod=600
Jul 10 02:25:39.521904 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.521787    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="kube-rbac-proxy-web" containerID="cri-o://821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790" gracePeriod=600
Jul 10 02:25:39.521904 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.521837    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="thanos-sidecar" containerID="cri-o://63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba" gracePeriod=600
Jul 10 02:25:39.521904 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.521854    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="config-reloader" containerID="cri-o://855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1" gracePeriod=600
Jul 10 02:25:39.522081 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.521984    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="kube-rbac-proxy" containerID="cri-o://f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6" gracePeriod=600
Jul 10 02:25:39.780264 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.779853    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:39.853386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853347    2553 generic.go:356] "Generic (PLEG): container finished" podID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerID="b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276" exitCode=0
Jul 10 02:25:39.853386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853376    2553 generic.go:356] "Generic (PLEG): container finished" podID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerID="f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6" exitCode=0
Jul 10 02:25:39.853386 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853386    2553 generic.go:356] "Generic (PLEG): container finished" podID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerID="821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790" exitCode=0
Jul 10 02:25:39.853896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853396    2553 generic.go:356] "Generic (PLEG): container finished" podID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerID="63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba" exitCode=0
Jul 10 02:25:39.853896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853407    2553 generic.go:356] "Generic (PLEG): container finished" podID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerID="855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1" exitCode=0
Jul 10 02:25:39.853896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853414    2553 generic.go:356] "Generic (PLEG): container finished" podID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerID="0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71" exitCode=0
Jul 10 02:25:39.853896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853426    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:39.853896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853426    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerDied","Data":"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"}
Jul 10 02:25:39.853896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853550    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerDied","Data":"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"}
Jul 10 02:25:39.853896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853579    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerDied","Data":"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"}
Jul 10 02:25:39.853896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853607    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerDied","Data":"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"}
Jul 10 02:25:39.853896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853630    2553 scope.go:117] "RemoveContainer" containerID="b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"
Jul 10 02:25:39.853896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853637    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerDied","Data":"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"}
Jul 10 02:25:39.853896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853665    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerDied","Data":"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"}
Jul 10 02:25:39.853896 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.853688    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c7f356de-d116-4319-b1d2-c1e7cafcd186","Type":"ContainerDied","Data":"ce537b69a725129b10897924e3d1b89c32a7072a0e7e31203b001ec5f5bf3418"}
Jul 10 02:25:39.861816 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.861796    2553 scope.go:117] "RemoveContainer" containerID="f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"
Jul 10 02:25:39.869943 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.869918    2553 scope.go:117] "RemoveContainer" containerID="821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"
Jul 10 02:25:39.878404 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.878379    2553 scope.go:117] "RemoveContainer" containerID="63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"
Jul 10 02:25:39.885397 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.885379    2553 scope.go:117] "RemoveContainer" containerID="855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"
Jul 10 02:25:39.891617 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891591    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-kube-rbac-proxy\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.891741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891626    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-grpc-tls\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.891741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891651    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-1\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.891741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891672    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-db\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.891741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891698    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.891741 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891729    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-thanos-prometheus-http-client-file\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891752    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qwpv\" (UniqueName: \"kubernetes.io/projected/c7f356de-d116-4319-b1d2-c1e7cafcd186-kube-api-access-6qwpv\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891780    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891812    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7f356de-d116-4319-b1d2-c1e7cafcd186-tls-assets\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891837    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-tls\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891887    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-config\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891921    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-kubelet-serving-ca-bundle\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.891954    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-0\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.892010    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:25:39.892169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.892026    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-metrics-client-certs\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.892086    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-trusted-ca-bundle\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.892120    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7f356de-d116-4319-b1d2-c1e7cafcd186-config-out\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.892152    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-serving-certs-ca-bundle\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892729 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.892202    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-web-config\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892729 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.892229    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-metrics-client-ca\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892729 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.892268    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-2\") pod \"c7f356de-d116-4319-b1d2-c1e7cafcd186\" (UID: \"c7f356de-d116-4319-b1d2-c1e7cafcd186\") "
Jul 10 02:25:39.892729 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.892616    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.892921 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.892887    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:25:39.893656 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.893260    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:25:39.893656 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.893285    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:25:39.893656 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.893369    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:25:39.894462 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.894356    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:25:39.894462 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.894447    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:39.895083 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.895056    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:25:39.895177 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.895133    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:39.895292 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.895271    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:39.895408 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.895367    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:39.895672 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.895435    2553 scope.go:117] "RemoveContainer" containerID="0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"
Jul 10 02:25:39.895767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.895678    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:25:39.896017 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.895894    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:39.896017 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.895897    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7f356de-d116-4319-b1d2-c1e7cafcd186-config-out" (OuterVolumeSpecName: "config-out") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:25:39.896264 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.896224    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:39.897028 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.896993    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7f356de-d116-4319-b1d2-c1e7cafcd186-kube-api-access-6qwpv" (OuterVolumeSpecName: "kube-api-access-6qwpv") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "kube-api-access-6qwpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:25:39.897028 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.897001    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-config" (OuterVolumeSpecName: "config") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:39.897028 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.897002    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7f356de-d116-4319-b1d2-c1e7cafcd186-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:25:39.897593 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.897570    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:39.903509 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.903491    2553 scope.go:117] "RemoveContainer" containerID="f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"
Jul 10 02:25:39.908459 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.908434    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-web-config" (OuterVolumeSpecName: "web-config") pod "c7f356de-d116-4319-b1d2-c1e7cafcd186" (UID: "c7f356de-d116-4319-b1d2-c1e7cafcd186"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:25:39.910770 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.910754    2553 scope.go:117] "RemoveContainer" containerID="b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"
Jul 10 02:25:39.911085 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:39.911066    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": container with ID starting with b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276 not found: ID does not exist" containerID="b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"
Jul 10 02:25:39.911145 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.911092    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"} err="failed to get container status \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": rpc error: code = NotFound desc = could not find container \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": container with ID starting with b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276 not found: ID does not exist"
Jul 10 02:25:39.911145 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.911110    2553 scope.go:117] "RemoveContainer" containerID="f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"
Jul 10 02:25:39.911365 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:39.911346    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": container with ID starting with f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6 not found: ID does not exist" containerID="f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"
Jul 10 02:25:39.911427 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.911376    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"} err="failed to get container status \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": rpc error: code = NotFound desc = could not find container \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": container with ID starting with f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6 not found: ID does not exist"
Jul 10 02:25:39.911427 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.911400    2553 scope.go:117] "RemoveContainer" containerID="821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"
Jul 10 02:25:39.911662 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:39.911646    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": container with ID starting with 821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790 not found: ID does not exist" containerID="821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"
Jul 10 02:25:39.911705 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.911668    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"} err="failed to get container status \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": rpc error: code = NotFound desc = could not find container \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": container with ID starting with 821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790 not found: ID does not exist"
Jul 10 02:25:39.911705 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.911683    2553 scope.go:117] "RemoveContainer" containerID="63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"
Jul 10 02:25:39.911881 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:39.911864    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": container with ID starting with 63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba not found: ID does not exist" containerID="63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"
Jul 10 02:25:39.911944 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.911889    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"} err="failed to get container status \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": rpc error: code = NotFound desc = could not find container \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": container with ID starting with 63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba not found: ID does not exist"
Jul 10 02:25:39.911944 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.911912    2553 scope.go:117] "RemoveContainer" containerID="855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"
Jul 10 02:25:39.912146 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:39.912131    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": container with ID starting with 855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1 not found: ID does not exist" containerID="855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"
Jul 10 02:25:39.912182 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.912151    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"} err="failed to get container status \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": rpc error: code = NotFound desc = could not find container \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": container with ID starting with 855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1 not found: ID does not exist"
Jul 10 02:25:39.912182 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.912164    2553 scope.go:117] "RemoveContainer" containerID="0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"
Jul 10 02:25:39.912343 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:39.912328    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": container with ID starting with 0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71 not found: ID does not exist" containerID="0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"
Jul 10 02:25:39.912382 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.912346    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"} err="failed to get container status \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": rpc error: code = NotFound desc = could not find container \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": container with ID starting with 0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71 not found: ID does not exist"
Jul 10 02:25:39.912382 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.912357    2553 scope.go:117] "RemoveContainer" containerID="f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"
Jul 10 02:25:39.912548 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:25:39.912534    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": container with ID starting with f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260 not found: ID does not exist" containerID="f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"
Jul 10 02:25:39.912587 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.912551    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"} err="failed to get container status \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": rpc error: code = NotFound desc = could not find container \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": container with ID starting with f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260 not found: ID does not exist"
Jul 10 02:25:39.912587 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.912562    2553 scope.go:117] "RemoveContainer" containerID="b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"
Jul 10 02:25:39.912797 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.912782    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"} err="failed to get container status \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": rpc error: code = NotFound desc = could not find container \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": container with ID starting with b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276 not found: ID does not exist"
Jul 10 02:25:39.912797 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.912797    2553 scope.go:117] "RemoveContainer" containerID="f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"
Jul 10 02:25:39.912997 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.912948    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"} err="failed to get container status \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": rpc error: code = NotFound desc = could not find container \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": container with ID starting with f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6 not found: ID does not exist"
Jul 10 02:25:39.913085 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.913073    2553 scope.go:117] "RemoveContainer" containerID="821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"
Jul 10 02:25:39.913270 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.913254    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"} err="failed to get container status \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": rpc error: code = NotFound desc = could not find container \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": container with ID starting with 821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790 not found: ID does not exist"
Jul 10 02:25:39.913322 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.913270    2553 scope.go:117] "RemoveContainer" containerID="63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"
Jul 10 02:25:39.913468 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.913445    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"} err="failed to get container status \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": rpc error: code = NotFound desc = could not find container \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": container with ID starting with 63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba not found: ID does not exist"
Jul 10 02:25:39.913529 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.913470    2553 scope.go:117] "RemoveContainer" containerID="855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"
Jul 10 02:25:39.913694 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.913678    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"} err="failed to get container status \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": rpc error: code = NotFound desc = could not find container \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": container with ID starting with 855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1 not found: ID does not exist"
Jul 10 02:25:39.913740 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.913694    2553 scope.go:117] "RemoveContainer" containerID="0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"
Jul 10 02:25:39.913899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.913881    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"} err="failed to get container status \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": rpc error: code = NotFound desc = could not find container \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": container with ID starting with 0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71 not found: ID does not exist"
Jul 10 02:25:39.913988 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.913901    2553 scope.go:117] "RemoveContainer" containerID="f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"
Jul 10 02:25:39.914142 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.914121    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"} err="failed to get container status \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": rpc error: code = NotFound desc = could not find container \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": container with ID starting with f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260 not found: ID does not exist"
Jul 10 02:25:39.914182 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.914145    2553 scope.go:117] "RemoveContainer" containerID="b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"
Jul 10 02:25:39.914378 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.914361    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"} err="failed to get container status \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": rpc error: code = NotFound desc = could not find container \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": container with ID starting with b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276 not found: ID does not exist"
Jul 10 02:25:39.914439 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.914380    2553 scope.go:117] "RemoveContainer" containerID="f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"
Jul 10 02:25:39.914582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.914566    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"} err="failed to get container status \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": rpc error: code = NotFound desc = could not find container \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": container with ID starting with f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6 not found: ID does not exist"
Jul 10 02:25:39.914639 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.914583    2553 scope.go:117] "RemoveContainer" containerID="821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"
Jul 10 02:25:39.914776 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.914757    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"} err="failed to get container status \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": rpc error: code = NotFound desc = could not find container \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": container with ID starting with 821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790 not found: ID does not exist"
Jul 10 02:25:39.914818 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.914777    2553 scope.go:117] "RemoveContainer" containerID="63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"
Jul 10 02:25:39.915027 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.915006    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"} err="failed to get container status \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": rpc error: code = NotFound desc = could not find container \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": container with ID starting with 63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba not found: ID does not exist"
Jul 10 02:25:39.915027 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.915027    2553 scope.go:117] "RemoveContainer" containerID="855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"
Jul 10 02:25:39.915217 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.915202    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"} err="failed to get container status \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": rpc error: code = NotFound desc = could not find container \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": container with ID starting with 855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1 not found: ID does not exist"
Jul 10 02:25:39.915217 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.915216    2553 scope.go:117] "RemoveContainer" containerID="0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"
Jul 10 02:25:39.915429 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.915412    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"} err="failed to get container status \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": rpc error: code = NotFound desc = could not find container \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": container with ID starting with 0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71 not found: ID does not exist"
Jul 10 02:25:39.915470 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.915429    2553 scope.go:117] "RemoveContainer" containerID="f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"
Jul 10 02:25:39.915604 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.915589    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"} err="failed to get container status \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": rpc error: code = NotFound desc = could not find container \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": container with ID starting with f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260 not found: ID does not exist"
Jul 10 02:25:39.915646 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.915604    2553 scope.go:117] "RemoveContainer" containerID="b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"
Jul 10 02:25:39.915797 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.915780    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"} err="failed to get container status \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": rpc error: code = NotFound desc = could not find container \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": container with ID starting with b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276 not found: ID does not exist"
Jul 10 02:25:39.915838 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.915798    2553 scope.go:117] "RemoveContainer" containerID="f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"
Jul 10 02:25:39.916000 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.915985    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"} err="failed to get container status \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": rpc error: code = NotFound desc = could not find container \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": container with ID starting with f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6 not found: ID does not exist"
Jul 10 02:25:39.916048 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.916001    2553 scope.go:117] "RemoveContainer" containerID="821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"
Jul 10 02:25:39.916187 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.916172    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"} err="failed to get container status \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": rpc error: code = NotFound desc = could not find container \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": container with ID starting with 821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790 not found: ID does not exist"
Jul 10 02:25:39.916236 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.916186    2553 scope.go:117] "RemoveContainer" containerID="63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"
Jul 10 02:25:39.916367 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.916351    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"} err="failed to get container status \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": rpc error: code = NotFound desc = could not find container \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": container with ID starting with 63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba not found: ID does not exist"
Jul 10 02:25:39.916409 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.916367    2553 scope.go:117] "RemoveContainer" containerID="855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"
Jul 10 02:25:39.916559 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.916543    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"} err="failed to get container status \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": rpc error: code = NotFound desc = could not find container \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": container with ID starting with 855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1 not found: ID does not exist"
Jul 10 02:25:39.916602 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.916559    2553 scope.go:117] "RemoveContainer" containerID="0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"
Jul 10 02:25:39.916728 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.916713    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"} err="failed to get container status \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": rpc error: code = NotFound desc = could not find container \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": container with ID starting with 0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71 not found: ID does not exist"
Jul 10 02:25:39.916777 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.916726    2553 scope.go:117] "RemoveContainer" containerID="f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"
Jul 10 02:25:39.916946 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.916930    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"} err="failed to get container status \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": rpc error: code = NotFound desc = could not find container \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": container with ID starting with f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260 not found: ID does not exist"
Jul 10 02:25:39.917008 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.916945    2553 scope.go:117] "RemoveContainer" containerID="b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"
Jul 10 02:25:39.917148 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.917132    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"} err="failed to get container status \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": rpc error: code = NotFound desc = could not find container \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": container with ID starting with b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276 not found: ID does not exist"
Jul 10 02:25:39.917189 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.917148    2553 scope.go:117] "RemoveContainer" containerID="f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"
Jul 10 02:25:39.917335 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.917319    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"} err="failed to get container status \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": rpc error: code = NotFound desc = could not find container \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": container with ID starting with f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6 not found: ID does not exist"
Jul 10 02:25:39.917376 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.917335    2553 scope.go:117] "RemoveContainer" containerID="821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"
Jul 10 02:25:39.917510 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.917495    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"} err="failed to get container status \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": rpc error: code = NotFound desc = could not find container \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": container with ID starting with 821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790 not found: ID does not exist"
Jul 10 02:25:39.917547 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.917510    2553 scope.go:117] "RemoveContainer" containerID="63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"
Jul 10 02:25:39.917690 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.917672    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"} err="failed to get container status \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": rpc error: code = NotFound desc = could not find container \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": container with ID starting with 63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba not found: ID does not exist"
Jul 10 02:25:39.917728 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.917689    2553 scope.go:117] "RemoveContainer" containerID="855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"
Jul 10 02:25:39.917879 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.917865    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"} err="failed to get container status \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": rpc error: code = NotFound desc = could not find container \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": container with ID starting with 855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1 not found: ID does not exist"
Jul 10 02:25:39.917921 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.917879    2553 scope.go:117] "RemoveContainer" containerID="0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"
Jul 10 02:25:39.918082 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.918066    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"} err="failed to get container status \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": rpc error: code = NotFound desc = could not find container \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": container with ID starting with 0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71 not found: ID does not exist"
Jul 10 02:25:39.918130 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.918082    2553 scope.go:117] "RemoveContainer" containerID="f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"
Jul 10 02:25:39.918275 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.918259    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"} err="failed to get container status \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": rpc error: code = NotFound desc = could not find container \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": container with ID starting with f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260 not found: ID does not exist"
Jul 10 02:25:39.918323 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.918276    2553 scope.go:117] "RemoveContainer" containerID="b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"
Jul 10 02:25:39.918463 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.918447    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276"} err="failed to get container status \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": rpc error: code = NotFound desc = could not find container \"b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276\": container with ID starting with b09deea6e6a654b246fd70138b8b42b100b48638ef98eb597a1dd327e1824276 not found: ID does not exist"
Jul 10 02:25:39.918463 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.918462    2553 scope.go:117] "RemoveContainer" containerID="f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"
Jul 10 02:25:39.918639 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.918624    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6"} err="failed to get container status \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": rpc error: code = NotFound desc = could not find container \"f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6\": container with ID starting with f405dc3be857838bf34ea027ce0723b8919a3baf18594827b928ac5330f501c6 not found: ID does not exist"
Jul 10 02:25:39.918677 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.918639    2553 scope.go:117] "RemoveContainer" containerID="821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"
Jul 10 02:25:39.918812 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.918796    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790"} err="failed to get container status \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": rpc error: code = NotFound desc = could not find container \"821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790\": container with ID starting with 821a7d88c51b2f79172d29a9aa87279e2bf974928d872241d9d86456e5b1a790 not found: ID does not exist"
Jul 10 02:25:39.918812 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.918811    2553 scope.go:117] "RemoveContainer" containerID="63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"
Jul 10 02:25:39.919063 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.919048    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba"} err="failed to get container status \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": rpc error: code = NotFound desc = could not find container \"63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba\": container with ID starting with 63932ac3557fc70e0789f174c442f01f95a526d28190d76db902dbc28be5edba not found: ID does not exist"
Jul 10 02:25:39.919063 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.919062    2553 scope.go:117] "RemoveContainer" containerID="855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"
Jul 10 02:25:39.919229 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.919214    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1"} err="failed to get container status \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": rpc error: code = NotFound desc = could not find container \"855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1\": container with ID starting with 855b946357114c2ca30a0410f31e1a158c539a8b5d64eb1187a1eecf2cde6ae1 not found: ID does not exist"
Jul 10 02:25:39.919271 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.919230    2553 scope.go:117] "RemoveContainer" containerID="0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"
Jul 10 02:25:39.919426 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.919410    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71"} err="failed to get container status \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": rpc error: code = NotFound desc = could not find container \"0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71\": container with ID starting with 0cd74451af9cdac6e5465d99703c70fec28655c5e48dad0baad7f04f67faad71 not found: ID does not exist"
Jul 10 02:25:39.919426 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.919425    2553 scope.go:117] "RemoveContainer" containerID="f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"
Jul 10 02:25:39.919610 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.919594    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260"} err="failed to get container status \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": rpc error: code = NotFound desc = could not find container \"f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260\": container with ID starting with f6bc7b4c17668e1b1d5c829a00bed84ec7cb21347f76bb891484dff27ce9d260 not found: ID does not exist"
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993370    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-db\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993408    2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993429    2553 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993445    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qwpv\" (UniqueName: \"kubernetes.io/projected/c7f356de-d116-4319-b1d2-c1e7cafcd186-kube-api-access-6qwpv\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993461    2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993477    2553 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c7f356de-d116-4319-b1d2-c1e7cafcd186-tls-assets\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993492    2553 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993506    2553 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-config\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993519    2553 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993533    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993546    2553 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-metrics-client-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993559    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993568    2553 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c7f356de-d116-4319-b1d2-c1e7cafcd186-config-out\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993576    2553 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.993561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993588    2553 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-web-config\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.994203 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993601    2553 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-configmap-metrics-client-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.994203 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993614    2553 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c7f356de-d116-4319-b1d2-c1e7cafcd186-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.994203 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993627    2553 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-kube-rbac-proxy\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:39.994203 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:39.993640    2553 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c7f356de-d116-4319-b1d2-c1e7cafcd186-secret-grpc-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:25:40.179227 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.179181    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:25:40.196420 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.196386    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:25:40.244513 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244436    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:25:40.244844 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244824    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="config-reloader"
Jul 10 02:25:40.244926 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244847    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="config-reloader"
Jul 10 02:25:40.244926 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244859    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="kube-rbac-proxy"
Jul 10 02:25:40.244926 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244867    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="kube-rbac-proxy"
Jul 10 02:25:40.244926 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244884    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="init-config-reloader"
Jul 10 02:25:40.244926 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244893    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="init-config-reloader"
Jul 10 02:25:40.244926 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244906    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="kube-rbac-proxy-thanos"
Jul 10 02:25:40.244926 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244915    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="kube-rbac-proxy-thanos"
Jul 10 02:25:40.245306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244936    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="thanos-sidecar"
Jul 10 02:25:40.245306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244944    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="thanos-sidecar"
Jul 10 02:25:40.245306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244958    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="kube-rbac-proxy-web"
Jul 10 02:25:40.245306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.244986    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="kube-rbac-proxy-web"
Jul 10 02:25:40.245306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.245009    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="prometheus"
Jul 10 02:25:40.245306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.245018    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="prometheus"
Jul 10 02:25:40.245306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.245096    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="prometheus"
Jul 10 02:25:40.245306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.245108    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="thanos-sidecar"
Jul 10 02:25:40.245306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.245122    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="kube-rbac-proxy"
Jul 10 02:25:40.245306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.245133    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="config-reloader"
Jul 10 02:25:40.245306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.245143    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="kube-rbac-proxy-web"
Jul 10 02:25:40.245306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.245151    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" containerName="kube-rbac-proxy-thanos"
Jul 10 02:25:40.250435 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.250412    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.256244 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.255950    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 10 02:25:40.256244 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.256024    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 10 02:25:40.256244 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.256049    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 02:25:40.256244 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.256058    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 10 02:25:40.256244 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.256118    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 10 02:25:40.256244 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.256049    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 10 02:25:40.256687 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.256252    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 10 02:25:40.256687 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.256567    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 10 02:25:40.256687 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.256618    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 10 02:25:40.256843 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.256724    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 10 02:25:40.256901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.256840    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 10 02:25:40.256901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.256873    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jwdw4\""
Jul 10 02:25:40.257281 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.257124    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 10 02:25:40.257281 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.257261    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-65b638e7m649f\""
Jul 10 02:25:40.266010 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.258406    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 10 02:25:40.267116 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.266926    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 10 02:25:40.269486 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.269457    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 10 02:25:40.278713 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.278683    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:25:40.398129 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398090    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398129 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398138    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398322 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398157    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398322 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398179    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl64s\" (UniqueName: \"kubernetes.io/projected/fa53d918-d255-4f4d-a728-6a3008b15259-kube-api-access-zl64s\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398322 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398239    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa53d918-d255-4f4d-a728-6a3008b15259-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398322 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398279    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398322 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398312    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-config\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398493 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398338    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398493 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398377    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398493 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398409    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398493 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398439    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398493 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398456    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398493 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398474    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398665 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398495    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398665 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398515    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398665 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398541    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398665 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398584    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa53d918-d255-4f4d-a728-6a3008b15259-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398665 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398601    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398665 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398616    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.398665 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.398631    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500116 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500035    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa53d918-d255-4f4d-a728-6a3008b15259-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500116 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500074    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500116 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500100    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-config\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500460 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500216    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500460 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500264    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500460 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500408    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500460 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500452    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500686 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500480    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500686 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500521    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500686 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500542    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500686 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500573    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500686 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500613    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500686 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500648    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa53d918-d255-4f4d-a728-6a3008b15259-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.500686 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500668    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.501072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500694    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.501072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500715    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.501072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500750    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.501072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500800    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.501072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500823    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.501072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500853    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl64s\" (UniqueName: \"kubernetes.io/projected/fa53d918-d255-4f4d-a728-6a3008b15259-kube-api-access-zl64s\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.501072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.500861    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.501072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.501043    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.502841 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.501564    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.502841 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.502222    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.502841 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.502502    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.503161 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.503124    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fa53d918-d255-4f4d-a728-6a3008b15259-config-out\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.503378 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.503357    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.503576 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.503549    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.503790 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.503767    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-config\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.503869 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.503799    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-web-config\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.504091 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.504064    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.504091 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.504078    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.504682 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.504662    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.505092 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.505067    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fa53d918-d255-4f4d-a728-6a3008b15259-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.505092 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.505087    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.506005 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.505984    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.506192 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.506175    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fa53d918-d255-4f4d-a728-6a3008b15259-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.506450 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.506430    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.506545 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.506529    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fa53d918-d255-4f4d-a728-6a3008b15259-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.512993 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.512952    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl64s\" (UniqueName: \"kubernetes.io/projected/fa53d918-d255-4f4d-a728-6a3008b15259-kube-api-access-zl64s\") pod \"prometheus-k8s-0\" (UID: \"fa53d918-d255-4f4d-a728-6a3008b15259\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.570166 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.570120    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:40.729872 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.729845    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 10 02:25:40.731541 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:25:40.731516    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa53d918_d255_4f4d_a728_6a3008b15259.slice/crio-d1f4a8cb39dd26611ec8ba7230bbb353d20dd478bfa94ca9565420bd4f5a0831 WatchSource:0}: Error finding container d1f4a8cb39dd26611ec8ba7230bbb353d20dd478bfa94ca9565420bd4f5a0831: Status 404 returned error can't find the container with id d1f4a8cb39dd26611ec8ba7230bbb353d20dd478bfa94ca9565420bd4f5a0831
Jul 10 02:25:40.859339 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.859301    2553 generic.go:356] "Generic (PLEG): container finished" podID="fa53d918-d255-4f4d-a728-6a3008b15259" containerID="270f739cc21121a7af64dcf11a22f595212f00c2c39e4a6120e069f8de91b179" exitCode=0
Jul 10 02:25:40.859779 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.859379    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa53d918-d255-4f4d-a728-6a3008b15259","Type":"ContainerDied","Data":"270f739cc21121a7af64dcf11a22f595212f00c2c39e4a6120e069f8de91b179"}
Jul 10 02:25:40.859779 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:40.859448    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa53d918-d255-4f4d-a728-6a3008b15259","Type":"ContainerStarted","Data":"d1f4a8cb39dd26611ec8ba7230bbb353d20dd478bfa94ca9565420bd4f5a0831"}
Jul 10 02:25:41.868078 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:41.868044    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa53d918-d255-4f4d-a728-6a3008b15259","Type":"ContainerStarted","Data":"655debbf65bdc2e62346e2a77b6c4b4ae061ae629cd12e7b8e3e473ef3d054a0"}
Jul 10 02:25:41.868469 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:41.868111    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa53d918-d255-4f4d-a728-6a3008b15259","Type":"ContainerStarted","Data":"fc2d58f757fb2cff314dd1c377f44c0ebb7a16dc79102c9a03ad63063bdcd40c"}
Jul 10 02:25:41.868469 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:41.868138    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa53d918-d255-4f4d-a728-6a3008b15259","Type":"ContainerStarted","Data":"a1a032ed03cefd291aa3470ae49116b322585fa97992f3782b623b9490e26741"}
Jul 10 02:25:41.868469 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:41.868163    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa53d918-d255-4f4d-a728-6a3008b15259","Type":"ContainerStarted","Data":"646541f6184d120f468a3827651f0bee3d35006f2c1ab7e7369d4cadc13796c6"}
Jul 10 02:25:41.868469 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:41.868186    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa53d918-d255-4f4d-a728-6a3008b15259","Type":"ContainerStarted","Data":"3c3a398770fd7f89b0dfc0da44202393681e41b12a0e9cd7c6e595894fae8f31"}
Jul 10 02:25:41.868469 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:41.868210    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fa53d918-d255-4f4d-a728-6a3008b15259","Type":"ContainerStarted","Data":"9493b70dbdc831fdc70b49468c7264307ad18123995eec4bfcab100269e82324"}
Jul 10 02:25:41.905479 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:41.905081    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.887865546 podStartE2EDuration="1.90505678s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.191234ms" isStatefulPod=false podCreationTimestamp="2026-07-10 02:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:25:41.90041046 +0000 UTC m=+174.421388770" watchObservedRunningTime="2026-07-10 02:25:41.90505678 +0000 UTC m=+174.426035089"
Jul 10 02:25:42.008673 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:42.008634    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7f356de-d116-4319-b1d2-c1e7cafcd186" path="/var/lib/kubelet/pods/c7f356de-d116-4319-b1d2-c1e7cafcd186/volumes"
Jul 10 02:25:42.755934 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:42.755895    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:42.825431 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:42.825395    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:43.177610 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:43.177583    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:43.278190 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:43.278157    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:43.350051 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:43.350022    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:45.570862 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:45.570825    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:25:52.478483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:52.478449    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:52.576406 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:52.576342    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:25:52.652059 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:25:52.652023    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:11.019537 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:11.019499    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:11.129499 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:11.129465    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:23.713285 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:23.713251    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:30.726538 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:30.726503    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:30.796899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:30.796867    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:38.159345 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:38.159303    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:38.501028 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:38.500942    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:40.570563 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:40.570528    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:26:40.586550 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:40.586507    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:26:41.128169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:41.128144    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 10 02:26:42.021650 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:42.021617    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:42.149683 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:42.149647    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:43.599537 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:43.599506    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:43.743285 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:43.743255    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:44.090285 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:44.090247    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:44.267341 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:44.267304    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:46.392587 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:46.392544    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:46.583871 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:46.583841    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:48.572744 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:48.572697    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:48.652266 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:48.652234    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:51.843767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:51.843729    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:54.077411 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:54.077377    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:55.675941 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:55.675901    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:26:55.778569 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:26:55.778541    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:02.034904 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:02.034873    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:02.133440 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:02.133408    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:03.834320 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:03.834292    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:16.630126 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:16.630032    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:16.726190 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:16.726153    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:17.304931 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:17.304866    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:17.771340 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:17.771244    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:17.888399 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:17.888354    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:17.950127 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:17.950100    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"]
Jul 10 02:27:17.953614 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:17.953594    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:17.956569 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:17.956544    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 02:27:17.956762 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:17.956669    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 02:27:17.956914 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:17.956891    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 02:27:17.957027 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:17.956943    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j45p7\""
Jul 10 02:27:17.957212 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:17.957195    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 02:27:17.983081 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:17.983040    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"]
Jul 10 02:27:18.028076 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.027984    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33082935-cd72-4064-bb27-85001f92e31d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.028076 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.028044    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33082935-cd72-4064-bb27-85001f92e31d-tmp\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.028263 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.028118    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/33082935-cd72-4064-bb27-85001f92e31d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.028263 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.028150    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/33082935-cd72-4064-bb27-85001f92e31d-manifests\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.028263 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.028210    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdcn5\" (UniqueName: \"kubernetes.io/projected/33082935-cd72-4064-bb27-85001f92e31d-kube-api-access-gdcn5\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.129209 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.129173    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33082935-cd72-4064-bb27-85001f92e31d-tmp\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.129393 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.129227    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/33082935-cd72-4064-bb27-85001f92e31d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.129393 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.129256    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/33082935-cd72-4064-bb27-85001f92e31d-manifests\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.129393 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.129314    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdcn5\" (UniqueName: \"kubernetes.io/projected/33082935-cd72-4064-bb27-85001f92e31d-kube-api-access-gdcn5\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.129393 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.129351    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33082935-cd72-4064-bb27-85001f92e31d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.129823 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.129799    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/33082935-cd72-4064-bb27-85001f92e31d-manifests\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.132019 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.131990    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/33082935-cd72-4064-bb27-85001f92e31d-tmp\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.132205 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.132183    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/33082935-cd72-4064-bb27-85001f92e31d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.132322 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.132301    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/33082935-cd72-4064-bb27-85001f92e31d-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.154492 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.154463    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdcn5\" (UniqueName: \"kubernetes.io/projected/33082935-cd72-4064-bb27-85001f92e31d-kube-api-access-gdcn5\") pod \"opendatahub-operator-controller-manager-7fc46458b-g2l8q\" (UID: \"33082935-cd72-4064-bb27-85001f92e31d\") " pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.184997 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.184939    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:18.264583 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.264547    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:18.304045 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.304013    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"]
Jul 10 02:27:18.307669 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.307639    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.311056 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.311034    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 02:27:18.311210 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.311060    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 02:27:18.311210 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.311175    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rp2w9\""
Jul 10 02:27:18.311210 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.311184    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 02:27:18.311397 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.311222    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 02:27:18.311469 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.311414    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 02:27:18.320584 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.320492    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:18.328023 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.327987    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"]
Jul 10 02:27:18.420370 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.420315    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:18.422596 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.422570    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"]
Jul 10 02:27:18.428212 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:27:18.428181    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33082935_cd72_4064_bb27_85001f92e31d.slice/crio-fa997c003fc48a7dfc04582a6f29b5614d190f2748528be95a42e3af61c7d65e WatchSource:0}: Error finding container fa997c003fc48a7dfc04582a6f29b5614d190f2748528be95a42e3af61c7d65e: Status 404 returned error can't find the container with id fa997c003fc48a7dfc04582a6f29b5614d190f2748528be95a42e3af61c7d65e
Jul 10 02:27:18.432158 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.432139    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d8601564-35c8-4f57-8d1d-52f21dd85944-manager-config\") pod \"lws-controller-manager-5fcbd9fc8-rpsqc\" (UID: \"d8601564-35c8-4f57-8d1d-52f21dd85944\") " pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.432246 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.432174    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8601564-35c8-4f57-8d1d-52f21dd85944-cert\") pod \"lws-controller-manager-5fcbd9fc8-rpsqc\" (UID: \"d8601564-35c8-4f57-8d1d-52f21dd85944\") " pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.432246 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.432201    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8601564-35c8-4f57-8d1d-52f21dd85944-metrics-cert\") pod \"lws-controller-manager-5fcbd9fc8-rpsqc\" (UID: \"d8601564-35c8-4f57-8d1d-52f21dd85944\") " pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.432360 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.432322    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrrln\" (UniqueName: \"kubernetes.io/projected/d8601564-35c8-4f57-8d1d-52f21dd85944-kube-api-access-nrrln\") pod \"lws-controller-manager-5fcbd9fc8-rpsqc\" (UID: \"d8601564-35c8-4f57-8d1d-52f21dd85944\") " pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.516905 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.516863    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:18.533029 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.533001    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8601564-35c8-4f57-8d1d-52f21dd85944-cert\") pod \"lws-controller-manager-5fcbd9fc8-rpsqc\" (UID: \"d8601564-35c8-4f57-8d1d-52f21dd85944\") " pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.533124 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.533048    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8601564-35c8-4f57-8d1d-52f21dd85944-metrics-cert\") pod \"lws-controller-manager-5fcbd9fc8-rpsqc\" (UID: \"d8601564-35c8-4f57-8d1d-52f21dd85944\") " pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.533124 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.533091    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrrln\" (UniqueName: \"kubernetes.io/projected/d8601564-35c8-4f57-8d1d-52f21dd85944-kube-api-access-nrrln\") pod \"lws-controller-manager-5fcbd9fc8-rpsqc\" (UID: \"d8601564-35c8-4f57-8d1d-52f21dd85944\") " pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.533218 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.533129    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d8601564-35c8-4f57-8d1d-52f21dd85944-manager-config\") pod \"lws-controller-manager-5fcbd9fc8-rpsqc\" (UID: \"d8601564-35c8-4f57-8d1d-52f21dd85944\") " pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.533780 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.533758    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d8601564-35c8-4f57-8d1d-52f21dd85944-manager-config\") pod \"lws-controller-manager-5fcbd9fc8-rpsqc\" (UID: \"d8601564-35c8-4f57-8d1d-52f21dd85944\") " pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.535601 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.535580    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d8601564-35c8-4f57-8d1d-52f21dd85944-metrics-cert\") pod \"lws-controller-manager-5fcbd9fc8-rpsqc\" (UID: \"d8601564-35c8-4f57-8d1d-52f21dd85944\") " pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.535722 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.535696    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8601564-35c8-4f57-8d1d-52f21dd85944-cert\") pod \"lws-controller-manager-5fcbd9fc8-rpsqc\" (UID: \"d8601564-35c8-4f57-8d1d-52f21dd85944\") " pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.549426 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.549400    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrrln\" (UniqueName: \"kubernetes.io/projected/d8601564-35c8-4f57-8d1d-52f21dd85944-kube-api-access-nrrln\") pod \"lws-controller-manager-5fcbd9fc8-rpsqc\" (UID: \"d8601564-35c8-4f57-8d1d-52f21dd85944\") " pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.621185 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.621087    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:18.671308 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.671274    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:18.769667 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.769640    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"]
Jul 10 02:27:18.770813 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:27:18.770787    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8601564_35c8_4f57_8d1d_52f21dd85944.slice/crio-4223c9c203e003a54add96c17c8e8b74eadc2cc37c0d915deec2d7cc17013b5f WatchSource:0}: Error finding container 4223c9c203e003a54add96c17c8e8b74eadc2cc37c0d915deec2d7cc17013b5f: Status 404 returned error can't find the container with id 4223c9c203e003a54add96c17c8e8b74eadc2cc37c0d915deec2d7cc17013b5f
Jul 10 02:27:18.777785 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:18.777752    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:19.264527 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:19.264483    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q" event={"ID":"33082935-cd72-4064-bb27-85001f92e31d","Type":"ContainerStarted","Data":"fa997c003fc48a7dfc04582a6f29b5614d190f2748528be95a42e3af61c7d65e"}
Jul 10 02:27:19.265743 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:19.265715    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc" event={"ID":"d8601564-35c8-4f57-8d1d-52f21dd85944","Type":"ContainerStarted","Data":"4223c9c203e003a54add96c17c8e8b74eadc2cc37c0d915deec2d7cc17013b5f"}
Jul 10 02:27:23.290464 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:23.290425    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc" event={"ID":"d8601564-35c8-4f57-8d1d-52f21dd85944","Type":"ContainerStarted","Data":"4f95829e041f77c35be336c90e890d0a766e9a408f533eb9ecf0537643cb870f"}
Jul 10 02:27:23.290923 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:23.290583    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:23.292035 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:23.292011    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q" event={"ID":"33082935-cd72-4064-bb27-85001f92e31d","Type":"ContainerStarted","Data":"499dca643b55b9a04d81d105ad5838a5beb77ad14fef64cab8e2dfdd52251e41"}
Jul 10 02:27:23.311768 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:23.311710    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc" podStartSLOduration=1.483687563 podStartE2EDuration="5.311693173s" totalImagesPullingTime="3.82800561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:27:23.310252184 +0000 UTC m=+275.831230495" watchObservedRunningTime="2026-07-10 02:27:23.311693173 +0000 UTC m=+275.832671482"
Jul 10 02:27:24.297750 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:24.297715    2553 generic.go:356] "Generic (PLEG): container finished" podID="33082935-cd72-4064-bb27-85001f92e31d" containerID="499dca643b55b9a04d81d105ad5838a5beb77ad14fef64cab8e2dfdd52251e41" exitCode=0
Jul 10 02:27:24.298167 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:24.297807    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q" event={"ID":"33082935-cd72-4064-bb27-85001f92e31d","Type":"ContainerDied","Data":"499dca643b55b9a04d81d105ad5838a5beb77ad14fef64cab8e2dfdd52251e41"}
Jul 10 02:27:25.304452 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:25.304415    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q" event={"ID":"33082935-cd72-4064-bb27-85001f92e31d","Type":"ContainerStarted","Data":"60541226cc9269661baf1a1a0e4eb8863b5d5abab7207101b48ba904db56ffe2"}
Jul 10 02:27:25.304829 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:25.304496    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:25.341167 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:25.341109    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q" podStartSLOduration=2.660008533 podStartE2EDuration="8.341093383s" totalImagesPullingTime="4.527065906s" totalInitContainerRuntime="1.154018944s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:27:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:27:25.338619453 +0000 UTC m=+277.859597786" watchObservedRunningTime="2026-07-10 02:27:25.341093383 +0000 UTC m=+277.862071692"
Jul 10 02:27:28.981954 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:28.981920    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:29.126240 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:29.126210    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:34.300442 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:34.300403    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5fcbd9fc8-rpsqc"
Jul 10 02:27:36.310889 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:36.310861    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fc46458b-g2l8q"
Jul 10 02:27:38.152648 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.152613    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:38.277652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.277618    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:38.716721 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.716688    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:38.783347 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.783310    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"]
Jul 10 02:27:38.796789 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.796758    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"
Jul 10 02:27:38.799374 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.799352    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 02:27:38.799666 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.799647    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xvrm2\""
Jul 10 02:27:38.801008 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.800993    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 02:27:38.805173 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.805150    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"]
Jul 10 02:27:38.813100 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.813075    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4f9x\" (UniqueName: \"kubernetes.io/projected/1130e493-92c1-4e54-8712-aad48a9ae4e7-kube-api-access-p4f9x\") pod \"kube-auth-proxy-f74c66c44-rqdgn\" (UID: \"1130e493-92c1-4e54-8712-aad48a9ae4e7\") " pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"
Jul 10 02:27:38.813234 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.813131    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1130e493-92c1-4e54-8712-aad48a9ae4e7-tmp\") pod \"kube-auth-proxy-f74c66c44-rqdgn\" (UID: \"1130e493-92c1-4e54-8712-aad48a9ae4e7\") " pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"
Jul 10 02:27:38.813234 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.813158    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1130e493-92c1-4e54-8712-aad48a9ae4e7-tls-certs\") pod \"kube-auth-proxy-f74c66c44-rqdgn\" (UID: \"1130e493-92c1-4e54-8712-aad48a9ae4e7\") " pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"
Jul 10 02:27:38.914361 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.914314    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4f9x\" (UniqueName: \"kubernetes.io/projected/1130e493-92c1-4e54-8712-aad48a9ae4e7-kube-api-access-p4f9x\") pod \"kube-auth-proxy-f74c66c44-rqdgn\" (UID: \"1130e493-92c1-4e54-8712-aad48a9ae4e7\") " pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"
Jul 10 02:27:38.914361 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.914365    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1130e493-92c1-4e54-8712-aad48a9ae4e7-tmp\") pod \"kube-auth-proxy-f74c66c44-rqdgn\" (UID: \"1130e493-92c1-4e54-8712-aad48a9ae4e7\") " pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"
Jul 10 02:27:38.914623 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.914387    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1130e493-92c1-4e54-8712-aad48a9ae4e7-tls-certs\") pod \"kube-auth-proxy-f74c66c44-rqdgn\" (UID: \"1130e493-92c1-4e54-8712-aad48a9ae4e7\") " pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"
Jul 10 02:27:38.914623 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:27:38.914492    2553 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 10 02:27:38.914623 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:27:38.914556    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1130e493-92c1-4e54-8712-aad48a9ae4e7-tls-certs podName:1130e493-92c1-4e54-8712-aad48a9ae4e7 nodeName:}" failed. No retries permitted until 2026-07-10 02:27:39.414538573 +0000 UTC m=+291.935516860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1130e493-92c1-4e54-8712-aad48a9ae4e7-tls-certs") pod "kube-auth-proxy-f74c66c44-rqdgn" (UID: "1130e493-92c1-4e54-8712-aad48a9ae4e7") : secret "kube-auth-proxy-tls" not found
Jul 10 02:27:38.916621 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.916598    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1130e493-92c1-4e54-8712-aad48a9ae4e7-tmp\") pod \"kube-auth-proxy-f74c66c44-rqdgn\" (UID: \"1130e493-92c1-4e54-8712-aad48a9ae4e7\") " pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"
Jul 10 02:27:38.943798 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:38.943760    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4f9x\" (UniqueName: \"kubernetes.io/projected/1130e493-92c1-4e54-8712-aad48a9ae4e7-kube-api-access-p4f9x\") pod \"kube-auth-proxy-f74c66c44-rqdgn\" (UID: \"1130e493-92c1-4e54-8712-aad48a9ae4e7\") " pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"
Jul 10 02:27:39.017887 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:39.017804    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:39.141176 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:39.141142    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:39.260953 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:39.260923    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:39.371978 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:39.371935    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:39.419236 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:39.419194    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1130e493-92c1-4e54-8712-aad48a9ae4e7-tls-certs\") pod \"kube-auth-proxy-f74c66c44-rqdgn\" (UID: \"1130e493-92c1-4e54-8712-aad48a9ae4e7\") " pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"
Jul 10 02:27:39.421727 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:39.421699    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1130e493-92c1-4e54-8712-aad48a9ae4e7-tls-certs\") pod \"kube-auth-proxy-f74c66c44-rqdgn\" (UID: \"1130e493-92c1-4e54-8712-aad48a9ae4e7\") " pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"
Jul 10 02:27:39.485448 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:39.485417    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:39.707294 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:39.707203    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"
Jul 10 02:27:39.853534 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:39.853482    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn"]
Jul 10 02:27:39.856334 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:27:39.856309    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1130e493_92c1_4e54_8712_aad48a9ae4e7.slice/crio-615983a4e372b327108d07701cb50c78e60fe4c8339c711cc4915889225bcce4 WatchSource:0}: Error finding container 615983a4e372b327108d07701cb50c78e60fe4c8339c711cc4915889225bcce4: Status 404 returned error can't find the container with id 615983a4e372b327108d07701cb50c78e60fe4c8339c711cc4915889225bcce4
Jul 10 02:27:40.096016 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:40.095949    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:40.260292 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:40.260261    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:40.372915 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:40.372822    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn" event={"ID":"1130e493-92c1-4e54-8712-aad48a9ae4e7","Type":"ContainerStarted","Data":"615983a4e372b327108d07701cb50c78e60fe4c8339c711cc4915889225bcce4"}
Jul 10 02:27:40.375679 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:40.375657    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:40.469654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:40.469604    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:41.919414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:41.919377    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:43.388383 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:43.388348    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn" event={"ID":"1130e493-92c1-4e54-8712-aad48a9ae4e7","Type":"ContainerStarted","Data":"1a6a25b80a60bb0448aad40e36546cf22ba13e2d4c7221f3bddc4dc009afab78"}
Jul 10 02:27:43.409231 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:43.409178    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f74c66c44-rqdgn" podStartSLOduration=2.682515424 podStartE2EDuration="5.40915898s" totalImagesPullingTime="2.726643556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:27:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:27:43.406973751 +0000 UTC m=+295.927952052" watchObservedRunningTime="2026-07-10 02:27:43.40915898 +0000 UTC m=+295.930137288"
Jul 10 02:27:46.575924 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:46.575894    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:46.670121 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:46.670086    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:47.614006 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:47.613973    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:47.876638 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:47.876554    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:47.909648 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:47.909613    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:27:47.917256 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:47.917230    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:27:47.920499 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:47.920469    2553 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 02:27:48.007059 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:48.006898    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:51.223190 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:51.223159    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:27:52.438286 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:27:52.438252    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:39.800704 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:39.800670    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:39.890650 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:39.890614    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:53.167335 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:53.167299    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:53.962478 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:53.962441    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:55.934760 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:55.934726    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:56.034423 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:56.034392    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:57.047237 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:57.047191    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:57.159429 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:57.159394    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:57.273865 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:57.273826    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:57.826757 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:57.826713    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:57.922485 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:57.922452    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:58.429633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:58.429589    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:59.373120 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:59.373074    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:28:59.784570 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:28:59.784486    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:00.046919 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:00.046890    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:00.171091 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:00.171059    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:00.290106 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:00.290067    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:03.593802 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:03.593769    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:04.748569 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:04.748533    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:06.797906 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:06.797868    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:06.899578 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:06.899545    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:07.372218 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:07.372177    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:07.474490 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:07.474450    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:08.099114 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:08.099084    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:12.192061 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:12.192022    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:12.297080 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:12.297045    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:14.300930 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:14.300877    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:14.646024 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:14.645916    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:17.806170 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:17.806133    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:17.875146 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:17.875113    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:18.393287 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:18.393246    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:18.493866 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:18.493833    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:19.005795 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:19.005757    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:19.076393 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:19.076356    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:24.467289 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.467247    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"]
Jul 10 02:29:24.470925 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.470905    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:24.473706 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.473681    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 02:29:24.473840 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.473748    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x245d\""
Jul 10 02:29:24.474163 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.474145    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 02:29:24.487854 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.487822    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"]
Jul 10 02:29:24.553338 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.553296    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c9936e9-0af9-49b7-822f-5b87bd000d78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-987w2\" (UID: \"5c9936e9-0af9-49b7-822f-5b87bd000d78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:24.553515 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.553434    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsk7p\" (UniqueName: \"kubernetes.io/projected/5c9936e9-0af9-49b7-822f-5b87bd000d78-kube-api-access-wsk7p\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-987w2\" (UID: \"5c9936e9-0af9-49b7-822f-5b87bd000d78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:24.654436 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.654398    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsk7p\" (UniqueName: \"kubernetes.io/projected/5c9936e9-0af9-49b7-822f-5b87bd000d78-kube-api-access-wsk7p\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-987w2\" (UID: \"5c9936e9-0af9-49b7-822f-5b87bd000d78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:24.654662 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.654448    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c9936e9-0af9-49b7-822f-5b87bd000d78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-987w2\" (UID: \"5c9936e9-0af9-49b7-822f-5b87bd000d78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:24.654812 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.654794    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c9936e9-0af9-49b7-822f-5b87bd000d78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-987w2\" (UID: \"5c9936e9-0af9-49b7-822f-5b87bd000d78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:24.665715 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.665685    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsk7p\" (UniqueName: \"kubernetes.io/projected/5c9936e9-0af9-49b7-822f-5b87bd000d78-kube-api-access-wsk7p\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-987w2\" (UID: \"5c9936e9-0af9-49b7-822f-5b87bd000d78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:24.748841 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.748750    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"]
Jul 10 02:29:24.749097 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.749083    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:24.765289 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.765182    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"]
Jul 10 02:29:24.782589 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.782544    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"]
Jul 10 02:29:24.786955 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.786927    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"
Jul 10 02:29:24.810358 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.810326    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"]
Jul 10 02:29:24.856236 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.856199    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-rcctf\" (UID: \"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"
Jul 10 02:29:24.856428 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.856251    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9chsp\" (UniqueName: \"kubernetes.io/projected/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b-kube-api-access-9chsp\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-rcctf\" (UID: \"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"
Jul 10 02:29:24.957407 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.957371    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-rcctf\" (UID: \"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"
Jul 10 02:29:24.957571 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.957429    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9chsp\" (UniqueName: \"kubernetes.io/projected/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b-kube-api-access-9chsp\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-rcctf\" (UID: \"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"
Jul 10 02:29:24.957763 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.957744    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-rcctf\" (UID: \"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"
Jul 10 02:29:24.971208 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:24.971183    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9chsp\" (UniqueName: \"kubernetes.io/projected/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b-kube-api-access-9chsp\") pod \"kuadrant-operator-controller-manager-b54fbbf4c-rcctf\" (UID: \"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"
Jul 10 02:29:25.013043 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:25.012941    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:25.099639 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:25.099600    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"
Jul 10 02:29:25.117244 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:25.117219    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:25.267060 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:25.267038    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"]
Jul 10 02:29:25.269160 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:29:25.269131    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79b2b05d_aa5a_4e42_a9e4_5492891f5a9b.slice/crio-66fe30eee07fbf50cd107111281ec317192d6e241219b5d94dfbe3fda82a2295 WatchSource:0}: Error finding container 66fe30eee07fbf50cd107111281ec317192d6e241219b5d94dfbe3fda82a2295: Status 404 returned error can't find the container with id 66fe30eee07fbf50cd107111281ec317192d6e241219b5d94dfbe3fda82a2295
Jul 10 02:29:25.271561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:25.271547    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 02:29:25.858942 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:25.858902    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf" event={"ID":"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b","Type":"ContainerStarted","Data":"66fe30eee07fbf50cd107111281ec317192d6e241219b5d94dfbe3fda82a2295"}
Jul 10 02:29:26.212853 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:26.212759    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:26.304634 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:26.304596    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:27.323658 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:29:27.323621    2553 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-b54fbbf4c-987w2_kuadrant-system_5c9936e9-0af9-49b7-822f-5b87bd000d78_0(a0cdd1b21d45842b7c3b17522aadd82e99f807e54e71c950154477b0574f3783): error adding pod kuadrant-system_kuadrant-operator-controller-manager-b54fbbf4c-987w2 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 10 02:29:27.323933 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:29:27.323688    2553 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-b54fbbf4c-987w2_kuadrant-system_5c9936e9-0af9-49b7-822f-5b87bd000d78_0(a0cdd1b21d45842b7c3b17522aadd82e99f807e54e71c950154477b0574f3783): error adding pod kuadrant-system_kuadrant-operator-controller-manager-b54fbbf4c-987w2 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:27.870089 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:27.870049    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:27.876890 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:27.876857    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:27.879321 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:29:27.879296    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-b54fbbf4c-987w2\" is forbidden: User \"system:node:ip-10-0-130-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-224.ec2.internal' and this object" podUID="5c9936e9-0af9-49b7-822f-5b87bd000d78" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:27.984575 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:27.984534    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wsk7p\" (UniqueName: \"kubernetes.io/projected/5c9936e9-0af9-49b7-822f-5b87bd000d78-kube-api-access-wsk7p\") pod \"5c9936e9-0af9-49b7-822f-5b87bd000d78\" (UID: \"5c9936e9-0af9-49b7-822f-5b87bd000d78\") "
Jul 10 02:29:27.984766 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:27.984625    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c9936e9-0af9-49b7-822f-5b87bd000d78-extensions-socket-volume\") pod \"5c9936e9-0af9-49b7-822f-5b87bd000d78\" (UID: \"5c9936e9-0af9-49b7-822f-5b87bd000d78\") "
Jul 10 02:29:27.984938 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:27.984912    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c9936e9-0af9-49b7-822f-5b87bd000d78-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5c9936e9-0af9-49b7-822f-5b87bd000d78" (UID: "5c9936e9-0af9-49b7-822f-5b87bd000d78"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:29:27.986669 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:27.986649    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c9936e9-0af9-49b7-822f-5b87bd000d78-kube-api-access-wsk7p" (OuterVolumeSpecName: "kube-api-access-wsk7p") pod "5c9936e9-0af9-49b7-822f-5b87bd000d78" (UID: "5c9936e9-0af9-49b7-822f-5b87bd000d78"). InnerVolumeSpecName "kube-api-access-wsk7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:29:28.008839 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:29:28.008802    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-b54fbbf4c-987w2\" is forbidden: User \"system:node:ip-10-0-130-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-224.ec2.internal' and this object" podUID="5c9936e9-0af9-49b7-822f-5b87bd000d78" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:28.010408 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:28.010378    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c9936e9-0af9-49b7-822f-5b87bd000d78" path="/var/lib/kubelet/pods/5c9936e9-0af9-49b7-822f-5b87bd000d78/volumes"
Jul 10 02:29:28.085281 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:28.085242    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c9936e9-0af9-49b7-822f-5b87bd000d78-extensions-socket-volume\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:29:28.085281 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:28.085267    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsk7p\" (UniqueName: \"kubernetes.io/projected/5c9936e9-0af9-49b7-822f-5b87bd000d78-kube-api-access-wsk7p\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:29:28.875416 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:28.875384    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:28.880109 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:29:28.880075    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-b54fbbf4c-987w2\" is forbidden: User \"system:node:ip-10-0-130-224.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-224.ec2.internal' and this object" podUID="5c9936e9-0af9-49b7-822f-5b87bd000d78" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-987w2"
Jul 10 02:29:30.908017 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:30.907946    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:31.012642 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:31.012595    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:34.904892 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:34.904853    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf" event={"ID":"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b","Type":"ContainerStarted","Data":"30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a"}
Jul 10 02:29:34.905295 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:34.905004    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"
Jul 10 02:29:42.563153 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:42.563117    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:42.633586 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:42.633553    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:45.912047 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:45.912016    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"
Jul 10 02:29:45.939374 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:45.939320    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf" podStartSLOduration=13.003436057 podStartE2EDuration="21.939302795s" totalImagesPullingTime="8.935866738s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:29:34.930532039 +0000 UTC m=+407.451510348" watchObservedRunningTime="2026-07-10 02:29:45.939302795 +0000 UTC m=+418.460281104"
Jul 10 02:29:52.400230 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:52.400199    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:52.500079 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:52.500040    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:52.599745 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:52.599712    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:53.134663 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:53.134621    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:53.200109 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:53.200079    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:29:58.211162 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:58.211129    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"]
Jul 10 02:29:58.211552 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:58.211332    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf" podUID="79b2b05d-aa5a-4e42-a9e4-5492891f5a9b" containerName="manager" containerID="cri-o://30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a" gracePeriod=10
Jul 10 02:29:58.454441 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:58.454416    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"
Jul 10 02:29:58.458170 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:58.458140    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b-extensions-socket-volume\") pod \"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b\" (UID: \"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b\") "
Jul 10 02:29:58.458304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:58.458216    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9chsp\" (UniqueName: \"kubernetes.io/projected/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b-kube-api-access-9chsp\") pod \"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b\" (UID: \"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b\") "
Jul 10 02:29:58.458567 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:58.458538    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "79b2b05d-aa5a-4e42-a9e4-5492891f5a9b" (UID: "79b2b05d-aa5a-4e42-a9e4-5492891f5a9b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:29:58.460474 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:58.460444    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b-kube-api-access-9chsp" (OuterVolumeSpecName: "kube-api-access-9chsp") pod "79b2b05d-aa5a-4e42-a9e4-5492891f5a9b" (UID: "79b2b05d-aa5a-4e42-a9e4-5492891f5a9b"). InnerVolumeSpecName "kube-api-access-9chsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:29:58.559383 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:58.559345    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b-extensions-socket-volume\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:29:58.559383 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:58.559374    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9chsp\" (UniqueName: \"kubernetes.io/projected/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b-kube-api-access-9chsp\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:29:59.016403 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:59.016367    2553 generic.go:356] "Generic (PLEG): container finished" podID="79b2b05d-aa5a-4e42-a9e4-5492891f5a9b" containerID="30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a" exitCode=0
Jul 10 02:29:59.016618 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:59.016421    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"
Jul 10 02:29:59.016618 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:59.016456    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf" event={"ID":"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b","Type":"ContainerDied","Data":"30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a"}
Jul 10 02:29:59.016618 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:59.016516    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf" event={"ID":"79b2b05d-aa5a-4e42-a9e4-5492891f5a9b","Type":"ContainerDied","Data":"66fe30eee07fbf50cd107111281ec317192d6e241219b5d94dfbe3fda82a2295"}
Jul 10 02:29:59.016618 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:59.016539    2553 scope.go:117] "RemoveContainer" containerID="30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a"
Jul 10 02:29:59.025814 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:59.025796    2553 scope.go:117] "RemoveContainer" containerID="30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a"
Jul 10 02:29:59.026189 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:29:59.026169    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a\": container with ID starting with 30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a not found: ID does not exist" containerID="30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a"
Jul 10 02:29:59.026252 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:59.026200    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a"} err="failed to get container status \"30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a\": rpc error: code = NotFound desc = could not find container \"30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a\": container with ID starting with 30c9b360779f749f012a1a4f1eee75907ee6412b756e73232104e64bbe36797a not found: ID does not exist"
Jul 10 02:29:59.039753 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:59.039724    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"]
Jul 10 02:29:59.050717 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:29:59.050684    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-b54fbbf4c-rcctf"]
Jul 10 02:30:00.007980 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:00.007936    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79b2b05d-aa5a-4e42-a9e4-5492891f5a9b" path="/var/lib/kubelet/pods/79b2b05d-aa5a-4e42-a9e4-5492891f5a9b/volumes"
Jul 10 02:30:02.420942 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:02.420905    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:02.591639 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:02.591605    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:03.403089 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:03.403057    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:03.504062 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:03.504031    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:03.604787 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:03.604757    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:04.828863 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.828828    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"]
Jul 10 02:30:04.829289 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.829249    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79b2b05d-aa5a-4e42-a9e4-5492891f5a9b" containerName="manager"
Jul 10 02:30:04.829289 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.829263    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="79b2b05d-aa5a-4e42-a9e4-5492891f5a9b" containerName="manager"
Jul 10 02:30:04.829384 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.829327    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="79b2b05d-aa5a-4e42-a9e4-5492891f5a9b" containerName="manager"
Jul 10 02:30:04.833400 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.833382    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"
Jul 10 02:30:04.836823 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.836800    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 02:30:04.836823 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.836800    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 02:30:04.837011 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.836916    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 02:30:04.837937 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.837923    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qpsps\""
Jul 10 02:30:04.844780 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.844754    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"]
Jul 10 02:30:04.847814 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.847793    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:04.916258 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.916220    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b64548d6-a236-4598-843f-afbfee89fb5e-config-file\") pod \"limitador-limitador-ff68ff5cb-q6bw5\" (UID: \"b64548d6-a236-4598-843f-afbfee89fb5e\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"
Jul 10 02:30:04.916442 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.916275    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9k4d\" (UniqueName: \"kubernetes.io/projected/b64548d6-a236-4598-843f-afbfee89fb5e-kube-api-access-t9k4d\") pod \"limitador-limitador-ff68ff5cb-q6bw5\" (UID: \"b64548d6-a236-4598-843f-afbfee89fb5e\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"
Jul 10 02:30:04.937380 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.937343    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"]
Jul 10 02:30:04.974674 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:04.974647    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:05.017411 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.017371    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b64548d6-a236-4598-843f-afbfee89fb5e-config-file\") pod \"limitador-limitador-ff68ff5cb-q6bw5\" (UID: \"b64548d6-a236-4598-843f-afbfee89fb5e\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"
Jul 10 02:30:05.017552 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.017417    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9k4d\" (UniqueName: \"kubernetes.io/projected/b64548d6-a236-4598-843f-afbfee89fb5e-kube-api-access-t9k4d\") pod \"limitador-limitador-ff68ff5cb-q6bw5\" (UID: \"b64548d6-a236-4598-843f-afbfee89fb5e\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"
Jul 10 02:30:05.018109 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.018090    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b64548d6-a236-4598-843f-afbfee89fb5e-config-file\") pod \"limitador-limitador-ff68ff5cb-q6bw5\" (UID: \"b64548d6-a236-4598-843f-afbfee89fb5e\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"
Jul 10 02:30:05.037599 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.037560    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9k4d\" (UniqueName: \"kubernetes.io/projected/b64548d6-a236-4598-843f-afbfee89fb5e-kube-api-access-t9k4d\") pod \"limitador-limitador-ff68ff5cb-q6bw5\" (UID: \"b64548d6-a236-4598-843f-afbfee89fb5e\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"
Jul 10 02:30:05.094875 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.094763    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:05.143808 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.143764    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"
Jul 10 02:30:05.283304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.283266    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"]
Jul 10 02:30:05.286779 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:30:05.286749    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64548d6_a236_4598_843f_afbfee89fb5e.slice/crio-22baf3d92f9765613f738bf5586235d70eb3a8c9dec1ccbfa18282ed29f9a48e WatchSource:0}: Error finding container 22baf3d92f9765613f738bf5586235d70eb3a8c9dec1ccbfa18282ed29f9a48e: Status 404 returned error can't find the container with id 22baf3d92f9765613f738bf5586235d70eb3a8c9dec1ccbfa18282ed29f9a48e
Jul 10 02:30:05.661429 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.661396    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b6c89bb85-kjdrw"]
Jul 10 02:30:05.665816 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.665795    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-kjdrw"
Jul 10 02:30:05.670978 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.670941    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rxftg\""
Jul 10 02:30:05.676022 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.675994    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-kjdrw"]
Jul 10 02:30:05.722730 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.722692    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkfzp\" (UniqueName: \"kubernetes.io/projected/bc21d395-eab6-422d-97ad-d6e3c481f900-kube-api-access-wkfzp\") pod \"authorino-b6c89bb85-kjdrw\" (UID: \"bc21d395-eab6-422d-97ad-d6e3c481f900\") " pod="kuadrant-system/authorino-b6c89bb85-kjdrw"
Jul 10 02:30:05.724005 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.723981    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:05.824171 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.824136    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkfzp\" (UniqueName: \"kubernetes.io/projected/bc21d395-eab6-422d-97ad-d6e3c481f900-kube-api-access-wkfzp\") pod \"authorino-b6c89bb85-kjdrw\" (UID: \"bc21d395-eab6-422d-97ad-d6e3c481f900\") " pod="kuadrant-system/authorino-b6c89bb85-kjdrw"
Jul 10 02:30:05.831133 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.831097    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:05.837472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.837446    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8df697c9f-rxmfl"]
Jul 10 02:30:05.839046 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.839017    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkfzp\" (UniqueName: \"kubernetes.io/projected/bc21d395-eab6-422d-97ad-d6e3c481f900-kube-api-access-wkfzp\") pod \"authorino-b6c89bb85-kjdrw\" (UID: \"bc21d395-eab6-422d-97ad-d6e3c481f900\") " pod="kuadrant-system/authorino-b6c89bb85-kjdrw"
Jul 10 02:30:05.840783 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.840768    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-rxmfl"
Jul 10 02:30:05.852066 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.852039    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8df697c9f-rxmfl"]
Jul 10 02:30:05.925694 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.925605    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhfg2\" (UniqueName: \"kubernetes.io/projected/b75ff22d-33a1-4870-90b7-54d47740d611-kube-api-access-rhfg2\") pod \"authorino-8df697c9f-rxmfl\" (UID: \"b75ff22d-33a1-4870-90b7-54d47740d611\") " pod="kuadrant-system/authorino-8df697c9f-rxmfl"
Jul 10 02:30:05.988556 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:05.988517    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-kjdrw"
Jul 10 02:30:06.026872 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:06.026834    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhfg2\" (UniqueName: \"kubernetes.io/projected/b75ff22d-33a1-4870-90b7-54d47740d611-kube-api-access-rhfg2\") pod \"authorino-8df697c9f-rxmfl\" (UID: \"b75ff22d-33a1-4870-90b7-54d47740d611\") " pod="kuadrant-system/authorino-8df697c9f-rxmfl"
Jul 10 02:30:06.038633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:06.038566    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhfg2\" (UniqueName: \"kubernetes.io/projected/b75ff22d-33a1-4870-90b7-54d47740d611-kube-api-access-rhfg2\") pod \"authorino-8df697c9f-rxmfl\" (UID: \"b75ff22d-33a1-4870-90b7-54d47740d611\") " pod="kuadrant-system/authorino-8df697c9f-rxmfl"
Jul 10 02:30:06.054735 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:06.054689    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5" event={"ID":"b64548d6-a236-4598-843f-afbfee89fb5e","Type":"ContainerStarted","Data":"22baf3d92f9765613f738bf5586235d70eb3a8c9dec1ccbfa18282ed29f9a48e"}
Jul 10 02:30:06.127707 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:06.127541    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-kjdrw"]
Jul 10 02:30:06.130464 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:30:06.130435    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbc21d395_eab6_422d_97ad_d6e3c481f900.slice/crio-247668dfa79a54e3b09bb5b6318b79f2b3a82b5a99548b6f5d6bfeca7d4b7b77 WatchSource:0}: Error finding container 247668dfa79a54e3b09bb5b6318b79f2b3a82b5a99548b6f5d6bfeca7d4b7b77: Status 404 returned error can't find the container with id 247668dfa79a54e3b09bb5b6318b79f2b3a82b5a99548b6f5d6bfeca7d4b7b77
Jul 10 02:30:06.156051 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:06.156010    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-rxmfl"
Jul 10 02:30:06.290795 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:06.290610    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8df697c9f-rxmfl"]
Jul 10 02:30:06.293547 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:30:06.293516    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb75ff22d_33a1_4870_90b7_54d47740d611.slice/crio-33cb30ac0f75ae6628e09e4725e34b1ddac80342762c2b228ca03b30ee815121 WatchSource:0}: Error finding container 33cb30ac0f75ae6628e09e4725e34b1ddac80342762c2b228ca03b30ee815121: Status 404 returned error can't find the container with id 33cb30ac0f75ae6628e09e4725e34b1ddac80342762c2b228ca03b30ee815121
Jul 10 02:30:07.062408 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:07.062369    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-rxmfl" event={"ID":"b75ff22d-33a1-4870-90b7-54d47740d611","Type":"ContainerStarted","Data":"33cb30ac0f75ae6628e09e4725e34b1ddac80342762c2b228ca03b30ee815121"}
Jul 10 02:30:07.063703 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:07.063677    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-kjdrw" event={"ID":"bc21d395-eab6-422d-97ad-d6e3c481f900","Type":"ContainerStarted","Data":"247668dfa79a54e3b09bb5b6318b79f2b3a82b5a99548b6f5d6bfeca7d4b7b77"}
Jul 10 02:30:08.044476 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:08.044436    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:08.110885 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:08.110846    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:12.093685 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:12.093651    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-rxmfl" event={"ID":"b75ff22d-33a1-4870-90b7-54d47740d611","Type":"ContainerStarted","Data":"043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd"}
Jul 10 02:30:12.095177 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:12.095147    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-kjdrw" event={"ID":"bc21d395-eab6-422d-97ad-d6e3c481f900","Type":"ContainerStarted","Data":"e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619"}
Jul 10 02:30:12.096447 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:12.096426    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5" event={"ID":"b64548d6-a236-4598-843f-afbfee89fb5e","Type":"ContainerStarted","Data":"549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a"}
Jul 10 02:30:12.096566 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:12.096548    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"
Jul 10 02:30:12.112391 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:12.112341    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-8df697c9f-rxmfl" podStartSLOduration=2.164485489 podStartE2EDuration="7.112326141s" totalImagesPullingTime="4.947840652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:30:12.110756921 +0000 UTC m=+444.631735232" watchObservedRunningTime="2026-07-10 02:30:12.112326141 +0000 UTC m=+444.633304449"
Jul 10 02:30:12.133450 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:12.133397    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5" podStartSLOduration=2.123920191 podStartE2EDuration="8.13337777s" totalImagesPullingTime="6.009457579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:30:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:30:12.132112291 +0000 UTC m=+444.653090594" watchObservedRunningTime="2026-07-10 02:30:12.13337777 +0000 UTC m=+444.654356105"
Jul 10 02:30:12.139394 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:12.139366    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-kjdrw"]
Jul 10 02:30:12.152759 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:12.152709    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b6c89bb85-kjdrw" podStartSLOduration=1.997217766 podStartE2EDuration="7.152691978s" totalImagesPullingTime="5.155474212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:30:12.151409876 +0000 UTC m=+444.672388185" watchObservedRunningTime="2026-07-10 02:30:12.152691978 +0000 UTC m=+444.673670289"
Jul 10 02:30:14.105254 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:14.105212    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b6c89bb85-kjdrw" podUID="bc21d395-eab6-422d-97ad-d6e3c481f900" containerName="authorino" containerID="cri-o://e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619" gracePeriod=30
Jul 10 02:30:14.353690 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:14.353662    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-kjdrw"
Jul 10 02:30:14.404246 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:14.404147    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkfzp\" (UniqueName: \"kubernetes.io/projected/bc21d395-eab6-422d-97ad-d6e3c481f900-kube-api-access-wkfzp\") pod \"bc21d395-eab6-422d-97ad-d6e3c481f900\" (UID: \"bc21d395-eab6-422d-97ad-d6e3c481f900\") "
Jul 10 02:30:14.406277 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:14.406243    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc21d395-eab6-422d-97ad-d6e3c481f900-kube-api-access-wkfzp" (OuterVolumeSpecName: "kube-api-access-wkfzp") pod "bc21d395-eab6-422d-97ad-d6e3c481f900" (UID: "bc21d395-eab6-422d-97ad-d6e3c481f900"). InnerVolumeSpecName "kube-api-access-wkfzp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:30:14.505117 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:14.505080    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkfzp\" (UniqueName: \"kubernetes.io/projected/bc21d395-eab6-422d-97ad-d6e3c481f900-kube-api-access-wkfzp\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:30:15.111141 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:15.111101    2553 generic.go:356] "Generic (PLEG): container finished" podID="bc21d395-eab6-422d-97ad-d6e3c481f900" containerID="e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619" exitCode=0
Jul 10 02:30:15.111546 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:15.111146    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b6c89bb85-kjdrw"
Jul 10 02:30:15.111546 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:15.111185    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-kjdrw" event={"ID":"bc21d395-eab6-422d-97ad-d6e3c481f900","Type":"ContainerDied","Data":"e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619"}
Jul 10 02:30:15.111546 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:15.111227    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b6c89bb85-kjdrw" event={"ID":"bc21d395-eab6-422d-97ad-d6e3c481f900","Type":"ContainerDied","Data":"247668dfa79a54e3b09bb5b6318b79f2b3a82b5a99548b6f5d6bfeca7d4b7b77"}
Jul 10 02:30:15.111546 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:15.111245    2553 scope.go:117] "RemoveContainer" containerID="e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619"
Jul 10 02:30:15.119592 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:15.119574    2553 scope.go:117] "RemoveContainer" containerID="e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619"
Jul 10 02:30:15.119907 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:30:15.119888    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619\": container with ID starting with e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619 not found: ID does not exist" containerID="e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619"
Jul 10 02:30:15.120019 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:15.119914    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619"} err="failed to get container status \"e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619\": rpc error: code = NotFound desc = could not find container \"e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619\": container with ID starting with e394170117d58a65c632590ed4836fd3fa17ed95b3682bcc8f0528e535049619 not found: ID does not exist"
Jul 10 02:30:15.133367 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:15.133330    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-kjdrw"]
Jul 10 02:30:15.137920 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:15.137895    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b6c89bb85-kjdrw"]
Jul 10 02:30:16.008736 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:16.008698    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc21d395-eab6-422d-97ad-d6e3c481f900" path="/var/lib/kubelet/pods/bc21d395-eab6-422d-97ad-d6e3c481f900/volumes"
Jul 10 02:30:21.348675 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:21.348640    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"]
Jul 10 02:30:21.349204 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:21.348905    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5" podUID="b64548d6-a236-4598-843f-afbfee89fb5e" containerName="limitador" containerID="cri-o://549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a" gracePeriod=30
Jul 10 02:30:21.351082 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:21.351058    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"
Jul 10 02:30:21.898717 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:21.898687    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"
Jul 10 02:30:21.971631 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:21.971540    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9k4d\" (UniqueName: \"kubernetes.io/projected/b64548d6-a236-4598-843f-afbfee89fb5e-kube-api-access-t9k4d\") pod \"b64548d6-a236-4598-843f-afbfee89fb5e\" (UID: \"b64548d6-a236-4598-843f-afbfee89fb5e\") "
Jul 10 02:30:21.971631 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:21.971613    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b64548d6-a236-4598-843f-afbfee89fb5e-config-file\") pod \"b64548d6-a236-4598-843f-afbfee89fb5e\" (UID: \"b64548d6-a236-4598-843f-afbfee89fb5e\") "
Jul 10 02:30:21.972112 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:21.972086    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b64548d6-a236-4598-843f-afbfee89fb5e-config-file" (OuterVolumeSpecName: "config-file") pod "b64548d6-a236-4598-843f-afbfee89fb5e" (UID: "b64548d6-a236-4598-843f-afbfee89fb5e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:30:21.973701 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:21.973678    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b64548d6-a236-4598-843f-afbfee89fb5e-kube-api-access-t9k4d" (OuterVolumeSpecName: "kube-api-access-t9k4d") pod "b64548d6-a236-4598-843f-afbfee89fb5e" (UID: "b64548d6-a236-4598-843f-afbfee89fb5e"). InnerVolumeSpecName "kube-api-access-t9k4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:30:22.072952 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:22.072911    2553 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b64548d6-a236-4598-843f-afbfee89fb5e-config-file\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:30:22.072952 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:22.072950    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9k4d\" (UniqueName: \"kubernetes.io/projected/b64548d6-a236-4598-843f-afbfee89fb5e-kube-api-access-t9k4d\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:30:22.147212 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:22.147174    2553 generic.go:356] "Generic (PLEG): container finished" podID="b64548d6-a236-4598-843f-afbfee89fb5e" containerID="549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a" exitCode=0
Jul 10 02:30:22.147382 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:22.147223    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"
Jul 10 02:30:22.147382 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:22.147255    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5" event={"ID":"b64548d6-a236-4598-843f-afbfee89fb5e","Type":"ContainerDied","Data":"549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a"}
Jul 10 02:30:22.147382 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:22.147308    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5" event={"ID":"b64548d6-a236-4598-843f-afbfee89fb5e","Type":"ContainerDied","Data":"22baf3d92f9765613f738bf5586235d70eb3a8c9dec1ccbfa18282ed29f9a48e"}
Jul 10 02:30:22.147382 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:22.147331    2553 scope.go:117] "RemoveContainer" containerID="549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a"
Jul 10 02:30:22.156171 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:22.156150    2553 scope.go:117] "RemoveContainer" containerID="549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a"
Jul 10 02:30:22.156436 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:30:22.156414    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a\": container with ID starting with 549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a not found: ID does not exist" containerID="549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a"
Jul 10 02:30:22.156508 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:22.156457    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a"} err="failed to get container status \"549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a\": rpc error: code = NotFound desc = could not find container \"549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a\": container with ID starting with 549479984b74933bd1720c46d2810ae4107bd981459ebed0d8b811342f14817a not found: ID does not exist"
Jul 10 02:30:22.165241 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:22.165214    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"]
Jul 10 02:30:22.169944 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:22.169918    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-q6bw5"]
Jul 10 02:30:24.009004 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:24.008955    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b64548d6-a236-4598-843f-afbfee89fb5e" path="/var/lib/kubelet/pods/b64548d6-a236-4598-843f-afbfee89fb5e/volumes"
Jul 10 02:30:25.276279 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.276242    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:25.366093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.366056    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:25.698541 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.698511    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"]
Jul 10 02:30:25.698892 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.698880    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b64548d6-a236-4598-843f-afbfee89fb5e" containerName="limitador"
Jul 10 02:30:25.698941 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.698894    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b64548d6-a236-4598-843f-afbfee89fb5e" containerName="limitador"
Jul 10 02:30:25.698941 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.698913    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc21d395-eab6-422d-97ad-d6e3c481f900" containerName="authorino"
Jul 10 02:30:25.698941 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.698919    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc21d395-eab6-422d-97ad-d6e3c481f900" containerName="authorino"
Jul 10 02:30:25.699068 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.699002    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc21d395-eab6-422d-97ad-d6e3c481f900" containerName="authorino"
Jul 10 02:30:25.699068 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.699009    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b64548d6-a236-4598-843f-afbfee89fb5e" containerName="limitador"
Jul 10 02:30:25.703432 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.703405    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"
Jul 10 02:30:25.707811 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.707780    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 10 02:30:25.708391 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.708371    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-6chvc\""
Jul 10 02:30:25.708534 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.708390    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 10 02:30:25.708534 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.708400    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 10 02:30:25.713736 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.713708    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"]
Jul 10 02:30:25.745833 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.745801    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:25.807842 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.807802    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-685xd\" (UniqueName: \"kubernetes.io/projected/ab720ff3-7d55-49c0-a2b2-008ee4a8ad77-kube-api-access-685xd\") pod \"postgres-69fb4594cf-w8kbv\" (UID: \"ab720ff3-7d55-49c0-a2b2-008ee4a8ad77\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"
Jul 10 02:30:25.808037 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.807853    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ab720ff3-7d55-49c0-a2b2-008ee4a8ad77-data\") pod \"postgres-69fb4594cf-w8kbv\" (UID: \"ab720ff3-7d55-49c0-a2b2-008ee4a8ad77\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"
Jul 10 02:30:25.908540 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.908491    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-685xd\" (UniqueName: \"kubernetes.io/projected/ab720ff3-7d55-49c0-a2b2-008ee4a8ad77-kube-api-access-685xd\") pod \"postgres-69fb4594cf-w8kbv\" (UID: \"ab720ff3-7d55-49c0-a2b2-008ee4a8ad77\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"
Jul 10 02:30:25.908540 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.908540    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ab720ff3-7d55-49c0-a2b2-008ee4a8ad77-data\") pod \"postgres-69fb4594cf-w8kbv\" (UID: \"ab720ff3-7d55-49c0-a2b2-008ee4a8ad77\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"
Jul 10 02:30:25.908918 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.908900    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ab720ff3-7d55-49c0-a2b2-008ee4a8ad77-data\") pod \"postgres-69fb4594cf-w8kbv\" (UID: \"ab720ff3-7d55-49c0-a2b2-008ee4a8ad77\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"
Jul 10 02:30:25.918718 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:25.918687    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-685xd\" (UniqueName: \"kubernetes.io/projected/ab720ff3-7d55-49c0-a2b2-008ee4a8ad77-kube-api-access-685xd\") pod \"postgres-69fb4594cf-w8kbv\" (UID: \"ab720ff3-7d55-49c0-a2b2-008ee4a8ad77\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"
Jul 10 02:30:26.015053 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:26.014948    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"
Jul 10 02:30:26.149625 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:26.149595    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"]
Jul 10 02:30:26.151288 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:30:26.151262    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab720ff3_7d55_49c0_a2b2_008ee4a8ad77.slice/crio-96f6a653f6c2a21cf2d256f5ab48497615e892e3c621f56f7a0d38c6998e5b6c WatchSource:0}: Error finding container 96f6a653f6c2a21cf2d256f5ab48497615e892e3c621f56f7a0d38c6998e5b6c: Status 404 returned error can't find the container with id 96f6a653f6c2a21cf2d256f5ab48497615e892e3c621f56f7a0d38c6998e5b6c
Jul 10 02:30:26.168782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:26.168750    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv" event={"ID":"ab720ff3-7d55-49c0-a2b2-008ee4a8ad77","Type":"ContainerStarted","Data":"96f6a653f6c2a21cf2d256f5ab48497615e892e3c621f56f7a0d38c6998e5b6c"}
Jul 10 02:30:31.201528 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:31.201422    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv" event={"ID":"ab720ff3-7d55-49c0-a2b2-008ee4a8ad77","Type":"ContainerStarted","Data":"6a0133ddd77521464e683f345538b23b6cfa06e568ed6bc2fca54113ca3cee2c"}
Jul 10 02:30:31.201941 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:31.201614    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"
Jul 10 02:30:31.221340 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:31.221280    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv" podStartSLOduration=1.508084384 podStartE2EDuration="6.221264621s" totalImagesPullingTime="4.713180237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:30:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:30:31.218834572 +0000 UTC m=+463.739812891" watchObservedRunningTime="2026-07-10 02:30:31.221264621 +0000 UTC m=+463.742242929"
Jul 10 02:30:37.241348 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:37.241319    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-w8kbv"
Jul 10 02:30:37.583274 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:37.583239    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:37.800217 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:37.800180    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6dbc6c7c8d-58rsb"]
Jul 10 02:30:37.806392 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:37.806370    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dbc6c7c8d-58rsb"
Jul 10 02:30:37.818017 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:37.817988    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6dbc6c7c8d-58rsb"]
Jul 10 02:30:37.871080 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:37.870989    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:37.920556 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:37.920524    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxljb\" (UniqueName: \"kubernetes.io/projected/d6a276d3-e900-45b9-be09-fbb7ed057e00-kube-api-access-pxljb\") pod \"authorino-6dbc6c7c8d-58rsb\" (UID: \"d6a276d3-e900-45b9-be09-fbb7ed057e00\") " pod="kuadrant-system/authorino-6dbc6c7c8d-58rsb"
Jul 10 02:30:37.935633 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:37.935602    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dbc6c7c8d-58rsb"]
Jul 10 02:30:37.935856 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:30:37.935837    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pxljb], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6dbc6c7c8d-58rsb" podUID="d6a276d3-e900-45b9-be09-fbb7ed057e00"
Jul 10 02:30:37.967102 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:37.967067    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76dd94b454-lflw7"]
Jul 10 02:30:37.971078 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:37.971059    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76dd94b454-lflw7"
Jul 10 02:30:37.973798 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:37.973776    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 10 02:30:37.978930 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:37.978908    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76dd94b454-lflw7"]
Jul 10 02:30:38.021382 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.021334    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxljb\" (UniqueName: \"kubernetes.io/projected/d6a276d3-e900-45b9-be09-fbb7ed057e00-kube-api-access-pxljb\") pod \"authorino-6dbc6c7c8d-58rsb\" (UID: \"d6a276d3-e900-45b9-be09-fbb7ed057e00\") " pod="kuadrant-system/authorino-6dbc6c7c8d-58rsb"
Jul 10 02:30:38.038940 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.038906    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxljb\" (UniqueName: \"kubernetes.io/projected/d6a276d3-e900-45b9-be09-fbb7ed057e00-kube-api-access-pxljb\") pod \"authorino-6dbc6c7c8d-58rsb\" (UID: \"d6a276d3-e900-45b9-be09-fbb7ed057e00\") " pod="kuadrant-system/authorino-6dbc6c7c8d-58rsb"
Jul 10 02:30:38.053503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.053474    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76dd94b454-lflw7"]
Jul 10 02:30:38.053757 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:30:38.053740    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-h9lwf tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76dd94b454-lflw7" podUID="e5a21edc-6531-41fb-ba4f-921619485a09"
Jul 10 02:30:38.089192 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.089153    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-77c666985d-rjksf"]
Jul 10 02:30:38.092954 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.092933    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77c666985d-rjksf"
Jul 10 02:30:38.103901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.103879    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77c666985d-rjksf"]
Jul 10 02:30:38.122580 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.122475    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5a21edc-6531-41fb-ba4f-921619485a09-tls-cert\") pod \"authorino-76dd94b454-lflw7\" (UID: \"e5a21edc-6531-41fb-ba4f-921619485a09\") " pod="kuadrant-system/authorino-76dd94b454-lflw7"
Jul 10 02:30:38.122580 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.122517    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9lwf\" (UniqueName: \"kubernetes.io/projected/e5a21edc-6531-41fb-ba4f-921619485a09-kube-api-access-h9lwf\") pod \"authorino-76dd94b454-lflw7\" (UID: \"e5a21edc-6531-41fb-ba4f-921619485a09\") " pod="kuadrant-system/authorino-76dd94b454-lflw7"
Jul 10 02:30:38.223839 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.223800    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed-tls-cert\") pod \"authorino-77c666985d-rjksf\" (UID: \"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed\") " pod="kuadrant-system/authorino-77c666985d-rjksf"
Jul 10 02:30:38.223839 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.223841    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zthqb\" (UniqueName: \"kubernetes.io/projected/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed-kube-api-access-zthqb\") pod \"authorino-77c666985d-rjksf\" (UID: \"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed\") " pod="kuadrant-system/authorino-77c666985d-rjksf"
Jul 10 02:30:38.224072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.223904    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5a21edc-6531-41fb-ba4f-921619485a09-tls-cert\") pod \"authorino-76dd94b454-lflw7\" (UID: \"e5a21edc-6531-41fb-ba4f-921619485a09\") " pod="kuadrant-system/authorino-76dd94b454-lflw7"
Jul 10 02:30:38.224072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.223922    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lwf\" (UniqueName: \"kubernetes.io/projected/e5a21edc-6531-41fb-ba4f-921619485a09-kube-api-access-h9lwf\") pod \"authorino-76dd94b454-lflw7\" (UID: \"e5a21edc-6531-41fb-ba4f-921619485a09\") " pod="kuadrant-system/authorino-76dd94b454-lflw7"
Jul 10 02:30:38.226326 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.226304    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5a21edc-6531-41fb-ba4f-921619485a09-tls-cert\") pod \"authorino-76dd94b454-lflw7\" (UID: \"e5a21edc-6531-41fb-ba4f-921619485a09\") " pod="kuadrant-system/authorino-76dd94b454-lflw7"
Jul 10 02:30:38.233311 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.233282    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76dd94b454-lflw7"
Jul 10 02:30:38.233460 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.233374    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9lwf\" (UniqueName: \"kubernetes.io/projected/e5a21edc-6531-41fb-ba4f-921619485a09-kube-api-access-h9lwf\") pod \"authorino-76dd94b454-lflw7\" (UID: \"e5a21edc-6531-41fb-ba4f-921619485a09\") " pod="kuadrant-system/authorino-76dd94b454-lflw7"
Jul 10 02:30:38.233460 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.233282    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dbc6c7c8d-58rsb"
Jul 10 02:30:38.248135 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.248111    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76dd94b454-lflw7"
Jul 10 02:30:38.250994 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.250951    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dbc6c7c8d-58rsb"
Jul 10 02:30:38.324808 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.324764    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed-tls-cert\") pod \"authorino-77c666985d-rjksf\" (UID: \"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed\") " pod="kuadrant-system/authorino-77c666985d-rjksf"
Jul 10 02:30:38.324808 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.324814    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zthqb\" (UniqueName: \"kubernetes.io/projected/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed-kube-api-access-zthqb\") pod \"authorino-77c666985d-rjksf\" (UID: \"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed\") " pod="kuadrant-system/authorino-77c666985d-rjksf"
Jul 10 02:30:38.327314 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.327294    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed-tls-cert\") pod \"authorino-77c666985d-rjksf\" (UID: \"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed\") " pod="kuadrant-system/authorino-77c666985d-rjksf"
Jul 10 02:30:38.334841 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.334819    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zthqb\" (UniqueName: \"kubernetes.io/projected/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed-kube-api-access-zthqb\") pod \"authorino-77c666985d-rjksf\" (UID: \"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed\") " pod="kuadrant-system/authorino-77c666985d-rjksf"
Jul 10 02:30:38.405174 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.405071    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77c666985d-rjksf"
Jul 10 02:30:38.425671 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.425636    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5a21edc-6531-41fb-ba4f-921619485a09-tls-cert\") pod \"e5a21edc-6531-41fb-ba4f-921619485a09\" (UID: \"e5a21edc-6531-41fb-ba4f-921619485a09\") "
Jul 10 02:30:38.425804 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.425680    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9lwf\" (UniqueName: \"kubernetes.io/projected/e5a21edc-6531-41fb-ba4f-921619485a09-kube-api-access-h9lwf\") pod \"e5a21edc-6531-41fb-ba4f-921619485a09\" (UID: \"e5a21edc-6531-41fb-ba4f-921619485a09\") "
Jul 10 02:30:38.425804 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.425760    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxljb\" (UniqueName: \"kubernetes.io/projected/d6a276d3-e900-45b9-be09-fbb7ed057e00-kube-api-access-pxljb\") pod \"d6a276d3-e900-45b9-be09-fbb7ed057e00\" (UID: \"d6a276d3-e900-45b9-be09-fbb7ed057e00\") "
Jul 10 02:30:38.427905 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.427871    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a276d3-e900-45b9-be09-fbb7ed057e00-kube-api-access-pxljb" (OuterVolumeSpecName: "kube-api-access-pxljb") pod "d6a276d3-e900-45b9-be09-fbb7ed057e00" (UID: "d6a276d3-e900-45b9-be09-fbb7ed057e00"). InnerVolumeSpecName "kube-api-access-pxljb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:30:38.427905 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.427879    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5a21edc-6531-41fb-ba4f-921619485a09-kube-api-access-h9lwf" (OuterVolumeSpecName: "kube-api-access-h9lwf") pod "e5a21edc-6531-41fb-ba4f-921619485a09" (UID: "e5a21edc-6531-41fb-ba4f-921619485a09"). InnerVolumeSpecName "kube-api-access-h9lwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:30:38.428093 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.427922    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5a21edc-6531-41fb-ba4f-921619485a09-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e5a21edc-6531-41fb-ba4f-921619485a09" (UID: "e5a21edc-6531-41fb-ba4f-921619485a09"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:30:38.526552 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.526519    2553 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5a21edc-6531-41fb-ba4f-921619485a09-tls-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:30:38.526552 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.526550    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9lwf\" (UniqueName: \"kubernetes.io/projected/e5a21edc-6531-41fb-ba4f-921619485a09-kube-api-access-h9lwf\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:30:38.526552 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.526562    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxljb\" (UniqueName: \"kubernetes.io/projected/d6a276d3-e900-45b9-be09-fbb7ed057e00-kube-api-access-pxljb\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:30:38.538779 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:38.538754    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-77c666985d-rjksf"]
Jul 10 02:30:38.541425 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:30:38.541398    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf7a3fb54_c36f_4991_84b0_5a43ce3e30ed.slice/crio-283ae277e6df7b89a68b948f68fe4e19c61576de21291db4a5d456e65e1615d2 WatchSource:0}: Error finding container 283ae277e6df7b89a68b948f68fe4e19c61576de21291db4a5d456e65e1615d2: Status 404 returned error can't find the container with id 283ae277e6df7b89a68b948f68fe4e19c61576de21291db4a5d456e65e1615d2
Jul 10 02:30:39.239647 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.239550    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76dd94b454-lflw7"
Jul 10 02:30:39.239647 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.239572    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77c666985d-rjksf" event={"ID":"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed","Type":"ContainerStarted","Data":"44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a"}
Jul 10 02:30:39.239647 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.239615    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77c666985d-rjksf" event={"ID":"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed","Type":"ContainerStarted","Data":"283ae277e6df7b89a68b948f68fe4e19c61576de21291db4a5d456e65e1615d2"}
Jul 10 02:30:39.239925 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.239721    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6dbc6c7c8d-58rsb"
Jul 10 02:30:39.265799 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.265745    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-77c666985d-rjksf" podStartSLOduration=0.89864689 podStartE2EDuration="1.265729656s" totalImagesPullingTime="367.082766ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:30:39.263587994 +0000 UTC m=+471.784566306" watchObservedRunningTime="2026-07-10 02:30:39.265729656 +0000 UTC m=+471.786708021"
Jul 10 02:30:39.291472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.291439    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76dd94b454-lflw7"]
Jul 10 02:30:39.294714 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.294671    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8df697c9f-rxmfl"]
Jul 10 02:30:39.294918 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.294892    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-8df697c9f-rxmfl" podUID="b75ff22d-33a1-4870-90b7-54d47740d611" containerName="authorino" containerID="cri-o://043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd" gracePeriod=30
Jul 10 02:30:39.296411 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.296386    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76dd94b454-lflw7"]
Jul 10 02:30:39.322736 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.322702    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6dbc6c7c8d-58rsb"]
Jul 10 02:30:39.328837 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.328807    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6dbc6c7c8d-58rsb"]
Jul 10 02:30:39.542975 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.542936    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-rxmfl"
Jul 10 02:30:39.736716 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.736687    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhfg2\" (UniqueName: \"kubernetes.io/projected/b75ff22d-33a1-4870-90b7-54d47740d611-kube-api-access-rhfg2\") pod \"b75ff22d-33a1-4870-90b7-54d47740d611\" (UID: \"b75ff22d-33a1-4870-90b7-54d47740d611\") "
Jul 10 02:30:39.738759 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.738721    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b75ff22d-33a1-4870-90b7-54d47740d611-kube-api-access-rhfg2" (OuterVolumeSpecName: "kube-api-access-rhfg2") pod "b75ff22d-33a1-4870-90b7-54d47740d611" (UID: "b75ff22d-33a1-4870-90b7-54d47740d611"). InnerVolumeSpecName "kube-api-access-rhfg2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:30:39.837887 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:39.837851    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhfg2\" (UniqueName: \"kubernetes.io/projected/b75ff22d-33a1-4870-90b7-54d47740d611-kube-api-access-rhfg2\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:30:40.009048 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:40.009009    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6a276d3-e900-45b9-be09-fbb7ed057e00" path="/var/lib/kubelet/pods/d6a276d3-e900-45b9-be09-fbb7ed057e00/volumes"
Jul 10 02:30:40.009345 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:40.009331    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5a21edc-6531-41fb-ba4f-921619485a09" path="/var/lib/kubelet/pods/e5a21edc-6531-41fb-ba4f-921619485a09/volumes"
Jul 10 02:30:40.245517 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:40.245427    2553 generic.go:356] "Generic (PLEG): container finished" podID="b75ff22d-33a1-4870-90b7-54d47740d611" containerID="043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd" exitCode=0
Jul 10 02:30:40.245517 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:40.245479    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8df697c9f-rxmfl"
Jul 10 02:30:40.245718 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:40.245517    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-rxmfl" event={"ID":"b75ff22d-33a1-4870-90b7-54d47740d611","Type":"ContainerDied","Data":"043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd"}
Jul 10 02:30:40.245718 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:40.245558    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8df697c9f-rxmfl" event={"ID":"b75ff22d-33a1-4870-90b7-54d47740d611","Type":"ContainerDied","Data":"33cb30ac0f75ae6628e09e4725e34b1ddac80342762c2b228ca03b30ee815121"}
Jul 10 02:30:40.245718 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:40.245578    2553 scope.go:117] "RemoveContainer" containerID="043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd"
Jul 10 02:30:40.254270 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:40.254247    2553 scope.go:117] "RemoveContainer" containerID="043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd"
Jul 10 02:30:40.254582 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:30:40.254564    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd\": container with ID starting with 043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd not found: ID does not exist" containerID="043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd"
Jul 10 02:30:40.254631 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:40.254591    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd"} err="failed to get container status \"043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd\": rpc error: code = NotFound desc = could not find container \"043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd\": container with ID starting with 043872f1b7817a9be1f5fab5a47ba69d2ff6bea3c0644a029b15ab5dc8d652cd not found: ID does not exist"
Jul 10 02:30:40.263615 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:40.263585    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8df697c9f-rxmfl"]
Jul 10 02:30:40.267644 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:40.267623    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8df697c9f-rxmfl"]
Jul 10 02:30:42.008365 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:42.008333    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b75ff22d-33a1-4870-90b7-54d47740d611" path="/var/lib/kubelet/pods/b75ff22d-33a1-4870-90b7-54d47740d611/volumes"
Jul 10 02:30:43.865341 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:43.865309    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:43.871998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:43.871956    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5c7c5d5769-qpl8t"]
Jul 10 02:30:43.872373 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:43.872360    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b75ff22d-33a1-4870-90b7-54d47740d611" containerName="authorino"
Jul 10 02:30:43.872418 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:43.872375    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b75ff22d-33a1-4870-90b7-54d47740d611" containerName="authorino"
Jul 10 02:30:43.872453 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:43.872449    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b75ff22d-33a1-4870-90b7-54d47740d611" containerName="authorino"
Jul 10 02:30:43.959850 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:43.959817    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:43.986241 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:43.986209    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c7c5d5769-qpl8t"]
Jul 10 02:30:43.986390 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:43.986317    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c7c5d5769-qpl8t"
Jul 10 02:30:43.989131 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:43.989106    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5tkrc\""
Jul 10 02:30:43.989278 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:43.989111    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 02:30:43.989278 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:43.989111    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 02:30:44.047174 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.047142    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:44.051496 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.051462    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dd68cb575-j8dlc"]
Jul 10 02:30:44.067911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.067878    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd68cb575-j8dlc"
Jul 10 02:30:44.068795 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.068765    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd68cb575-j8dlc"]
Jul 10 02:30:44.075419 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.075392    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d97c2233-44d3-4543-b03e-2fa2d79aa26e-webhook-cert\") pod \"maas-controller-5c7c5d5769-qpl8t\" (UID: \"d97c2233-44d3-4543-b03e-2fa2d79aa26e\") " pod="opendatahub/maas-controller-5c7c5d5769-qpl8t"
Jul 10 02:30:44.075612 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.075431    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gt7bl\" (UniqueName: \"kubernetes.io/projected/e9710a18-3c20-45b4-be32-0ac2ac1ee753-kube-api-access-gt7bl\") pod \"maas-controller-dd68cb575-j8dlc\" (UID: \"e9710a18-3c20-45b4-be32-0ac2ac1ee753\") " pod="opendatahub/maas-controller-dd68cb575-j8dlc"
Jul 10 02:30:44.075612 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.075491    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9710a18-3c20-45b4-be32-0ac2ac1ee753-webhook-cert\") pod \"maas-controller-dd68cb575-j8dlc\" (UID: \"e9710a18-3c20-45b4-be32-0ac2ac1ee753\") " pod="opendatahub/maas-controller-dd68cb575-j8dlc"
Jul 10 02:30:44.075612 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.075539    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2zhn\" (UniqueName: \"kubernetes.io/projected/d97c2233-44d3-4543-b03e-2fa2d79aa26e-kube-api-access-d2zhn\") pod \"maas-controller-5c7c5d5769-qpl8t\" (UID: \"d97c2233-44d3-4543-b03e-2fa2d79aa26e\") " pod="opendatahub/maas-controller-5c7c5d5769-qpl8t"
Jul 10 02:30:44.121590 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.121479    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:44.176851 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.176812    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d97c2233-44d3-4543-b03e-2fa2d79aa26e-webhook-cert\") pod \"maas-controller-5c7c5d5769-qpl8t\" (UID: \"d97c2233-44d3-4543-b03e-2fa2d79aa26e\") " pod="opendatahub/maas-controller-5c7c5d5769-qpl8t"
Jul 10 02:30:44.176851 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.176855    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gt7bl\" (UniqueName: \"kubernetes.io/projected/e9710a18-3c20-45b4-be32-0ac2ac1ee753-kube-api-access-gt7bl\") pod \"maas-controller-dd68cb575-j8dlc\" (UID: \"e9710a18-3c20-45b4-be32-0ac2ac1ee753\") " pod="opendatahub/maas-controller-dd68cb575-j8dlc"
Jul 10 02:30:44.177101 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.176995    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9710a18-3c20-45b4-be32-0ac2ac1ee753-webhook-cert\") pod \"maas-controller-dd68cb575-j8dlc\" (UID: \"e9710a18-3c20-45b4-be32-0ac2ac1ee753\") " pod="opendatahub/maas-controller-dd68cb575-j8dlc"
Jul 10 02:30:44.177101 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.177051    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2zhn\" (UniqueName: \"kubernetes.io/projected/d97c2233-44d3-4543-b03e-2fa2d79aa26e-kube-api-access-d2zhn\") pod \"maas-controller-5c7c5d5769-qpl8t\" (UID: \"d97c2233-44d3-4543-b03e-2fa2d79aa26e\") " pod="opendatahub/maas-controller-5c7c5d5769-qpl8t"
Jul 10 02:30:44.179436 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.179405    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d97c2233-44d3-4543-b03e-2fa2d79aa26e-webhook-cert\") pod \"maas-controller-5c7c5d5769-qpl8t\" (UID: \"d97c2233-44d3-4543-b03e-2fa2d79aa26e\") " pod="opendatahub/maas-controller-5c7c5d5769-qpl8t"
Jul 10 02:30:44.179553 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.179405    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9710a18-3c20-45b4-be32-0ac2ac1ee753-webhook-cert\") pod \"maas-controller-dd68cb575-j8dlc\" (UID: \"e9710a18-3c20-45b4-be32-0ac2ac1ee753\") " pod="opendatahub/maas-controller-dd68cb575-j8dlc"
Jul 10 02:30:44.186262 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.186235    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gt7bl\" (UniqueName: \"kubernetes.io/projected/e9710a18-3c20-45b4-be32-0ac2ac1ee753-kube-api-access-gt7bl\") pod \"maas-controller-dd68cb575-j8dlc\" (UID: \"e9710a18-3c20-45b4-be32-0ac2ac1ee753\") " pod="opendatahub/maas-controller-dd68cb575-j8dlc"
Jul 10 02:30:44.186385 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.186237    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2zhn\" (UniqueName: \"kubernetes.io/projected/d97c2233-44d3-4543-b03e-2fa2d79aa26e-kube-api-access-d2zhn\") pod \"maas-controller-5c7c5d5769-qpl8t\" (UID: \"d97c2233-44d3-4543-b03e-2fa2d79aa26e\") " pod="opendatahub/maas-controller-5c7c5d5769-qpl8t"
Jul 10 02:30:44.297242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.297201    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c7c5d5769-qpl8t"
Jul 10 02:30:44.379666 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.379431    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd68cb575-j8dlc"
Jul 10 02:30:44.449041 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.449010    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5c7c5d5769-qpl8t"]
Jul 10 02:30:44.453492 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:30:44.453462    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd97c2233_44d3_4543_b03e_2fa2d79aa26e.slice/crio-33cd46113985b747c18c448cc9695da7eae7a1174eeb1de5deef3eb6f81288ea WatchSource:0}: Error finding container 33cd46113985b747c18c448cc9695da7eae7a1174eeb1de5deef3eb6f81288ea: Status 404 returned error can't find the container with id 33cd46113985b747c18c448cc9695da7eae7a1174eeb1de5deef3eb6f81288ea
Jul 10 02:30:44.560585 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:44.560561    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd68cb575-j8dlc"]
Jul 10 02:30:44.562790 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:30:44.562761    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9710a18_3c20_45b4_be32_0ac2ac1ee753.slice/crio-53cd0e8a612d8535dd5a8187e036d56c16b7f17c39d52ec460af2a4bdb32836c WatchSource:0}: Error finding container 53cd0e8a612d8535dd5a8187e036d56c16b7f17c39d52ec460af2a4bdb32836c: Status 404 returned error can't find the container with id 53cd0e8a612d8535dd5a8187e036d56c16b7f17c39d52ec460af2a4bdb32836c
Jul 10 02:30:45.273490 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:45.273449    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c7c5d5769-qpl8t" event={"ID":"d97c2233-44d3-4543-b03e-2fa2d79aa26e","Type":"ContainerStarted","Data":"33cd46113985b747c18c448cc9695da7eae7a1174eeb1de5deef3eb6f81288ea"}
Jul 10 02:30:45.275250 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:45.275219    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd68cb575-j8dlc" event={"ID":"e9710a18-3c20-45b4-be32-0ac2ac1ee753","Type":"ContainerStarted","Data":"53cd0e8a612d8535dd5a8187e036d56c16b7f17c39d52ec460af2a4bdb32836c"}
Jul 10 02:30:47.558305 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:47.558217    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:47.675417 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:47.675384    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:30:48.290669 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:48.290635    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c7c5d5769-qpl8t" event={"ID":"d97c2233-44d3-4543-b03e-2fa2d79aa26e","Type":"ContainerStarted","Data":"b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42"}
Jul 10 02:30:48.290882 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:48.290760    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5c7c5d5769-qpl8t"
Jul 10 02:30:48.292177 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:48.292146    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd68cb575-j8dlc" event={"ID":"e9710a18-3c20-45b4-be32-0ac2ac1ee753","Type":"ContainerStarted","Data":"c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0"}
Jul 10 02:30:48.292311 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:48.292232    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dd68cb575-j8dlc"
Jul 10 02:30:48.313310 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:48.313242    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5c7c5d5769-qpl8t" podStartSLOduration=2.463856678 podStartE2EDuration="5.313225721s" totalImagesPullingTime="2.849369043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:30:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:30:48.310427899 +0000 UTC m=+480.831406208" watchObservedRunningTime="2026-07-10 02:30:48.313225721 +0000 UTC m=+480.834204029"
Jul 10 02:30:48.334868 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:48.334813    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dd68cb575-j8dlc" podStartSLOduration=1.583959808 podStartE2EDuration="4.334795523s" totalImagesPullingTime="2.750835715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:30:48.332006449 +0000 UTC m=+480.852984761" watchObservedRunningTime="2026-07-10 02:30:48.334795523 +0000 UTC m=+480.855773853"
Jul 10 02:30:59.302408 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:59.302374    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5c7c5d5769-qpl8t"
Jul 10 02:30:59.302840 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:59.302625    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dd68cb575-j8dlc"
Jul 10 02:30:59.373618 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:59.373584    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c7c5d5769-qpl8t"]
Jul 10 02:30:59.373855 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:59.373830    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5c7c5d5769-qpl8t" podUID="d97c2233-44d3-4543-b03e-2fa2d79aa26e" containerName="manager" containerID="cri-o://b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42" gracePeriod=30
Jul 10 02:30:59.620580 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:59.620554    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c7c5d5769-qpl8t"
Jul 10 02:30:59.723410 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:59.723369    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2zhn\" (UniqueName: \"kubernetes.io/projected/d97c2233-44d3-4543-b03e-2fa2d79aa26e-kube-api-access-d2zhn\") pod \"d97c2233-44d3-4543-b03e-2fa2d79aa26e\" (UID: \"d97c2233-44d3-4543-b03e-2fa2d79aa26e\") "
Jul 10 02:30:59.723626 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:59.723477    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d97c2233-44d3-4543-b03e-2fa2d79aa26e-webhook-cert\") pod \"d97c2233-44d3-4543-b03e-2fa2d79aa26e\" (UID: \"d97c2233-44d3-4543-b03e-2fa2d79aa26e\") "
Jul 10 02:30:59.725822 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:59.725790    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d97c2233-44d3-4543-b03e-2fa2d79aa26e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d97c2233-44d3-4543-b03e-2fa2d79aa26e" (UID: "d97c2233-44d3-4543-b03e-2fa2d79aa26e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:30:59.725945 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:59.725792    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d97c2233-44d3-4543-b03e-2fa2d79aa26e-kube-api-access-d2zhn" (OuterVolumeSpecName: "kube-api-access-d2zhn") pod "d97c2233-44d3-4543-b03e-2fa2d79aa26e" (UID: "d97c2233-44d3-4543-b03e-2fa2d79aa26e"). InnerVolumeSpecName "kube-api-access-d2zhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:30:59.824292 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:59.824253    2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d97c2233-44d3-4543-b03e-2fa2d79aa26e-webhook-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:30:59.824292 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:30:59.824286    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2zhn\" (UniqueName: \"kubernetes.io/projected/d97c2233-44d3-4543-b03e-2fa2d79aa26e-kube-api-access-d2zhn\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:31:00.353051 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:00.353018    2553 generic.go:356] "Generic (PLEG): container finished" podID="d97c2233-44d3-4543-b03e-2fa2d79aa26e" containerID="b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42" exitCode=0
Jul 10 02:31:00.353455 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:00.353061    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5c7c5d5769-qpl8t"
Jul 10 02:31:00.353455 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:00.353108    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c7c5d5769-qpl8t" event={"ID":"d97c2233-44d3-4543-b03e-2fa2d79aa26e","Type":"ContainerDied","Data":"b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42"}
Jul 10 02:31:00.353455 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:00.353160    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5c7c5d5769-qpl8t" event={"ID":"d97c2233-44d3-4543-b03e-2fa2d79aa26e","Type":"ContainerDied","Data":"33cd46113985b747c18c448cc9695da7eae7a1174eeb1de5deef3eb6f81288ea"}
Jul 10 02:31:00.353455 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:00.353184    2553 scope.go:117] "RemoveContainer" containerID="b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42"
Jul 10 02:31:00.361697 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:00.361679    2553 scope.go:117] "RemoveContainer" containerID="b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42"
Jul 10 02:31:00.361978 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:31:00.361943    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42\": container with ID starting with b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42 not found: ID does not exist" containerID="b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42"
Jul 10 02:31:00.362036 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:00.361989    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42"} err="failed to get container status \"b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42\": rpc error: code = NotFound desc = could not find container \"b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42\": container with ID starting with b4b7be61b1f243a8bd5372118f145e5a6040aba8fdb81b7de6d00f07ec2c8d42 not found: ID does not exist"
Jul 10 02:31:00.371786 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:00.371766    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5c7c5d5769-qpl8t"]
Jul 10 02:31:00.378465 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:00.378443    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5c7c5d5769-qpl8t"]
Jul 10 02:31:02.008878 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:02.008842    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d97c2233-44d3-4543-b03e-2fa2d79aa26e" path="/var/lib/kubelet/pods/d97c2233-44d3-4543-b03e-2fa2d79aa26e/volumes"
Jul 10 02:31:19.438104 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:19.438069    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:31:19.835176 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:19.835143    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:31:19.881054 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:19.881014    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"]
Jul 10 02:31:19.881423 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:19.881410    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d97c2233-44d3-4543-b03e-2fa2d79aa26e" containerName="manager"
Jul 10 02:31:19.881468 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:19.881424    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d97c2233-44d3-4543-b03e-2fa2d79aa26e" containerName="manager"
Jul 10 02:31:19.881516 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:19.881506    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d97c2233-44d3-4543-b03e-2fa2d79aa26e" containerName="manager"
Jul 10 02:31:19.884643 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:19.884625    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:19.887350 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:19.887325    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 10 02:31:19.887490 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:19.887365    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g2v9p\""
Jul 10 02:31:19.896845 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:19.896814    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"]
Jul 10 02:31:20.024614 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.024577    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9711ac9c-d874-4c26-80ab-5d8e97a5854e-openshift-service-ca\") pod \"maas-api-6b4cfccc4d-nfl42\" (UID: \"9711ac9c-d874-4c26-80ab-5d8e97a5854e\") " pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:20.024797 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.024667    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9711ac9c-d874-4c26-80ab-5d8e97a5854e-maas-api-tls\") pod \"maas-api-6b4cfccc4d-nfl42\" (UID: \"9711ac9c-d874-4c26-80ab-5d8e97a5854e\") " pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:20.024797 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.024687    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmbf6\" (UniqueName: \"kubernetes.io/projected/9711ac9c-d874-4c26-80ab-5d8e97a5854e-kube-api-access-xmbf6\") pod \"maas-api-6b4cfccc4d-nfl42\" (UID: \"9711ac9c-d874-4c26-80ab-5d8e97a5854e\") " pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:20.126112 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.126026    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9711ac9c-d874-4c26-80ab-5d8e97a5854e-maas-api-tls\") pod \"maas-api-6b4cfccc4d-nfl42\" (UID: \"9711ac9c-d874-4c26-80ab-5d8e97a5854e\") " pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:20.126112 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.126059    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmbf6\" (UniqueName: \"kubernetes.io/projected/9711ac9c-d874-4c26-80ab-5d8e97a5854e-kube-api-access-xmbf6\") pod \"maas-api-6b4cfccc4d-nfl42\" (UID: \"9711ac9c-d874-4c26-80ab-5d8e97a5854e\") " pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:20.126295 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.126122    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9711ac9c-d874-4c26-80ab-5d8e97a5854e-openshift-service-ca\") pod \"maas-api-6b4cfccc4d-nfl42\" (UID: \"9711ac9c-d874-4c26-80ab-5d8e97a5854e\") " pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:20.126853 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.126827    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9711ac9c-d874-4c26-80ab-5d8e97a5854e-openshift-service-ca\") pod \"maas-api-6b4cfccc4d-nfl42\" (UID: \"9711ac9c-d874-4c26-80ab-5d8e97a5854e\") " pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:20.128466 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.128439    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9711ac9c-d874-4c26-80ab-5d8e97a5854e-maas-api-tls\") pod \"maas-api-6b4cfccc4d-nfl42\" (UID: \"9711ac9c-d874-4c26-80ab-5d8e97a5854e\") " pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:20.134542 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.134520    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmbf6\" (UniqueName: \"kubernetes.io/projected/9711ac9c-d874-4c26-80ab-5d8e97a5854e-kube-api-access-xmbf6\") pod \"maas-api-6b4cfccc4d-nfl42\" (UID: \"9711ac9c-d874-4c26-80ab-5d8e97a5854e\") " pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:20.174414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.174380    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:31:20.196483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.196451    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:20.347643 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.347588    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"]
Jul 10 02:31:20.350262 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:31:20.350234    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9711ac9c_d874_4c26_80ab_5d8e97a5854e.slice/crio-cb7e3a2b5b7d7e9d0b05afcead072fcb41cd2d6c74ce7ce8eeef96b5a6694698 WatchSource:0}: Error finding container cb7e3a2b5b7d7e9d0b05afcead072fcb41cd2d6c74ce7ce8eeef96b5a6694698: Status 404 returned error can't find the container with id cb7e3a2b5b7d7e9d0b05afcead072fcb41cd2d6c74ce7ce8eeef96b5a6694698
Jul 10 02:31:20.376894 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.376799    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:31:20.451850 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.451814    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42" event={"ID":"9711ac9c-d874-4c26-80ab-5d8e97a5854e","Type":"ContainerStarted","Data":"cb7e3a2b5b7d7e9d0b05afcead072fcb41cd2d6c74ce7ce8eeef96b5a6694698"}
Jul 10 02:31:20.477230 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.477194    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:31:20.559912 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.559877    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-wtrvc"]
Jul 10 02:31:20.564622 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.564600    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc"
Jul 10 02:31:20.567575 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.567541    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 10 02:31:20.567782 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.567760    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cj89r\""
Jul 10 02:31:20.579088 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.579063    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-wtrvc"]
Jul 10 02:31:20.732502 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.732382    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39e8a37e-529a-428d-86a0-2e62d76ebe5d-plugins-config-volume\") pod \"payload-pre-processing-7964457696-wtrvc\" (UID: \"39e8a37e-529a-428d-86a0-2e62d76ebe5d\") " pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc"
Jul 10 02:31:20.732677 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.732575    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c77rv\" (UniqueName: \"kubernetes.io/projected/39e8a37e-529a-428d-86a0-2e62d76ebe5d-kube-api-access-c77rv\") pod \"payload-pre-processing-7964457696-wtrvc\" (UID: \"39e8a37e-529a-428d-86a0-2e62d76ebe5d\") " pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc"
Jul 10 02:31:20.833873 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.833816    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c77rv\" (UniqueName: \"kubernetes.io/projected/39e8a37e-529a-428d-86a0-2e62d76ebe5d-kube-api-access-c77rv\") pod \"payload-pre-processing-7964457696-wtrvc\" (UID: \"39e8a37e-529a-428d-86a0-2e62d76ebe5d\") " pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc"
Jul 10 02:31:20.834100 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.833885    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39e8a37e-529a-428d-86a0-2e62d76ebe5d-plugins-config-volume\") pod \"payload-pre-processing-7964457696-wtrvc\" (UID: \"39e8a37e-529a-428d-86a0-2e62d76ebe5d\") " pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc"
Jul 10 02:31:20.834714 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.834687    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39e8a37e-529a-428d-86a0-2e62d76ebe5d-plugins-config-volume\") pod \"payload-pre-processing-7964457696-wtrvc\" (UID: \"39e8a37e-529a-428d-86a0-2e62d76ebe5d\") " pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc"
Jul 10 02:31:20.843510 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.843481    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c77rv\" (UniqueName: \"kubernetes.io/projected/39e8a37e-529a-428d-86a0-2e62d76ebe5d-kube-api-access-c77rv\") pod \"payload-pre-processing-7964457696-wtrvc\" (UID: \"39e8a37e-529a-428d-86a0-2e62d76ebe5d\") " pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc"
Jul 10 02:31:20.876578 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:20.876540    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc"
Jul 10 02:31:21.027014 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:21.026982    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-wtrvc"]
Jul 10 02:31:21.027899 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:31:21.027868    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e8a37e_529a_428d_86a0_2e62d76ebe5d.slice/crio-45677fb2eb9728b2686bef4dfaf0f94691781ffe6e716cf7c3dd21edc0718803 WatchSource:0}: Error finding container 45677fb2eb9728b2686bef4dfaf0f94691781ffe6e716cf7c3dd21edc0718803: Status 404 returned error can't find the container with id 45677fb2eb9728b2686bef4dfaf0f94691781ffe6e716cf7c3dd21edc0718803
Jul 10 02:31:21.230265 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:21.230234    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:31:21.459658 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:21.459621    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc" event={"ID":"39e8a37e-529a-428d-86a0-2e62d76ebe5d","Type":"ContainerStarted","Data":"45677fb2eb9728b2686bef4dfaf0f94691781ffe6e716cf7c3dd21edc0718803"}
Jul 10 02:31:23.471547 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:23.471512    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42" event={"ID":"9711ac9c-d874-4c26-80ab-5d8e97a5854e","Type":"ContainerStarted","Data":"1c90b94fe4f60beb2ce0bc22746318c62e9fd895b93197b38f81382dd43d0ea8"}
Jul 10 02:31:23.472040 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:23.471676    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:23.472923 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:23.472902    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc" event={"ID":"39e8a37e-529a-428d-86a0-2e62d76ebe5d","Type":"ContainerStarted","Data":"b65b50f5f3379580dc9a5264efad4e2c85ce3e3c1130f964824211d6a660dab6"}
Jul 10 02:31:23.473064 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:23.473008    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc"
Jul 10 02:31:23.498579 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:23.498531    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42" podStartSLOduration=2.182266569 podStartE2EDuration="4.498518061s" totalImagesPullingTime="2.316251492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:31:23.497950748 +0000 UTC m=+516.018929058" watchObservedRunningTime="2026-07-10 02:31:23.498518061 +0000 UTC m=+516.019496374"
Jul 10 02:31:23.523421 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:23.523370    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc" podStartSLOduration=1.883492209 podStartE2EDuration="3.523355054s" totalImagesPullingTime="1.639862845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:31:23.521092268 +0000 UTC m=+516.042070590" watchObservedRunningTime="2026-07-10 02:31:23.523355054 +0000 UTC m=+516.044333397"
Jul 10 02:31:29.483889 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:29.483813    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b4cfccc4d-nfl42"
Jul 10 02:31:30.517734 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:30.517687    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:31:30.615246 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:30.615207    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:31:34.479128 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:34.479092    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-wtrvc"
Jul 10 02:31:45.825837 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.825754    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"]
Jul 10 02:31:45.829739 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.829716    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:45.835585 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.835564    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 02:31:45.836694 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.836671    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 02:31:45.836801 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.836726    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ggkvw\""
Jul 10 02:31:45.836801 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.836787    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 10 02:31:45.842753 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.842728    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"]
Jul 10 02:31:45.884536 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.884500    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:31:45.944886 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.944844    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbzk5\" (UniqueName: \"kubernetes.io/projected/63895b2b-ccbe-4b4c-b52c-2f30fb377458-kube-api-access-rbzk5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:45.945099 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.945001    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63895b2b-ccbe-4b4c-b52c-2f30fb377458-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:45.945099 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.945037    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63895b2b-ccbe-4b4c-b52c-2f30fb377458-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:45.945099 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.945057    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63895b2b-ccbe-4b4c-b52c-2f30fb377458-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:45.945221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.945117    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63895b2b-ccbe-4b4c-b52c-2f30fb377458-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:45.945221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:45.945137    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63895b2b-ccbe-4b4c-b52c-2f30fb377458-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.045795 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.045749    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63895b2b-ccbe-4b4c-b52c-2f30fb377458-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.046056 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.045797    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63895b2b-ccbe-4b4c-b52c-2f30fb377458-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.046056 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.045855    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63895b2b-ccbe-4b4c-b52c-2f30fb377458-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.046056 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.045940    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63895b2b-ccbe-4b4c-b52c-2f30fb377458-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.046056 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.046001    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63895b2b-ccbe-4b4c-b52c-2f30fb377458-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.046313 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.046231    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63895b2b-ccbe-4b4c-b52c-2f30fb377458-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.046313 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.046298    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbzk5\" (UniqueName: \"kubernetes.io/projected/63895b2b-ccbe-4b4c-b52c-2f30fb377458-kube-api-access-rbzk5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.046420 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.046399    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63895b2b-ccbe-4b4c-b52c-2f30fb377458-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.046575 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.046545    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63895b2b-ccbe-4b4c-b52c-2f30fb377458-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.048463 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.048438    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63895b2b-ccbe-4b4c-b52c-2f30fb377458-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.048871 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.048854    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63895b2b-ccbe-4b4c-b52c-2f30fb377458-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.055145 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.055121    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbzk5\" (UniqueName: \"kubernetes.io/projected/63895b2b-ccbe-4b4c-b52c-2f30fb377458-kube-api-access-rbzk5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx\" (UID: \"63895b2b-ccbe-4b4c-b52c-2f30fb377458\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.140421 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.140333    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:46.281877 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.281653    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"]
Jul 10 02:31:46.287485 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:31:46.287451    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63895b2b_ccbe_4b4c_b52c_2f30fb377458.slice/crio-51b8415ab80b7f006b65a29d8d3f989a5464ce1ba974ccdd377fab1205f14675 WatchSource:0}: Error finding container 51b8415ab80b7f006b65a29d8d3f989a5464ce1ba974ccdd377fab1205f14675: Status 404 returned error can't find the container with id 51b8415ab80b7f006b65a29d8d3f989a5464ce1ba974ccdd377fab1205f14675
Jul 10 02:31:46.592013 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:46.591951    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx" event={"ID":"63895b2b-ccbe-4b4c-b52c-2f30fb377458","Type":"ContainerStarted","Data":"51b8415ab80b7f006b65a29d8d3f989a5464ce1ba974ccdd377fab1205f14675"}
Jul 10 02:31:47.598916 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:47.598877    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx" event={"ID":"63895b2b-ccbe-4b4c-b52c-2f30fb377458","Type":"ContainerStarted","Data":"1e759cd5750cfe138f1aaf6ab27daa4e2d8fe0b23d2e083f40929526ee8e948b"}
Jul 10 02:31:47.647849 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:47.647777    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx" podStartSLOduration=1.441153887 podStartE2EDuration="2.647754183s" totalImagesPullingTime="1.206600296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:31:47.645299297 +0000 UTC m=+540.166277618" watchObservedRunningTime="2026-07-10 02:31:47.647754183 +0000 UTC m=+540.168732494"
Jul 10 02:31:55.400457 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:55.400410    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:31:56.141260 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:56.141226    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:56.141460 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:56.141301    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:56.153900 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:56.153876    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:31:56.652377 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:31:56.652336    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx"
Jul 10 02:32:10.149067 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:10.149029    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:32:17.035588 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.035551    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"]
Jul 10 02:32:17.039225 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.039201    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.042466 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.042440    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 10 02:32:17.062761 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.062730    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"]
Jul 10 02:32:17.078669 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.078637    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:32:17.131120 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.131078    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24f84186-6d95-44f8-bafd-87b40634a85b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.131294 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.131135    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24f84186-6d95-44f8-bafd-87b40634a85b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.131294 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.131154    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f84186-6d95-44f8-bafd-87b40634a85b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.131294 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.131213    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp7zw\" (UniqueName: \"kubernetes.io/projected/24f84186-6d95-44f8-bafd-87b40634a85b-kube-api-access-tp7zw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.131294 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.131233    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f84186-6d95-44f8-bafd-87b40634a85b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.131294 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.131280    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f84186-6d95-44f8-bafd-87b40634a85b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.232334 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.232298    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24f84186-6d95-44f8-bafd-87b40634a85b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.232507 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.232350    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24f84186-6d95-44f8-bafd-87b40634a85b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.232507 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.232464    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f84186-6d95-44f8-bafd-87b40634a85b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.232583 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.232524    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp7zw\" (UniqueName: \"kubernetes.io/projected/24f84186-6d95-44f8-bafd-87b40634a85b-kube-api-access-tp7zw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.232583 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.232568    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f84186-6d95-44f8-bafd-87b40634a85b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.232669 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.232624    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f84186-6d95-44f8-bafd-87b40634a85b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.232728 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.232711    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/24f84186-6d95-44f8-bafd-87b40634a85b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.233077 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.233052    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/24f84186-6d95-44f8-bafd-87b40634a85b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.233187 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.233052    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/24f84186-6d95-44f8-bafd-87b40634a85b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.234774 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.234754    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/24f84186-6d95-44f8-bafd-87b40634a85b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.235137 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.235098    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/24f84186-6d95-44f8-bafd-87b40634a85b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.244981 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.244927    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp7zw\" (UniqueName: \"kubernetes.io/projected/24f84186-6d95-44f8-bafd-87b40634a85b-kube-api-access-tp7zw\") pod \"e2e-trlp-test-simulated-kserve-598466548d-bqx6w\" (UID: \"24f84186-6d95-44f8-bafd-87b40634a85b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.350921 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.350874    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:17.495922 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.495891    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"]
Jul 10 02:32:17.497998 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:32:17.497943    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f84186_6d95_44f8_bafd_87b40634a85b.slice/crio-43a8c1e40ddeb96e5aa1d9da8f5e4b16b776bfdbdfe46b8d0e37fd702dc2dbc6 WatchSource:0}: Error finding container 43a8c1e40ddeb96e5aa1d9da8f5e4b16b776bfdbdfe46b8d0e37fd702dc2dbc6: Status 404 returned error can't find the container with id 43a8c1e40ddeb96e5aa1d9da8f5e4b16b776bfdbdfe46b8d0e37fd702dc2dbc6
Jul 10 02:32:17.740656 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:17.740619    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w" event={"ID":"24f84186-6d95-44f8-bafd-87b40634a85b","Type":"ContainerStarted","Data":"43a8c1e40ddeb96e5aa1d9da8f5e4b16b776bfdbdfe46b8d0e37fd702dc2dbc6"}
Jul 10 02:32:18.747409 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:18.747368    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w" event={"ID":"24f84186-6d95-44f8-bafd-87b40634a85b","Type":"ContainerStarted","Data":"a19cc102f824cfa9ceef6b2d1bfcf961a712ab8ecf597b266b81f66eb8b9f871"}
Jul 10 02:32:18.768795 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:18.768737    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w" podStartSLOduration=1.588636675 podStartE2EDuration="1.768718824s" totalImagesPullingTime="180.082149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:32:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:32:18.766618354 +0000 UTC m=+571.287596664" watchObservedRunningTime="2026-07-10 02:32:18.768718824 +0000 UTC m=+571.289697133"
Jul 10 02:32:27.351842 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:27.351788    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:27.352330 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:27.351878    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:27.364814 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:27.364783    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:27.801621 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:27.801591    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-bqx6w"
Jul 10 02:32:32.752994 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:32.752941    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:32:38.045217 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:38.045184    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:32:47.943085 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:47.943052    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:32:47.947909 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:32:47.947879    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:33:00.739269 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:33:00.739224    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:33:02.239536 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:33:02.239505    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:33:02.352546 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:33:02.352515    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:34:00.149121 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:00.149083    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66d74486d7-5xgdq"]
Jul 10 02:34:00.153220 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:00.153197    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66d74486d7-5xgdq"
Jul 10 02:34:00.163000 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:00.162941    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66d74486d7-5xgdq"]
Jul 10 02:34:00.193446 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:00.193412    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgx4l\" (UniqueName: \"kubernetes.io/projected/7956b83c-f621-48bf-99d4-80aaf753607d-kube-api-access-qgx4l\") pod \"authorino-66d74486d7-5xgdq\" (UID: \"7956b83c-f621-48bf-99d4-80aaf753607d\") " pod="kuadrant-system/authorino-66d74486d7-5xgdq"
Jul 10 02:34:00.193698 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:00.193470    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7956b83c-f621-48bf-99d4-80aaf753607d-tls-cert\") pod \"authorino-66d74486d7-5xgdq\" (UID: \"7956b83c-f621-48bf-99d4-80aaf753607d\") " pod="kuadrant-system/authorino-66d74486d7-5xgdq"
Jul 10 02:34:00.294501 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:00.294458    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgx4l\" (UniqueName: \"kubernetes.io/projected/7956b83c-f621-48bf-99d4-80aaf753607d-kube-api-access-qgx4l\") pod \"authorino-66d74486d7-5xgdq\" (UID: \"7956b83c-f621-48bf-99d4-80aaf753607d\") " pod="kuadrant-system/authorino-66d74486d7-5xgdq"
Jul 10 02:34:00.294706 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:00.294526    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7956b83c-f621-48bf-99d4-80aaf753607d-tls-cert\") pod \"authorino-66d74486d7-5xgdq\" (UID: \"7956b83c-f621-48bf-99d4-80aaf753607d\") " pod="kuadrant-system/authorino-66d74486d7-5xgdq"
Jul 10 02:34:00.297006 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:00.296973    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/7956b83c-f621-48bf-99d4-80aaf753607d-tls-cert\") pod \"authorino-66d74486d7-5xgdq\" (UID: \"7956b83c-f621-48bf-99d4-80aaf753607d\") " pod="kuadrant-system/authorino-66d74486d7-5xgdq"
Jul 10 02:34:00.305468 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:00.305443    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgx4l\" (UniqueName: \"kubernetes.io/projected/7956b83c-f621-48bf-99d4-80aaf753607d-kube-api-access-qgx4l\") pod \"authorino-66d74486d7-5xgdq\" (UID: \"7956b83c-f621-48bf-99d4-80aaf753607d\") " pod="kuadrant-system/authorino-66d74486d7-5xgdq"
Jul 10 02:34:00.463320 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:00.463221    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66d74486d7-5xgdq"
Jul 10 02:34:00.603330 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:00.603297    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66d74486d7-5xgdq"]
Jul 10 02:34:00.604356 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:34:00.604334    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7956b83c_f621_48bf_99d4_80aaf753607d.slice/crio-48f4caafaa08dd3d8140ee60d11dd0fde8659628e1174b37408cf1b04ebb89e5 WatchSource:0}: Error finding container 48f4caafaa08dd3d8140ee60d11dd0fde8659628e1174b37408cf1b04ebb89e5: Status 404 returned error can't find the container with id 48f4caafaa08dd3d8140ee60d11dd0fde8659628e1174b37408cf1b04ebb89e5
Jul 10 02:34:01.230232 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.230186    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66d74486d7-5xgdq" event={"ID":"7956b83c-f621-48bf-99d4-80aaf753607d","Type":"ContainerStarted","Data":"1c611498b1f003dc3c8269165f1bc4811e368f3a6f15a6b302c3933df7a9f5a8"}
Jul 10 02:34:01.230645 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.230252    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66d74486d7-5xgdq" event={"ID":"7956b83c-f621-48bf-99d4-80aaf753607d","Type":"ContainerStarted","Data":"48f4caafaa08dd3d8140ee60d11dd0fde8659628e1174b37408cf1b04ebb89e5"}
Jul 10 02:34:01.311513 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.311452    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66d74486d7-5xgdq" podStartSLOduration=0.801645087 podStartE2EDuration="1.311430838s" totalImagesPullingTime="509.785751ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:34:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:34:01.258063216 +0000 UTC m=+673.779041525" watchObservedRunningTime="2026-07-10 02:34:01.311430838 +0000 UTC m=+673.832409147"
Jul 10 02:34:01.311937 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.311922    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77c666985d-rjksf"]
Jul 10 02:34:01.312163 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.312135    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-77c666985d-rjksf" podUID="f7a3fb54-c36f-4991-84b0-5a43ce3e30ed" containerName="authorino" containerID="cri-o://44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a" gracePeriod=30
Jul 10 02:34:01.584561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.584534    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77c666985d-rjksf"
Jul 10 02:34:01.608731 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.608699    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed-tls-cert\") pod \"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed\" (UID: \"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed\") "
Jul 10 02:34:01.608898 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.608758    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zthqb\" (UniqueName: \"kubernetes.io/projected/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed-kube-api-access-zthqb\") pod \"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed\" (UID: \"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed\") "
Jul 10 02:34:01.611119 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.611086    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed-kube-api-access-zthqb" (OuterVolumeSpecName: "kube-api-access-zthqb") pod "f7a3fb54-c36f-4991-84b0-5a43ce3e30ed" (UID: "f7a3fb54-c36f-4991-84b0-5a43ce3e30ed"). InnerVolumeSpecName "kube-api-access-zthqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:34:01.621177 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.621136    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f7a3fb54-c36f-4991-84b0-5a43ce3e30ed" (UID: "f7a3fb54-c36f-4991-84b0-5a43ce3e30ed"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:34:01.710482 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.710395    2553 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed-tls-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:34:01.710482 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.710425    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zthqb\" (UniqueName: \"kubernetes.io/projected/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed-kube-api-access-zthqb\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:34:01.978930 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:01.978845    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:34:02.180990 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:02.180940    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:34:02.238491 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:02.238397    2553 generic.go:356] "Generic (PLEG): container finished" podID="f7a3fb54-c36f-4991-84b0-5a43ce3e30ed" containerID="44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a" exitCode=0
Jul 10 02:34:02.238897 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:02.238499    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-77c666985d-rjksf"
Jul 10 02:34:02.238897 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:02.238535    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77c666985d-rjksf" event={"ID":"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed","Type":"ContainerDied","Data":"44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a"}
Jul 10 02:34:02.238897 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:02.238578    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-77c666985d-rjksf" event={"ID":"f7a3fb54-c36f-4991-84b0-5a43ce3e30ed","Type":"ContainerDied","Data":"283ae277e6df7b89a68b948f68fe4e19c61576de21291db4a5d456e65e1615d2"}
Jul 10 02:34:02.238897 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:02.238601    2553 scope.go:117] "RemoveContainer" containerID="44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a"
Jul 10 02:34:02.248155 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:02.248130    2553 scope.go:117] "RemoveContainer" containerID="44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a"
Jul 10 02:34:02.248486 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:34:02.248466    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a\": container with ID starting with 44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a not found: ID does not exist" containerID="44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a"
Jul 10 02:34:02.248538 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:02.248497    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a"} err="failed to get container status \"44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a\": rpc error: code = NotFound desc = could not find container \"44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a\": container with ID starting with 44d4071dd0f00f87927af4a9339075c90d92582b18723007335439a84d7b237a not found: ID does not exist"
Jul 10 02:34:02.284387 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:02.284346    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-77c666985d-rjksf"]
Jul 10 02:34:02.300083 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:02.300047    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-77c666985d-rjksf"]
Jul 10 02:34:03.137827 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:03.137794    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:34:03.297629 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:03.297596    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:34:04.009154 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:04.009125    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7a3fb54-c36f-4991-84b0-5a43ce3e30ed" path="/var/lib/kubelet/pods/f7a3fb54-c36f-4991-84b0-5a43ce3e30ed/volumes"
Jul 10 02:34:04.555376 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:34:04.555345    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:35:13.562561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:13.562522    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:35:13.660919 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:13.660881    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dd68cb575-j8dlc"]
Jul 10 02:35:13.661172 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:13.661147    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-dd68cb575-j8dlc" podUID="e9710a18-3c20-45b4-be32-0ac2ac1ee753" containerName="manager" containerID="cri-o://c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0" gracePeriod=30
Jul 10 02:35:13.920872 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:13.920844    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd68cb575-j8dlc"
Jul 10 02:35:14.087390 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.087287    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gt7bl\" (UniqueName: \"kubernetes.io/projected/e9710a18-3c20-45b4-be32-0ac2ac1ee753-kube-api-access-gt7bl\") pod \"e9710a18-3c20-45b4-be32-0ac2ac1ee753\" (UID: \"e9710a18-3c20-45b4-be32-0ac2ac1ee753\") "
Jul 10 02:35:14.087579 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.087396    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9710a18-3c20-45b4-be32-0ac2ac1ee753-webhook-cert\") pod \"e9710a18-3c20-45b4-be32-0ac2ac1ee753\" (UID: \"e9710a18-3c20-45b4-be32-0ac2ac1ee753\") "
Jul 10 02:35:14.095506 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.095391    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9710a18-3c20-45b4-be32-0ac2ac1ee753-kube-api-access-gt7bl" (OuterVolumeSpecName: "kube-api-access-gt7bl") pod "e9710a18-3c20-45b4-be32-0ac2ac1ee753" (UID: "e9710a18-3c20-45b4-be32-0ac2ac1ee753"). InnerVolumeSpecName "kube-api-access-gt7bl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:35:14.095506 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.095496    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9710a18-3c20-45b4-be32-0ac2ac1ee753-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e9710a18-3c20-45b4-be32-0ac2ac1ee753" (UID: "e9710a18-3c20-45b4-be32-0ac2ac1ee753"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:35:14.191382 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.191344    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gt7bl\" (UniqueName: \"kubernetes.io/projected/e9710a18-3c20-45b4-be32-0ac2ac1ee753-kube-api-access-gt7bl\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:35:14.191382 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.191375    2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e9710a18-3c20-45b4-be32-0ac2ac1ee753-webhook-cert\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:35:14.582879 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.582844    2553 generic.go:356] "Generic (PLEG): container finished" podID="e9710a18-3c20-45b4-be32-0ac2ac1ee753" containerID="c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0" exitCode=0
Jul 10 02:35:14.583294 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.582902    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd68cb575-j8dlc"
Jul 10 02:35:14.583294 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.582923    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd68cb575-j8dlc" event={"ID":"e9710a18-3c20-45b4-be32-0ac2ac1ee753","Type":"ContainerDied","Data":"c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0"}
Jul 10 02:35:14.583294 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.583032    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd68cb575-j8dlc" event={"ID":"e9710a18-3c20-45b4-be32-0ac2ac1ee753","Type":"ContainerDied","Data":"53cd0e8a612d8535dd5a8187e036d56c16b7f17c39d52ec460af2a4bdb32836c"}
Jul 10 02:35:14.583294 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.583055    2553 scope.go:117] "RemoveContainer" containerID="c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0"
Jul 10 02:35:14.592309 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.592286    2553 scope.go:117] "RemoveContainer" containerID="c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0"
Jul 10 02:35:14.592573 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:35:14.592553    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0\": container with ID starting with c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0 not found: ID does not exist" containerID="c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0"
Jul 10 02:35:14.592652 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.592582    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0"} err="failed to get container status \"c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0\": rpc error: code = NotFound desc = could not find container \"c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0\": container with ID starting with c9161ed5497d81049d6d393551a867d6e8178666553645de711c95d8024feaf0 not found: ID does not exist"
Jul 10 02:35:14.607226 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.607190    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dd68cb575-j8dlc"]
Jul 10 02:35:14.611342 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:14.611314    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dd68cb575-j8dlc"]
Jul 10 02:35:15.259244 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.259210    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:35:15.377829 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.377792    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dd68cb575-9lpm4"]
Jul 10 02:35:15.378202 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.378190    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9710a18-3c20-45b4-be32-0ac2ac1ee753" containerName="manager"
Jul 10 02:35:15.378259 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.378204    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9710a18-3c20-45b4-be32-0ac2ac1ee753" containerName="manager"
Jul 10 02:35:15.378259 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.378219    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7a3fb54-c36f-4991-84b0-5a43ce3e30ed" containerName="authorino"
Jul 10 02:35:15.378259 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.378224    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7a3fb54-c36f-4991-84b0-5a43ce3e30ed" containerName="authorino"
Jul 10 02:35:15.378354 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.378293    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7a3fb54-c36f-4991-84b0-5a43ce3e30ed" containerName="authorino"
Jul 10 02:35:15.378354 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.378302    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9710a18-3c20-45b4-be32-0ac2ac1ee753" containerName="manager"
Jul 10 02:35:15.382732 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.382713    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd68cb575-9lpm4"
Jul 10 02:35:15.385596 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.385559    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 10 02:35:15.385749 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.385712    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 10 02:35:15.386687 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.386669    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5tkrc\""
Jul 10 02:35:15.395151 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.395126    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd68cb575-9lpm4"]
Jul 10 02:35:15.403517 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.403490    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbn7r\" (UniqueName: \"kubernetes.io/projected/01c518a3-3433-4487-a42f-29b868e43b4d-kube-api-access-mbn7r\") pod \"maas-controller-dd68cb575-9lpm4\" (UID: \"01c518a3-3433-4487-a42f-29b868e43b4d\") " pod="opendatahub/maas-controller-dd68cb575-9lpm4"
Jul 10 02:35:15.403644 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.403560    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01c518a3-3433-4487-a42f-29b868e43b4d-webhook-cert\") pod \"maas-controller-dd68cb575-9lpm4\" (UID: \"01c518a3-3433-4487-a42f-29b868e43b4d\") " pod="opendatahub/maas-controller-dd68cb575-9lpm4"
Jul 10 02:35:15.504143 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.504105    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01c518a3-3433-4487-a42f-29b868e43b4d-webhook-cert\") pod \"maas-controller-dd68cb575-9lpm4\" (UID: \"01c518a3-3433-4487-a42f-29b868e43b4d\") " pod="opendatahub/maas-controller-dd68cb575-9lpm4"
Jul 10 02:35:15.504337 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.504197    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbn7r\" (UniqueName: \"kubernetes.io/projected/01c518a3-3433-4487-a42f-29b868e43b4d-kube-api-access-mbn7r\") pod \"maas-controller-dd68cb575-9lpm4\" (UID: \"01c518a3-3433-4487-a42f-29b868e43b4d\") " pod="opendatahub/maas-controller-dd68cb575-9lpm4"
Jul 10 02:35:15.506704 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.506674    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01c518a3-3433-4487-a42f-29b868e43b4d-webhook-cert\") pod \"maas-controller-dd68cb575-9lpm4\" (UID: \"01c518a3-3433-4487-a42f-29b868e43b4d\") " pod="opendatahub/maas-controller-dd68cb575-9lpm4"
Jul 10 02:35:15.514325 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.514272    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbn7r\" (UniqueName: \"kubernetes.io/projected/01c518a3-3433-4487-a42f-29b868e43b4d-kube-api-access-mbn7r\") pod \"maas-controller-dd68cb575-9lpm4\" (UID: \"01c518a3-3433-4487-a42f-29b868e43b4d\") " pod="opendatahub/maas-controller-dd68cb575-9lpm4"
Jul 10 02:35:15.693382 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.693337    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dd68cb575-9lpm4"
Jul 10 02:35:15.842924 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.842896    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dd68cb575-9lpm4"]
Jul 10 02:35:15.844944 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:35:15.844913    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c518a3_3433_4487_a42f_29b868e43b4d.slice/crio-bf57e8044555bef0b99bfbc9974c785b84d4a57b68454e9dd3967a40305a9fd5 WatchSource:0}: Error finding container bf57e8044555bef0b99bfbc9974c785b84d4a57b68454e9dd3967a40305a9fd5: Status 404 returned error can't find the container with id bf57e8044555bef0b99bfbc9974c785b84d4a57b68454e9dd3967a40305a9fd5
Jul 10 02:35:15.846289 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:15.846268    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 02:35:16.011657 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:16.011622    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9710a18-3c20-45b4-be32-0ac2ac1ee753" path="/var/lib/kubelet/pods/e9710a18-3c20-45b4-be32-0ac2ac1ee753/volumes"
Jul 10 02:35:16.597902 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:16.597786    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd68cb575-9lpm4" event={"ID":"01c518a3-3433-4487-a42f-29b868e43b4d","Type":"ContainerStarted","Data":"c53e2ba4c3aacbdc9edd0331a201f120b2ce9c77c8fde3e7d91d06ee7d08b945"}
Jul 10 02:35:16.597902 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:16.597857    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dd68cb575-9lpm4" event={"ID":"01c518a3-3433-4487-a42f-29b868e43b4d","Type":"ContainerStarted","Data":"bf57e8044555bef0b99bfbc9974c785b84d4a57b68454e9dd3967a40305a9fd5"}
Jul 10 02:35:16.598164 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:16.598011    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dd68cb575-9lpm4"
Jul 10 02:35:16.619019 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:16.618936    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dd68cb575-9lpm4" podStartSLOduration=1.128616174 podStartE2EDuration="1.618917357s" totalImagesPullingTime="490.301183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:35:16.617603883 +0000 UTC m=+749.138582192" watchObservedRunningTime="2026-07-10 02:35:16.618917357 +0000 UTC m=+749.139895666"
Jul 10 02:35:27.608316 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:27.608277    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dd68cb575-9lpm4"
Jul 10 02:35:55.996817 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:55.996779    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:35:56.093070 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:56.093034    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:35:56.194477 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:35:56.194443    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:36:01.990085 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:36:01.990049    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:36:02.091920 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:36:02.091886    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:36:02.188805 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:36:02.188772    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:36:02.318041 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:36:02.318006    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:36:08.112272 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:36:08.112207    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:36:08.185904 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:36:08.185859    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:37:46.217976 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:37:46.217874    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:37:46.306433 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:37:46.306403    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:37:47.976537 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:37:47.976506    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:37:47.977825 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:37:47.977805    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:38:05.407273 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:38:05.407237    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:39:29.219025 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:39:29.218866    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:39:29.317356 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:39:29.317318    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:40:52.595801 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:40:52.595702    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:40:52.696150 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:40:52.696118    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:41:00.866283 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:41:00.866250    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:42:48.011241 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:42:48.011195    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:42:48.012628 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:42:48.012605    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:45:50.526540 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:45:50.526503    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:25.239239 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:25.239194    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:32.634100 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:32.634068    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:40.884955 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:40.884872    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:45.958957 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:45.958922    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:48.691914 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:48.691862    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:48.792990 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:48.792926    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:49.153472 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:49.153427    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:54.950301 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:54.950254    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:55.038106 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:55.038068    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:55.183486 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:55.183452    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:55.278925 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:55.278839    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:56.355037 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.354999    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:56.428123 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.428090    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"]
Jul 10 02:46:56.431708 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.431688    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:46:56.434560 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.434538    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-91f589dd-serving-cert\""
Jul 10 02:46:56.445321 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.445298    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"]
Jul 10 02:46:56.451223 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.451199    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:56.537388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.537357    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:56.556149 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.556117    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sctpr\" (UniqueName: \"kubernetes.io/projected/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-kube-api-access-sctpr\") pod \"maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r\" (UID: \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:46:56.556329 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.556172    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-openshift-service-ca\") pod \"maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r\" (UID: \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:46:56.556387 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.556321    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-maas-api-tls\") pod \"maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r\" (UID: \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:46:56.644660 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.644535    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:56.657379 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.657347    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-maas-api-tls\") pod \"maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r\" (UID: \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:46:56.657561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.657387    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sctpr\" (UniqueName: \"kubernetes.io/projected/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-kube-api-access-sctpr\") pod \"maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r\" (UID: \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:46:56.657561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.657419    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-openshift-service-ca\") pod \"maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r\" (UID: \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:46:56.658209 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.658176    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-openshift-service-ca\") pod \"maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r\" (UID: \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:46:56.659872 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.659854    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-maas-api-tls\") pod \"maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r\" (UID: \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:46:56.667715 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.667689    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sctpr\" (UniqueName: \"kubernetes.io/projected/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-kube-api-access-sctpr\") pod \"maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r\" (UID: \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:46:56.742327 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.742291    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:46:56.885873 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.885846    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"]
Jul 10 02:46:56.887734 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:46:56.887705    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f5ebbf6_146c_40e8_baae_e7b7e2166f67.slice/crio-4ef6c851e83c9f453cd3588b55ad6c3974efe743ebcfea40b4e117b45adb3317 WatchSource:0}: Error finding container 4ef6c851e83c9f453cd3588b55ad6c3974efe743ebcfea40b4e117b45adb3317: Status 404 returned error can't find the container with id 4ef6c851e83c9f453cd3588b55ad6c3974efe743ebcfea40b4e117b45adb3317
Jul 10 02:46:56.889007 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:56.888958    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 02:46:57.002501 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:57.002409    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r" event={"ID":"5f5ebbf6-146c-40e8-baae-e7b7e2166f67","Type":"ContainerStarted","Data":"4ef6c851e83c9f453cd3588b55ad6c3974efe743ebcfea40b4e117b45adb3317"}
Jul 10 02:46:57.105264 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:57.105217    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:57.206095 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:57.206065    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:58.009477 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:58.009442    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r" event={"ID":"5f5ebbf6-146c-40e8-baae-e7b7e2166f67","Type":"ContainerStarted","Data":"1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4"}
Jul 10 02:46:58.040556 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:58.040503    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r" podStartSLOduration=1.5382764899999999 podStartE2EDuration="2.04048527s" totalImagesPullingTime="502.20878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:46:58.037793083 +0000 UTC m=+1450.558771392" watchObservedRunningTime="2026-07-10 02:46:58.04048527 +0000 UTC m=+1450.561463578"
Jul 10 02:46:58.595221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:58.595189    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:46:59.013660 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:46:59.013577    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:47:01.352150 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:01.352117    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:01.536054 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:01.536020    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:01.635748 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:01.635657    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:01.738407 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:01.738376    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"]
Jul 10 02:47:01.738582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:01.738559    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r" podUID="5f5ebbf6-146c-40e8-baae-e7b7e2166f67" containerName="maas-api" containerID="cri-o://1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4" gracePeriod=30
Jul 10 02:47:01.767811 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:01.767779    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:01.990387 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:01.990360    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:47:02.031070 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.031032    2553 generic.go:356] "Generic (PLEG): container finished" podID="5f5ebbf6-146c-40e8-baae-e7b7e2166f67" containerID="1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4" exitCode=0
Jul 10 02:47:02.031241 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.031088    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"
Jul 10 02:47:02.031241 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.031114    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r" event={"ID":"5f5ebbf6-146c-40e8-baae-e7b7e2166f67","Type":"ContainerDied","Data":"1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4"}
Jul 10 02:47:02.031241 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.031174    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r" event={"ID":"5f5ebbf6-146c-40e8-baae-e7b7e2166f67","Type":"ContainerDied","Data":"4ef6c851e83c9f453cd3588b55ad6c3974efe743ebcfea40b4e117b45adb3317"}
Jul 10 02:47:02.031241 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.031202    2553 scope.go:117] "RemoveContainer" containerID="1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4"
Jul 10 02:47:02.040283 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.040261    2553 scope.go:117] "RemoveContainer" containerID="1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4"
Jul 10 02:47:02.040616 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:47:02.040595    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4\": container with ID starting with 1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4 not found: ID does not exist" containerID="1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4"
Jul 10 02:47:02.040674 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.040628    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4"} err="failed to get container status \"1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4\": rpc error: code = NotFound desc = could not find container \"1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4\": container with ID starting with 1284ffdc84d6d16e38b71bf2c5d735af00dba3fbb55f63db50919f9214d16ea4 not found: ID does not exist"
Jul 10 02:47:02.109081 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.109043    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sctpr\" (UniqueName: \"kubernetes.io/projected/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-kube-api-access-sctpr\") pod \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\" (UID: \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\") "
Jul 10 02:47:02.109283 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.109121    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-openshift-service-ca\") pod \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\" (UID: \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\") "
Jul 10 02:47:02.109283 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.109144    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-maas-api-tls\") pod \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\" (UID: \"5f5ebbf6-146c-40e8-baae-e7b7e2166f67\") "
Jul 10 02:47:02.109503 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.109475    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5f5ebbf6-146c-40e8-baae-e7b7e2166f67" (UID: "5f5ebbf6-146c-40e8-baae-e7b7e2166f67"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:47:02.111424 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.111385    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5f5ebbf6-146c-40e8-baae-e7b7e2166f67" (UID: "5f5ebbf6-146c-40e8-baae-e7b7e2166f67"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:47:02.111531 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.111446    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-kube-api-access-sctpr" (OuterVolumeSpecName: "kube-api-access-sctpr") pod "5f5ebbf6-146c-40e8-baae-e7b7e2166f67" (UID: "5f5ebbf6-146c-40e8-baae-e7b7e2166f67"). InnerVolumeSpecName "kube-api-access-sctpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:47:02.210092 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.209993    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-maas-api-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:47:02.210092 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.210028    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sctpr\" (UniqueName: \"kubernetes.io/projected/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-kube-api-access-sctpr\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:47:02.210092 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.210042    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5f5ebbf6-146c-40e8-baae-e7b7e2166f67-openshift-service-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:47:02.354000 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.353952    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"]
Jul 10 02:47:02.357919 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:02.357888    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-91f589dd-64f6cfdbf-lg98r"]
Jul 10 02:47:04.008627 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:04.008589    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f5ebbf6-146c-40e8-baae-e7b7e2166f67" path="/var/lib/kubelet/pods/5f5ebbf6-146c-40e8-baae-e7b7e2166f67/volumes"
Jul 10 02:47:04.820013 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:04.819944    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:07.552551 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:07.552509    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:07.631841 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:07.631806    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:07.773776 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:07.773748    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:07.873350 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:07.873259    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:08.942189 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:08.942157    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:09.042589 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.042553    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:09.083285 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.083253    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"]
Jul 10 02:47:09.083648 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.083634    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f5ebbf6-146c-40e8-baae-e7b7e2166f67" containerName="maas-api"
Jul 10 02:47:09.083701 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.083650    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f5ebbf6-146c-40e8-baae-e7b7e2166f67" containerName="maas-api"
Jul 10 02:47:09.083736 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.083731    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f5ebbf6-146c-40e8-baae-e7b7e2166f67" containerName="maas-api"
Jul 10 02:47:09.088221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.088195    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:09.090951 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.090929    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8f3ec1ad-serving-cert\""
Jul 10 02:47:09.098577 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.098543    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"]
Jul 10 02:47:09.164269 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.164234    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:09.273573 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.273460    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8hzf\" (UniqueName: \"kubernetes.io/projected/60c8613b-76ff-49cf-90a1-da419d7915dc-kube-api-access-j8hzf\") pod \"maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw\" (UID: \"60c8613b-76ff-49cf-90a1-da419d7915dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:09.273573 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.273521    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c8613b-76ff-49cf-90a1-da419d7915dc-maas-api-tls\") pod \"maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw\" (UID: \"60c8613b-76ff-49cf-90a1-da419d7915dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:09.273573 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.273566    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c8613b-76ff-49cf-90a1-da419d7915dc-openshift-service-ca\") pod \"maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw\" (UID: \"60c8613b-76ff-49cf-90a1-da419d7915dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:09.359285 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.359240    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:09.374216 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.374178    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8hzf\" (UniqueName: \"kubernetes.io/projected/60c8613b-76ff-49cf-90a1-da419d7915dc-kube-api-access-j8hzf\") pod \"maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw\" (UID: \"60c8613b-76ff-49cf-90a1-da419d7915dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:09.374378 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.374234    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c8613b-76ff-49cf-90a1-da419d7915dc-maas-api-tls\") pod \"maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw\" (UID: \"60c8613b-76ff-49cf-90a1-da419d7915dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:09.374378 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.374257    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c8613b-76ff-49cf-90a1-da419d7915dc-openshift-service-ca\") pod \"maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw\" (UID: \"60c8613b-76ff-49cf-90a1-da419d7915dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:09.375022 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.374995    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c8613b-76ff-49cf-90a1-da419d7915dc-openshift-service-ca\") pod \"maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw\" (UID: \"60c8613b-76ff-49cf-90a1-da419d7915dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:09.376719 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.376700    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c8613b-76ff-49cf-90a1-da419d7915dc-maas-api-tls\") pod \"maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw\" (UID: \"60c8613b-76ff-49cf-90a1-da419d7915dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:09.382737 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.382712    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8hzf\" (UniqueName: \"kubernetes.io/projected/60c8613b-76ff-49cf-90a1-da419d7915dc-kube-api-access-j8hzf\") pod \"maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw\" (UID: \"60c8613b-76ff-49cf-90a1-da419d7915dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:09.400645 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.400615    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:09.543721 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.543696    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"]
Jul 10 02:47:09.545468 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:47:09.545441    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60c8613b_76ff_49cf_90a1_da419d7915dc.slice/crio-6c3a1fa1200d414e887dd258012eb2aa430d2c59465f1936eff9006a062abf48 WatchSource:0}: Error finding container 6c3a1fa1200d414e887dd258012eb2aa430d2c59465f1936eff9006a062abf48: Status 404 returned error can't find the container with id 6c3a1fa1200d414e887dd258012eb2aa430d2c59465f1936eff9006a062abf48
Jul 10 02:47:09.612133 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.612098    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:09.733414 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:09.733378    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:10.076376 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:10.076337    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw" event={"ID":"60c8613b-76ff-49cf-90a1-da419d7915dc","Type":"ContainerStarted","Data":"3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5"}
Jul 10 02:47:10.076802 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:10.076401    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw" event={"ID":"60c8613b-76ff-49cf-90a1-da419d7915dc","Type":"ContainerStarted","Data":"6c3a1fa1200d414e887dd258012eb2aa430d2c59465f1936eff9006a062abf48"}
Jul 10 02:47:10.076802 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:10.076519    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:10.096003 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:10.095752    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw" podStartSLOduration=0.754542044 podStartE2EDuration="1.095731579s" totalImagesPullingTime="341.189535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:47:10.095277169 +0000 UTC m=+1462.616255479" watchObservedRunningTime="2026-07-10 02:47:10.095731579 +0000 UTC m=+1462.616709889"
Jul 10 02:47:10.918557 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:10.918524    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:13.949330 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:13.949293    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:14.322885 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.322841    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"]
Jul 10 02:47:14.323157 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.323111    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw" podUID="60c8613b-76ff-49cf-90a1-da419d7915dc" containerName="maas-api" containerID="cri-o://3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5" gracePeriod=30
Jul 10 02:47:14.328693 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.328669    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:14.348192 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.348161    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:14.572191 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.572165    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:14.623243 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.623154    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c8613b-76ff-49cf-90a1-da419d7915dc-openshift-service-ca\") pod \"60c8613b-76ff-49cf-90a1-da419d7915dc\" (UID: \"60c8613b-76ff-49cf-90a1-da419d7915dc\") "
Jul 10 02:47:14.623243 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.623240    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8hzf\" (UniqueName: \"kubernetes.io/projected/60c8613b-76ff-49cf-90a1-da419d7915dc-kube-api-access-j8hzf\") pod \"60c8613b-76ff-49cf-90a1-da419d7915dc\" (UID: \"60c8613b-76ff-49cf-90a1-da419d7915dc\") "
Jul 10 02:47:14.623421 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.623279    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c8613b-76ff-49cf-90a1-da419d7915dc-maas-api-tls\") pod \"60c8613b-76ff-49cf-90a1-da419d7915dc\" (UID: \"60c8613b-76ff-49cf-90a1-da419d7915dc\") "
Jul 10 02:47:14.623539 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.623516    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60c8613b-76ff-49cf-90a1-da419d7915dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "60c8613b-76ff-49cf-90a1-da419d7915dc" (UID: "60c8613b-76ff-49cf-90a1-da419d7915dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:47:14.625280 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.625249    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60c8613b-76ff-49cf-90a1-da419d7915dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "60c8613b-76ff-49cf-90a1-da419d7915dc" (UID: "60c8613b-76ff-49cf-90a1-da419d7915dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:47:14.625402 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.625318    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60c8613b-76ff-49cf-90a1-da419d7915dc-kube-api-access-j8hzf" (OuterVolumeSpecName: "kube-api-access-j8hzf") pod "60c8613b-76ff-49cf-90a1-da419d7915dc" (UID: "60c8613b-76ff-49cf-90a1-da419d7915dc"). InnerVolumeSpecName "kube-api-access-j8hzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:47:14.724785 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.724746    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8hzf\" (UniqueName: \"kubernetes.io/projected/60c8613b-76ff-49cf-90a1-da419d7915dc-kube-api-access-j8hzf\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:47:14.724785 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.724779    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60c8613b-76ff-49cf-90a1-da419d7915dc-maas-api-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:47:14.724785 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:14.724789    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60c8613b-76ff-49cf-90a1-da419d7915dc-openshift-service-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:47:15.103464 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:15.103426    2553 generic.go:356] "Generic (PLEG): container finished" podID="60c8613b-76ff-49cf-90a1-da419d7915dc" containerID="3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5" exitCode=0
Jul 10 02:47:15.103924 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:15.103478    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"
Jul 10 02:47:15.103924 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:15.103515    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw" event={"ID":"60c8613b-76ff-49cf-90a1-da419d7915dc","Type":"ContainerDied","Data":"3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5"}
Jul 10 02:47:15.103924 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:15.103584    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw" event={"ID":"60c8613b-76ff-49cf-90a1-da419d7915dc","Type":"ContainerDied","Data":"6c3a1fa1200d414e887dd258012eb2aa430d2c59465f1936eff9006a062abf48"}
Jul 10 02:47:15.103924 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:15.103620    2553 scope.go:117] "RemoveContainer" containerID="3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5"
Jul 10 02:47:15.113532 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:15.113512    2553 scope.go:117] "RemoveContainer" containerID="3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5"
Jul 10 02:47:15.113829 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:47:15.113803    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5\": container with ID starting with 3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5 not found: ID does not exist" containerID="3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5"
Jul 10 02:47:15.113876 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:15.113836    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5"} err="failed to get container status \"3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5\": rpc error: code = NotFound desc = could not find container \"3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5\": container with ID starting with 3532dbf95a41f7069fec51c553cc45b5b52a6f39e98be38d69446f7bdbc2a7d5 not found: ID does not exist"
Jul 10 02:47:15.129219 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:15.129176    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"]
Jul 10 02:47:15.131096 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:15.131067    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8f3ec1ad-99b46d9cb-qm7nw"]
Jul 10 02:47:16.011468 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:16.011431    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60c8613b-76ff-49cf-90a1-da419d7915dc" path="/var/lib/kubelet/pods/60c8613b-76ff-49cf-90a1-da419d7915dc/volumes"
Jul 10 02:47:20.025463 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:20.025430    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:20.111170 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:20.111134    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:22.237538 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:22.237500    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:25.903268 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:25.903233    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:25.971373 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:25.971338    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:26.126136 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:26.126104    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:26.226940 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:26.226853    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:27.301893 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.301859    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:27.381759 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.381720    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"]
Jul 10 02:47:27.382216 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.382197    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60c8613b-76ff-49cf-90a1-da419d7915dc" containerName="maas-api"
Jul 10 02:47:27.382216 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.382216    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="60c8613b-76ff-49cf-90a1-da419d7915dc" containerName="maas-api"
Jul 10 02:47:27.382398 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.382312    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="60c8613b-76ff-49cf-90a1-da419d7915dc" containerName="maas-api"
Jul 10 02:47:27.385324 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.385302    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:27.387862 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.387837    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-851fc22b-serving-cert\""
Jul 10 02:47:27.388804 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.388777    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:27.398655 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.398630    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"]
Jul 10 02:47:27.445255 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.445203    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvp4m\" (UniqueName: \"kubernetes.io/projected/5dd93e37-9389-4f0e-b443-648c8599550c-kube-api-access-lvp4m\") pod \"maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:27.445255 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.445262    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd93e37-9389-4f0e-b443-648c8599550c-openshift-service-ca\") pod \"maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:27.445516 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.445365    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd93e37-9389-4f0e-b443-648c8599550c-maas-api-tls\") pod \"maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:27.469520 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.469487    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:27.546395 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.546354    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvp4m\" (UniqueName: \"kubernetes.io/projected/5dd93e37-9389-4f0e-b443-648c8599550c-kube-api-access-lvp4m\") pod \"maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:27.546395 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.546403    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd93e37-9389-4f0e-b443-648c8599550c-openshift-service-ca\") pod \"maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:27.546649 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.546436    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd93e37-9389-4f0e-b443-648c8599550c-maas-api-tls\") pod \"maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:27.546649 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:47:27.546551    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-serving-cert: secret "maas-api-e2e-derive-851fc22b-serving-cert" not found
Jul 10 02:47:27.546649 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:47:27.546605    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5dd93e37-9389-4f0e-b443-648c8599550c-maas-api-tls podName:5dd93e37-9389-4f0e-b443-648c8599550c nodeName:}" failed. No retries permitted until 2026-07-10 02:47:28.046590199 +0000 UTC m=+1480.567568486 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5dd93e37-9389-4f0e-b443-648c8599550c-maas-api-tls") pod "maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t" (UID: "5dd93e37-9389-4f0e-b443-648c8599550c") : secret "maas-api-e2e-derive-851fc22b-serving-cert" not found
Jul 10 02:47:27.547079 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.547060    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd93e37-9389-4f0e-b443-648c8599550c-openshift-service-ca\") pod \"maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:27.559130 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.559066    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvp4m\" (UniqueName: \"kubernetes.io/projected/5dd93e37-9389-4f0e-b443-648c8599550c-kube-api-access-lvp4m\") pod \"maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:27.935697 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:27.935614    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:28.035723 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:28.035687    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:28.050756 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:28.050720    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd93e37-9389-4f0e-b443-648c8599550c-maas-api-tls\") pod \"maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:28.053195 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:28.053172    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd93e37-9389-4f0e-b443-648c8599550c-maas-api-tls\") pod \"maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:28.136312 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:28.136268    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:28.296663 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:28.296631    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:28.438009 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:28.437983    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"]
Jul 10 02:47:28.440094 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:47:28.440068    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd93e37_9389_4f0e_b443_648c8599550c.slice/crio-1c012bf252f1767037572bad82cf5d82390dfc71dad462cb544d00ae53b56321 WatchSource:0}: Error finding container 1c012bf252f1767037572bad82cf5d82390dfc71dad462cb544d00ae53b56321: Status 404 returned error can't find the container with id 1c012bf252f1767037572bad82cf5d82390dfc71dad462cb544d00ae53b56321
Jul 10 02:47:29.172277 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:29.172229    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t" event={"ID":"5dd93e37-9389-4f0e-b443-648c8599550c","Type":"ContainerStarted","Data":"752e4cf845e1c989ae5892d3d5dbd80975713fdd8c72230f9814ad0966ce9c70"}
Jul 10 02:47:29.172483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:29.172321    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:29.172483 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:29.172338    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t" event={"ID":"5dd93e37-9389-4f0e-b443-648c8599550c","Type":"ContainerStarted","Data":"1c012bf252f1767037572bad82cf5d82390dfc71dad462cb544d00ae53b56321"}
Jul 10 02:47:29.190594 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:29.190467    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t" podStartSLOduration=1.670183854 podStartE2EDuration="2.190446862s" totalImagesPullingTime="520.263008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:47:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:47:29.189811917 +0000 UTC m=+1481.710790227" watchObservedRunningTime="2026-07-10 02:47:29.190446862 +0000 UTC m=+1481.711425172"
Jul 10 02:47:29.314565 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:29.314532    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:31.630148 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:31.630116    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:31.829466 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:31.829426    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:31.928164 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:31.928031    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:31.995469 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:31.995434    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"]
Jul 10 02:47:31.995693 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:31.995666    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t" podUID="5dd93e37-9389-4f0e-b443-648c8599550c" containerName="maas-api" containerID="cri-o://752e4cf845e1c989ae5892d3d5dbd80975713fdd8c72230f9814ad0966ce9c70" gracePeriod=30
Jul 10 02:47:32.024900 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.024871    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:32.189511 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.189419    2553 generic.go:356] "Generic (PLEG): container finished" podID="5dd93e37-9389-4f0e-b443-648c8599550c" containerID="752e4cf845e1c989ae5892d3d5dbd80975713fdd8c72230f9814ad0966ce9c70" exitCode=0
Jul 10 02:47:32.189511 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.189491    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t" event={"ID":"5dd93e37-9389-4f0e-b443-648c8599550c","Type":"ContainerDied","Data":"752e4cf845e1c989ae5892d3d5dbd80975713fdd8c72230f9814ad0966ce9c70"}
Jul 10 02:47:32.249510 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.249477    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:32.390859 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.390822    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd93e37-9389-4f0e-b443-648c8599550c-maas-api-tls\") pod \"5dd93e37-9389-4f0e-b443-648c8599550c\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") "
Jul 10 02:47:32.391101 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.390889    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd93e37-9389-4f0e-b443-648c8599550c-openshift-service-ca\") pod \"5dd93e37-9389-4f0e-b443-648c8599550c\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") "
Jul 10 02:47:32.391101 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.390912    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvp4m\" (UniqueName: \"kubernetes.io/projected/5dd93e37-9389-4f0e-b443-648c8599550c-kube-api-access-lvp4m\") pod \"5dd93e37-9389-4f0e-b443-648c8599550c\" (UID: \"5dd93e37-9389-4f0e-b443-648c8599550c\") "
Jul 10 02:47:32.391294 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.391263    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dd93e37-9389-4f0e-b443-648c8599550c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5dd93e37-9389-4f0e-b443-648c8599550c" (UID: "5dd93e37-9389-4f0e-b443-648c8599550c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:47:32.393041 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.393015    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5dd93e37-9389-4f0e-b443-648c8599550c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5dd93e37-9389-4f0e-b443-648c8599550c" (UID: "5dd93e37-9389-4f0e-b443-648c8599550c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:47:32.393133 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.393107    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dd93e37-9389-4f0e-b443-648c8599550c-kube-api-access-lvp4m" (OuterVolumeSpecName: "kube-api-access-lvp4m") pod "5dd93e37-9389-4f0e-b443-648c8599550c" (UID: "5dd93e37-9389-4f0e-b443-648c8599550c"). InnerVolumeSpecName "kube-api-access-lvp4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:47:32.491813 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.491722    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5dd93e37-9389-4f0e-b443-648c8599550c-maas-api-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:47:32.491813 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.491762    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5dd93e37-9389-4f0e-b443-648c8599550c-openshift-service-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:47:32.491813 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:32.491777    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvp4m\" (UniqueName: \"kubernetes.io/projected/5dd93e37-9389-4f0e-b443-648c8599550c-kube-api-access-lvp4m\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:47:33.195475 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:33.195444    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"
Jul 10 02:47:33.195475 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:33.195457    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t" event={"ID":"5dd93e37-9389-4f0e-b443-648c8599550c","Type":"ContainerDied","Data":"1c012bf252f1767037572bad82cf5d82390dfc71dad462cb544d00ae53b56321"}
Jul 10 02:47:33.195952 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:33.195525    2553 scope.go:117] "RemoveContainer" containerID="752e4cf845e1c989ae5892d3d5dbd80975713fdd8c72230f9814ad0966ce9c70"
Jul 10 02:47:33.217131 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:33.217102    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"]
Jul 10 02:47:33.222669 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:33.222642    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-851fc22b-868b7cb9dc-xbn7t"]
Jul 10 02:47:33.324725 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:33.324673    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:34.009426 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:34.009392    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dd93e37-9389-4f0e-b443-648c8599550c" path="/var/lib/kubelet/pods/5dd93e37-9389-4f0e-b443-648c8599550c/volumes"
Jul 10 02:47:37.978946 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:37.978908    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:38.079617 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:38.079579    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:38.436182 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:38.436151    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:38.535605 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:38.535571    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:38.636351 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:38.636319    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:40.779774 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:40.779736    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:40.877183 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:40.877143    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:46.235795 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:46.235760    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:46.362222 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:46.362188    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:46.500221 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:46.500134    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:46.747031 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:46.746999    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:46.993139 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:46.993106    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:47:48.041310 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:48.041274    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:47:48.043883 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:47:48.043857    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:48:12.986008 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:12.985903    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:19.247817 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:19.247778    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:19.363492 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:19.363461    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:19.454067 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:19.454035    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:35.355225 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:35.355190    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:41.480712 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:41.480675    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:41.548196 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:41.548152    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:41.635859 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:41.635825    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:41.735858 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:41.735769    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:52.206707 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:52.206671    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:52.996410 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:52.996379    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:57.058264 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:57.058231    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:59.192707 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:59.192669    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:59.300249 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:59.300217    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:59.397344 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:59.397313    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:48:59.460917 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:48:59.460840    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:00.219634 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:00.219606    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:00.312697 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:00.312661    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:00.411231 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:00.411203    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:02.047786 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:02.047753    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:08.108050 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:08.108001    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:08.209361 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:08.209323    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:08.760953 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:08.760921    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:14.854334 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:14.854296    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:14.958529 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:14.958492    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:15.120258 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:15.120168    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:15.446440 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:15.446348    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:15.633656 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:15.633616    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:18.107250 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.107196    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:18.201913 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.201881    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:18.283306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.283264    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"]
Jul 10 02:49:18.283881 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.283860    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dd93e37-9389-4f0e-b443-648c8599550c" containerName="maas-api"
Jul 10 02:49:18.283881 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.283879    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dd93e37-9389-4f0e-b443-648c8599550c" containerName="maas-api"
Jul 10 02:49:18.284069 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.283954    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dd93e37-9389-4f0e-b443-648c8599550c" containerName="maas-api"
Jul 10 02:49:18.287453 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.287424    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:18.290120 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.290098    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a1436a69-serving-cert\""
Jul 10 02:49:18.297258 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.297222    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"]
Jul 10 02:49:18.325762 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.325725    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:18.376578 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.376482    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a292c-527b-4323-b259-987e96d25954-openshift-service-ca\") pod \"maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l\" (UID: \"841a292c-527b-4323-b259-987e96d25954\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:18.376578 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.376524    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zwhc\" (UniqueName: \"kubernetes.io/projected/841a292c-527b-4323-b259-987e96d25954-kube-api-access-8zwhc\") pod \"maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l\" (UID: \"841a292c-527b-4323-b259-987e96d25954\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:18.376773 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.376597    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a292c-527b-4323-b259-987e96d25954-maas-api-tls\") pod \"maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l\" (UID: \"841a292c-527b-4323-b259-987e96d25954\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:18.431139 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.431110    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:18.477425 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.477383    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a292c-527b-4323-b259-987e96d25954-openshift-service-ca\") pod \"maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l\" (UID: \"841a292c-527b-4323-b259-987e96d25954\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:18.477425 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.477425    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zwhc\" (UniqueName: \"kubernetes.io/projected/841a292c-527b-4323-b259-987e96d25954-kube-api-access-8zwhc\") pod \"maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l\" (UID: \"841a292c-527b-4323-b259-987e96d25954\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:18.477654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.477446    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a292c-527b-4323-b259-987e96d25954-maas-api-tls\") pod \"maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l\" (UID: \"841a292c-527b-4323-b259-987e96d25954\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:18.478172 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.478149    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a292c-527b-4323-b259-987e96d25954-openshift-service-ca\") pod \"maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l\" (UID: \"841a292c-527b-4323-b259-987e96d25954\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:18.480149 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.480132    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a292c-527b-4323-b259-987e96d25954-maas-api-tls\") pod \"maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l\" (UID: \"841a292c-527b-4323-b259-987e96d25954\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:18.493220 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.493192    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zwhc\" (UniqueName: \"kubernetes.io/projected/841a292c-527b-4323-b259-987e96d25954-kube-api-access-8zwhc\") pod \"maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l\" (UID: \"841a292c-527b-4323-b259-987e96d25954\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:18.599420 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.599379    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:18.745085 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.745057    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"]
Jul 10 02:49:18.750312 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:49:18.750277    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841a292c_527b_4323_b259_987e96d25954.slice/crio-21efeb931137a584e95a62ed7ba16f5b9ef49970e80b5544bc681b64c9972458 WatchSource:0}: Error finding container 21efeb931137a584e95a62ed7ba16f5b9ef49970e80b5544bc681b64c9972458: Status 404 returned error can't find the container with id 21efeb931137a584e95a62ed7ba16f5b9ef49970e80b5544bc681b64c9972458
Jul 10 02:49:18.815167 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.815127    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:18.915851 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:18.915711    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:19.705696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:19.705660    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l" event={"ID":"841a292c-527b-4323-b259-987e96d25954","Type":"ContainerStarted","Data":"4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179"}
Jul 10 02:49:19.706165 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:19.705735    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:19.706165 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:19.705759    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l" event={"ID":"841a292c-527b-4323-b259-987e96d25954","Type":"ContainerStarted","Data":"21efeb931137a584e95a62ed7ba16f5b9ef49970e80b5544bc681b64c9972458"}
Jul 10 02:49:19.725236 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:19.725184    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l" podStartSLOduration=1.317558574 podStartE2EDuration="1.725167975s" totalImagesPullingTime="407.609401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:49:19.724138525 +0000 UTC m=+1592.245116882" watchObservedRunningTime="2026-07-10 02:49:19.725167975 +0000 UTC m=+1592.246146283"
Jul 10 02:49:22.569812 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:22.569779    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:23.214711 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:23.214634    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:23.308206 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:23.308169    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:23.612156 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:23.612123    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:25.717064 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:25.716979    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:29.445352 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:29.445316    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:29.522510 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:29.522474    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:29.843094 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:29.843059    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:30.292222 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.292192    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:30.347429 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.347383    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"]
Jul 10 02:49:30.347670 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.347642    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l" podUID="841a292c-527b-4323-b259-987e96d25954" containerName="maas-api" containerID="cri-o://4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179" gracePeriod=30
Jul 10 02:49:30.393187 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.393152    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:30.602318 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.602289    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:30.692255 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.692216    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a292c-527b-4323-b259-987e96d25954-openshift-service-ca\") pod \"841a292c-527b-4323-b259-987e96d25954\" (UID: \"841a292c-527b-4323-b259-987e96d25954\") "
Jul 10 02:49:30.692438 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.692327    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zwhc\" (UniqueName: \"kubernetes.io/projected/841a292c-527b-4323-b259-987e96d25954-kube-api-access-8zwhc\") pod \"841a292c-527b-4323-b259-987e96d25954\" (UID: \"841a292c-527b-4323-b259-987e96d25954\") "
Jul 10 02:49:30.692438 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.692396    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a292c-527b-4323-b259-987e96d25954-maas-api-tls\") pod \"841a292c-527b-4323-b259-987e96d25954\" (UID: \"841a292c-527b-4323-b259-987e96d25954\") "
Jul 10 02:49:30.692602 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.692576    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841a292c-527b-4323-b259-987e96d25954-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "841a292c-527b-4323-b259-987e96d25954" (UID: "841a292c-527b-4323-b259-987e96d25954"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:49:30.692696 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.692677    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a292c-527b-4323-b259-987e96d25954-openshift-service-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:49:30.694569 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.694543    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841a292c-527b-4323-b259-987e96d25954-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "841a292c-527b-4323-b259-987e96d25954" (UID: "841a292c-527b-4323-b259-987e96d25954"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:49:30.694638 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.694582    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/841a292c-527b-4323-b259-987e96d25954-kube-api-access-8zwhc" (OuterVolumeSpecName: "kube-api-access-8zwhc") pod "841a292c-527b-4323-b259-987e96d25954" (UID: "841a292c-527b-4323-b259-987e96d25954"). InnerVolumeSpecName "kube-api-access-8zwhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:49:30.760855 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.760820    2553 generic.go:356] "Generic (PLEG): container finished" podID="841a292c-527b-4323-b259-987e96d25954" containerID="4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179" exitCode=0
Jul 10 02:49:30.761048 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.760866    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"
Jul 10 02:49:30.761048 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.760906    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l" event={"ID":"841a292c-527b-4323-b259-987e96d25954","Type":"ContainerDied","Data":"4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179"}
Jul 10 02:49:30.761048 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.760980    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l" event={"ID":"841a292c-527b-4323-b259-987e96d25954","Type":"ContainerDied","Data":"21efeb931137a584e95a62ed7ba16f5b9ef49970e80b5544bc681b64c9972458"}
Jul 10 02:49:30.761048 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.761011    2553 scope.go:117] "RemoveContainer" containerID="4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179"
Jul 10 02:49:30.771144 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.771125    2553 scope.go:117] "RemoveContainer" containerID="4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179"
Jul 10 02:49:30.771453 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:49:30.771433    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179\": container with ID starting with 4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179 not found: ID does not exist" containerID="4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179"
Jul 10 02:49:30.771524 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.771462    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179"} err="failed to get container status \"4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179\": rpc error: code = NotFound desc = could not find container \"4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179\": container with ID starting with 4f69fbea5b6cab36c792a10962b0473ad128da0ae1f966a86c59ffc6bca7f179 not found: ID does not exist"
Jul 10 02:49:30.790020 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.789993    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"]
Jul 10 02:49:30.793314 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.793288    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zwhc\" (UniqueName: \"kubernetes.io/projected/841a292c-527b-4323-b259-987e96d25954-kube-api-access-8zwhc\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:49:30.793314 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.793313    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a292c-527b-4323-b259-987e96d25954-maas-api-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:49:30.796184 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:30.796120    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a1436a69-6bcdfbf5dc-vf79l"]
Jul 10 02:49:32.008913 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:32.008876    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="841a292c-527b-4323-b259-987e96d25954" path="/var/lib/kubelet/pods/841a292c-527b-4323-b259-987e96d25954/volumes"
Jul 10 02:49:36.237650 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:36.237614    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:36.307715 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:36.307660    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:36.518609 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:36.518515    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:36.724021 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:36.723990    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:36.884285 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:36.884251    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:37.053253 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:37.053215    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:37.154199 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:37.154082    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:42.838397 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:42.838290    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:42.905654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:42.905621    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:43.016092 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:43.016051    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:43.116305 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:43.116218    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:43.214309 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:43.214264    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:48.951902 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:48.951862    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:49.028009 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:49.027950    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:53.602241 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:53.602203    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:55.754953 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:55.754918    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:56.120264 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:56.120228    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:56.477861 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:56.477777    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:59.239406 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.239372    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:59.308848 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.308812    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"]
Jul 10 02:49:59.309327 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.309307    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841a292c-527b-4323-b259-987e96d25954" containerName="maas-api"
Jul 10 02:49:59.309431 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.309329    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="841a292c-527b-4323-b259-987e96d25954" containerName="maas-api"
Jul 10 02:49:59.309489 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.309428    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="841a292c-527b-4323-b259-987e96d25954" containerName="maas-api"
Jul 10 02:49:59.312694 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.312672    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:49:59.315234 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.315201    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-dc829df0-serving-cert\""
Jul 10 02:49:59.327814 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.327783    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"]
Jul 10 02:49:59.332073 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.332043    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:59.366603 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.366566    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9667504-f632-4853-8a88-179e619878de-maas-api-tls\") pod \"maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:49:59.366787 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.366615    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9667504-f632-4853-8a88-179e619878de-openshift-service-ca\") pod \"maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:49:59.366787 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.366698    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnp47\" (UniqueName: \"kubernetes.io/projected/e9667504-f632-4853-8a88-179e619878de-kube-api-access-dnp47\") pod \"maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:49:59.466313 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.466282    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:59.467341 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.467303    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnp47\" (UniqueName: \"kubernetes.io/projected/e9667504-f632-4853-8a88-179e619878de-kube-api-access-dnp47\") pod \"maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:49:59.467444 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.467364    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9667504-f632-4853-8a88-179e619878de-maas-api-tls\") pod \"maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:49:59.467444 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.467400    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9667504-f632-4853-8a88-179e619878de-openshift-service-ca\") pod \"maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:49:59.467559 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:49:59.467502    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-serving-cert: secret "maas-api-e2e-mt-dc829df0-serving-cert" not found
Jul 10 02:49:59.467559 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:49:59.467558    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9667504-f632-4853-8a88-179e619878de-maas-api-tls podName:e9667504-f632-4853-8a88-179e619878de nodeName:}" failed. No retries permitted until 2026-07-10 02:49:59.967543764 +0000 UTC m=+1632.488522051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e9667504-f632-4853-8a88-179e619878de-maas-api-tls") pod "maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr" (UID: "e9667504-f632-4853-8a88-179e619878de") : secret "maas-api-e2e-mt-dc829df0-serving-cert" not found
Jul 10 02:49:59.468065 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.468048    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9667504-f632-4853-8a88-179e619878de-openshift-service-ca\") pod \"maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:49:59.487534 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.487503    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnp47\" (UniqueName: \"kubernetes.io/projected/e9667504-f632-4853-8a88-179e619878de-kube-api-access-dnp47\") pod \"maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:49:59.688329 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.688285    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:59.891816 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.891770    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:49:59.972308 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.972204    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9667504-f632-4853-8a88-179e619878de-maas-api-tls\") pod \"maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:49:59.974755 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.974731    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9667504-f632-4853-8a88-179e619878de-maas-api-tls\") pod \"maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:49:59.993326 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:49:59.993295    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:00.223321 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:00.223228    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:50:00.366711 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:00.366677    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"]
Jul 10 02:50:00.367841 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:50:00.367813    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9667504_f632_4853_8a88_179e619878de.slice/crio-b28f7c32c6038b8a349729d4d1181590f559c61770dfe07707a188e1cb3164a9 WatchSource:0}: Error finding container b28f7c32c6038b8a349729d4d1181590f559c61770dfe07707a188e1cb3164a9: Status 404 returned error can't find the container with id b28f7c32c6038b8a349729d4d1181590f559c61770dfe07707a188e1cb3164a9
Jul 10 02:50:00.913195 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:00.913160    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr" event={"ID":"e9667504-f632-4853-8a88-179e619878de","Type":"ContainerStarted","Data":"073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c"}
Jul 10 02:50:00.913376 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:00.913220    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr" event={"ID":"e9667504-f632-4853-8a88-179e619878de","Type":"ContainerStarted","Data":"b28f7c32c6038b8a349729d4d1181590f559c61770dfe07707a188e1cb3164a9"}
Jul 10 02:50:00.913440 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:00.913373    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:50:00.932443 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:00.932379    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr" podStartSLOduration=1.469845793 podStartE2EDuration="1.932355045s" totalImagesPullingTime="462.509252ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:50:00.931678874 +0000 UTC m=+1633.452657183" watchObservedRunningTime="2026-07-10 02:50:00.932355045 +0000 UTC m=+1633.453333355"
Jul 10 02:50:03.694122 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:03.694085    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:05.114536 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:05.114482    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:06.923327 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:06.923291    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:50:11.869654 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:11.869616    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:11.931042 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:11.930946    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:26.855561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:26.855521    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:37.339263 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:37.339209    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:37.440187 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:37.440120    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:46.480584 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:46.480549    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:47.093751 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.093717    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:47.225740 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.225705    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:47.394672 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.394592    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"]
Jul 10 02:50:47.394825 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.394793    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr" podUID="e9667504-f632-4853-8a88-179e619878de" containerName="maas-api" containerID="cri-o://073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c" gracePeriod=30
Jul 10 02:50:47.436121 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.436080    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:47.647661 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.647589    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:50:47.739250 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.739214    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnp47\" (UniqueName: \"kubernetes.io/projected/e9667504-f632-4853-8a88-179e619878de-kube-api-access-dnp47\") pod \"e9667504-f632-4853-8a88-179e619878de\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") "
Jul 10 02:50:47.739464 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.739288    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9667504-f632-4853-8a88-179e619878de-maas-api-tls\") pod \"e9667504-f632-4853-8a88-179e619878de\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") "
Jul 10 02:50:47.739464 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.739323    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9667504-f632-4853-8a88-179e619878de-openshift-service-ca\") pod \"e9667504-f632-4853-8a88-179e619878de\" (UID: \"e9667504-f632-4853-8a88-179e619878de\") "
Jul 10 02:50:47.739715 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.739692    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9667504-f632-4853-8a88-179e619878de-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e9667504-f632-4853-8a88-179e619878de" (UID: "e9667504-f632-4853-8a88-179e619878de"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:50:47.741476 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.741452    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9667504-f632-4853-8a88-179e619878de-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e9667504-f632-4853-8a88-179e619878de" (UID: "e9667504-f632-4853-8a88-179e619878de"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:50:47.741606 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.741581    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9667504-f632-4853-8a88-179e619878de-kube-api-access-dnp47" (OuterVolumeSpecName: "kube-api-access-dnp47") pod "e9667504-f632-4853-8a88-179e619878de" (UID: "e9667504-f632-4853-8a88-179e619878de"). InnerVolumeSpecName "kube-api-access-dnp47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:50:47.840437 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.840402    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e9667504-f632-4853-8a88-179e619878de-maas-api-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:50:47.840437 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.840435    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9667504-f632-4853-8a88-179e619878de-openshift-service-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:50:47.840645 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:47.840453    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnp47\" (UniqueName: \"kubernetes.io/projected/e9667504-f632-4853-8a88-179e619878de-kube-api-access-dnp47\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:50:48.142013 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:48.141958    2553 generic.go:356] "Generic (PLEG): container finished" podID="e9667504-f632-4853-8a88-179e619878de" containerID="073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c" exitCode=0
Jul 10 02:50:48.142013 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:48.142004    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr" event={"ID":"e9667504-f632-4853-8a88-179e619878de","Type":"ContainerDied","Data":"073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c"}
Jul 10 02:50:48.142245 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:48.142030    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"
Jul 10 02:50:48.142245 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:48.142076    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr" event={"ID":"e9667504-f632-4853-8a88-179e619878de","Type":"ContainerDied","Data":"b28f7c32c6038b8a349729d4d1181590f559c61770dfe07707a188e1cb3164a9"}
Jul 10 02:50:48.142245 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:48.142109    2553 scope.go:117] "RemoveContainer" containerID="073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c"
Jul 10 02:50:48.151410 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:48.151392    2553 scope.go:117] "RemoveContainer" containerID="073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c"
Jul 10 02:50:48.151687 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:50:48.151656    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c\": container with ID starting with 073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c not found: ID does not exist" containerID="073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c"
Jul 10 02:50:48.151764 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:48.151690    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c"} err="failed to get container status \"073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c\": rpc error: code = NotFound desc = could not find container \"073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c\": container with ID starting with 073dbdd6fc59eec4a3fb8c4e752d4809552c55e12f2d95359c1277ed6c0f500c not found: ID does not exist"
Jul 10 02:50:48.163420 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:48.163384    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"]
Jul 10 02:50:48.166892 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:48.166865    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-dc829df0-659bd9c598-bd7gr"]
Jul 10 02:50:50.009790 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:50.009758    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9667504-f632-4853-8a88-179e619878de" path="/var/lib/kubelet/pods/e9667504-f632-4853-8a88-179e619878de/volumes"
Jul 10 02:50:52.492087 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:52.492056    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:50:57.517879 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:50:57.517843    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:34.315317 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:34.315277    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:34.756687 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:34.756581    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:40.242074 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:40.242029    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:45.860675 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:45.860615    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:45.934102 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:45.934072    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:46.149429 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:46.149345    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:46.393135 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:46.393098    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:47.429045 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:47.429018    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:47.529459 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:47.529421    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:47.631123 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:47.631092    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:48.351077 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:48.351045    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:48.444832 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:48.444751    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:48.544449 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:48.544415    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:49.953031 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:49.952945    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:56.230353 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:56.230302    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:56.331392 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:56.331359    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:51:56.904894 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:51:56.904863    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:03.195886 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:03.195853    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:03.304684 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:03.304650    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:03.396459 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:03.396421    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:13.874188 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:13.874143    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:14.211252 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:14.211148    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:35.136724 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:35.136658    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:40.960054 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:40.959950    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:41.020617 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:41.020584    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:41.323212 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:41.323181    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:41.593889 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:41.593807    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:41.913178 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:41.913094    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:45.072768 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.072737    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:45.167363 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.167330    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:45.280214 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.280178    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"]
Jul 10 02:52:45.280841 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.280817    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9667504-f632-4853-8a88-179e619878de" containerName="maas-api"
Jul 10 02:52:45.280923 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.280843    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9667504-f632-4853-8a88-179e619878de" containerName="maas-api"
Jul 10 02:52:45.280976 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.280944    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9667504-f632-4853-8a88-179e619878de" containerName="maas-api"
Jul 10 02:52:45.284699 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.284676    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:45.287345 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.287320    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-829dac-serving-cert\""
Jul 10 02:52:45.294798 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.294769    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"]
Jul 10 02:52:45.314687 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.314651    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:45.321843 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.321811    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-829dac-784d87997f-ksdlx\" (UID: \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:45.322038 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.321886    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2x56\" (UniqueName: \"kubernetes.io/projected/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-kube-api-access-k2x56\") pod \"maas-api-e2e-inf-a-829dac-784d87997f-ksdlx\" (UID: \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:45.322038 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.321931    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-maas-api-tls\") pod \"maas-api-e2e-inf-a-829dac-784d87997f-ksdlx\" (UID: \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:45.422475 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.422387    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2x56\" (UniqueName: \"kubernetes.io/projected/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-kube-api-access-k2x56\") pod \"maas-api-e2e-inf-a-829dac-784d87997f-ksdlx\" (UID: \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:45.422475 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.422430    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-maas-api-tls\") pod \"maas-api-e2e-inf-a-829dac-784d87997f-ksdlx\" (UID: \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:45.422708 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.422514    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-829dac-784d87997f-ksdlx\" (UID: \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:45.423242 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.423222    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-openshift-service-ca\") pod \"maas-api-e2e-inf-a-829dac-784d87997f-ksdlx\" (UID: \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:45.424866 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.424848    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-maas-api-tls\") pod \"maas-api-e2e-inf-a-829dac-784d87997f-ksdlx\" (UID: \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:45.430220 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.430200    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2x56\" (UniqueName: \"kubernetes.io/projected/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-kube-api-access-k2x56\") pod \"maas-api-e2e-inf-a-829dac-784d87997f-ksdlx\" (UID: \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:45.457187 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.457149    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:45.597207 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.597176    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:45.743271 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.743248    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"]
Jul 10 02:52:45.745877 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:52:45.745836    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5cae2e9_14fd_4c34_a3ab_39335a036ebd.slice/crio-73b126b04cd308a261fe327078921a6f93cd1a902aaa4ba272d3ddf9e71614cb WatchSource:0}: Error finding container 73b126b04cd308a261fe327078921a6f93cd1a902aaa4ba272d3ddf9e71614cb: Status 404 returned error can't find the container with id 73b126b04cd308a261fe327078921a6f93cd1a902aaa4ba272d3ddf9e71614cb
Jul 10 02:52:45.747651 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.747635    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 02:52:45.849396 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.849367    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:45.951427 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:45.951349    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:46.710625 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:46.710594    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx" event={"ID":"d5cae2e9-14fd-4c34-a3ab-39335a036ebd","Type":"ContainerStarted","Data":"4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28"}
Jul 10 02:52:46.711072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:46.710644    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx" event={"ID":"d5cae2e9-14fd-4c34-a3ab-39335a036ebd","Type":"ContainerStarted","Data":"73b126b04cd308a261fe327078921a6f93cd1a902aaa4ba272d3ddf9e71614cb"}
Jul 10 02:52:46.711072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:46.710696    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:46.727030 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:46.726951    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx" podStartSLOduration=1.206006645 podStartE2EDuration="1.726935475s" totalImagesPullingTime="520.92883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:52:46.726733296 +0000 UTC m=+1799.247711608" watchObservedRunningTime="2026-07-10 02:52:46.726935475 +0000 UTC m=+1799.247913784"
Jul 10 02:52:48.072279 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:48.072242    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:52:48.075739 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:48.075717    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:52:49.477395 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:49.477360    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:49.796308 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:49.796281    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:50.095929 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:50.095819    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:50.337495 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:50.337465    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:52.724010 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:52.723980    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:52:52.996879 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:52.996745    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:53.069247 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.069206    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"]
Jul 10 02:52:53.072448 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.072422    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:53.073630 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.073609    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:53.076662 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.076642    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-1bc4ca-serving-cert\""
Jul 10 02:52:53.082800 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.082770    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"]
Jul 10 02:52:53.092102 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.092071    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7ebf26-c892-4477-b4c6-b1292d961d60-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:53.092233 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.092115    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjsxp\" (UniqueName: \"kubernetes.io/projected/8b7ebf26-c892-4477-b4c6-b1292d961d60-kube-api-access-hjsxp\") pod \"maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:53.092233 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.092185    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b7ebf26-c892-4477-b4c6-b1292d961d60-maas-api-tls\") pod \"maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:53.141850 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.141819    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:53.193245 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.193205    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7ebf26-c892-4477-b4c6-b1292d961d60-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:53.193245 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.193246    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjsxp\" (UniqueName: \"kubernetes.io/projected/8b7ebf26-c892-4477-b4c6-b1292d961d60-kube-api-access-hjsxp\") pod \"maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:53.193484 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.193278    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b7ebf26-c892-4477-b4c6-b1292d961d60-maas-api-tls\") pod \"maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:53.193484 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:52:53.193410    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-serving-cert: secret "maas-api-e2e-inf-b-1bc4ca-serving-cert" not found
Jul 10 02:52:53.193484 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:52:53.193473    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7ebf26-c892-4477-b4c6-b1292d961d60-maas-api-tls podName:8b7ebf26-c892-4477-b4c6-b1292d961d60 nodeName:}" failed. No retries permitted until 2026-07-10 02:52:53.693453321 +0000 UTC m=+1806.214431626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8b7ebf26-c892-4477-b4c6-b1292d961d60-maas-api-tls") pod "maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4" (UID: "8b7ebf26-c892-4477-b4c6-b1292d961d60") : secret "maas-api-e2e-inf-b-1bc4ca-serving-cert" not found
Jul 10 02:52:53.193932 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.193912    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7ebf26-c892-4477-b4c6-b1292d961d60-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:53.204452 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.204424    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjsxp\" (UniqueName: \"kubernetes.io/projected/8b7ebf26-c892-4477-b4c6-b1292d961d60-kube-api-access-hjsxp\") pod \"maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:53.624490 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.624458    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:53.698300 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.698262    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b7ebf26-c892-4477-b4c6-b1292d961d60-maas-api-tls\") pod \"maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:53.700798 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.700763    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b7ebf26-c892-4477-b4c6-b1292d961d60-maas-api-tls\") pod \"maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:53.725614 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.725579    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:53.826838 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.826789    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:52:53.985523 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:53.985437    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:54.129217 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:54.129191    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"]
Jul 10 02:52:54.131622 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:52:54.131588    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7ebf26_c892_4477_b4c6_b1292d961d60.slice/crio-8020a09a27f723dbf705bfc6d7f1c1e2c634dc36d6b1bf60fec3c925b13e707e WatchSource:0}: Error finding container 8020a09a27f723dbf705bfc6d7f1c1e2c634dc36d6b1bf60fec3c925b13e707e: Status 404 returned error can't find the container with id 8020a09a27f723dbf705bfc6d7f1c1e2c634dc36d6b1bf60fec3c925b13e707e
Jul 10 02:52:54.755029 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:54.754897    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4" event={"ID":"8b7ebf26-c892-4477-b4c6-b1292d961d60","Type":"ContainerStarted","Data":"c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193"}
Jul 10 02:52:54.755029 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:54.754958    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4" event={"ID":"8b7ebf26-c892-4477-b4c6-b1292d961d60","Type":"ContainerStarted","Data":"8020a09a27f723dbf705bfc6d7f1c1e2c634dc36d6b1bf60fec3c925b13e707e"}
Jul 10 02:52:54.755029 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:54.755019    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:52:54.780409 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:54.780358    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4" podStartSLOduration=1.473111587 podStartE2EDuration="1.780339968s" totalImagesPullingTime="307.228381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:52:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:52:54.778734917 +0000 UTC m=+1807.299713226" watchObservedRunningTime="2026-07-10 02:52:54.780339968 +0000 UTC m=+1807.301318278"
Jul 10 02:52:57.488904 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:52:57.488864    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:00.765204 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:00.765172    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:53:06.595601 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:06.595560    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:06.695123 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:06.695088    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:14.491152 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:14.491115    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:14.592013 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:14.591948    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:16.725649 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:16.725614    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:40.319707 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.319672    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"]
Jul 10 02:53:40.323508 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.323487    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.325899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.325870    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1bc4ca\"/\"kube-root-ca.crt\""
Jul 10 02:53:40.326065 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.325918    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1bc4ca\"/\"openshift-service-ca.crt\""
Jul 10 02:53:40.326918 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.326900    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1bc4ca\"/\"test-model-1bc4ca-kserve-self-signed-certs\""
Jul 10 02:53:40.327003 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.326927    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1bc4ca\"/\"default-dockercfg-5fqw6\""
Jul 10 02:53:40.335383 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.335357    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"]
Jul 10 02:53:40.345547 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.345518    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:53:40.449120 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.449076    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-tmp-dir\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.449304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.449187    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-dshm\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.449304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.449221    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w8gj\" (UniqueName: \"kubernetes.io/projected/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-kube-api-access-2w8gj\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.449304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.449245    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-model-cache\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.449304 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.449266    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-home\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.449448 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.449388    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-tls-certs\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.550153 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.550115    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-tls-certs\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.550328 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.550162    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-tmp-dir\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.550328 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.550235    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-dshm\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.550328 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.550261    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w8gj\" (UniqueName: \"kubernetes.io/projected/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-kube-api-access-2w8gj\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.550328 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.550287    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-model-cache\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.550328 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.550313    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-home\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.550727 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.550704    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-tmp-dir\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.550807 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.550775    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-model-cache\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.550864 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.550804    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-home\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.552578 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.552555    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-dshm\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.552863 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.552843    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-tls-certs\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.558807 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.558785    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w8gj\" (UniqueName: \"kubernetes.io/projected/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-kube-api-access-2w8gj\") pod \"test-model-1bc4ca-kserve-867854bc4f-9cp9b\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") " pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.633357 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.633256    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:40.771209 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.771180    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"]
Jul 10 02:53:40.773123 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:53:40.773093    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e6d4633_9e9f_49f6_a765_7c7a8ab7687f.slice/crio-6163eca3bfc79b60f0abedcc8549437d30e2bbc628e0c603e51292b974eabced WatchSource:0}: Error finding container 6163eca3bfc79b60f0abedcc8549437d30e2bbc628e0c603e51292b974eabced: Status 404 returned error can't find the container with id 6163eca3bfc79b60f0abedcc8549437d30e2bbc628e0c603e51292b974eabced
Jul 10 02:53:40.977273 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.977170    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b" event={"ID":"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f","Type":"ContainerStarted","Data":"fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516"}
Jul 10 02:53:40.977273 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.977210    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b" event={"ID":"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f","Type":"ContainerStarted","Data":"6163eca3bfc79b60f0abedcc8549437d30e2bbc628e0c603e51292b974eabced"}
Jul 10 02:53:40.994151 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:40.994080    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b" podStartSLOduration=0.994063126 podStartE2EDuration="994.063126ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:53:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:53:40.992207741 +0000 UTC m=+1853.513186046" watchObservedRunningTime="2026-07-10 02:53:40.994063126 +0000 UTC m=+1853.515041435"
Jul 10 02:53:50.633913 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:50.633870    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:50.634360 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:50.633933    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:50.646554 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:50.646524    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:53:51.044857 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:53:51.044828    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:54:01.517955 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:01.517912    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:02.438609 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:02.438571    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"]
Jul 10 02:54:02.460832 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:02.460768    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:02.602188 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:02.602142    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:02.988919 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:02.988884    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:03.096319 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.096268    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:03.189676 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.189639    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:03.289878 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.289256    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"]
Jul 10 02:54:03.289878 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.289562    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx" podUID="d5cae2e9-14fd-4c34-a3ab-39335a036ebd" containerName="maas-api" containerID="cri-o://4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28" gracePeriod=30
Jul 10 02:54:03.314794 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.314755    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:03.751616 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.751589    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:54:03.775412 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.775383    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2x56\" (UniqueName: \"kubernetes.io/projected/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-kube-api-access-k2x56\") pod \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\" (UID: \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\") "
Jul 10 02:54:03.775589 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.775478    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-maas-api-tls\") pod \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\" (UID: \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\") "
Jul 10 02:54:03.775589 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.775555    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-openshift-service-ca\") pod \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\" (UID: \"d5cae2e9-14fd-4c34-a3ab-39335a036ebd\") "
Jul 10 02:54:03.776011 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.775983    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d5cae2e9-14fd-4c34-a3ab-39335a036ebd" (UID: "d5cae2e9-14fd-4c34-a3ab-39335a036ebd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:54:03.777685 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.777659    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d5cae2e9-14fd-4c34-a3ab-39335a036ebd" (UID: "d5cae2e9-14fd-4c34-a3ab-39335a036ebd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:54:03.777894 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.777876    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-kube-api-access-k2x56" (OuterVolumeSpecName: "kube-api-access-k2x56") pod "d5cae2e9-14fd-4c34-a3ab-39335a036ebd" (UID: "d5cae2e9-14fd-4c34-a3ab-39335a036ebd"). InnerVolumeSpecName "kube-api-access-k2x56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:54:03.876333 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.876233    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-maas-api-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:54:03.876333 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.876262    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-openshift-service-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:54:03.876333 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:03.876272    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2x56\" (UniqueName: \"kubernetes.io/projected/d5cae2e9-14fd-4c34-a3ab-39335a036ebd-kube-api-access-k2x56\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:54:04.105471 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:04.105431    2553 generic.go:356] "Generic (PLEG): container finished" podID="d5cae2e9-14fd-4c34-a3ab-39335a036ebd" containerID="4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28" exitCode=0
Jul 10 02:54:04.105642 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:04.105479    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"
Jul 10 02:54:04.105642 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:04.105517    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx" event={"ID":"d5cae2e9-14fd-4c34-a3ab-39335a036ebd","Type":"ContainerDied","Data":"4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28"}
Jul 10 02:54:04.105642 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:04.105574    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx" event={"ID":"d5cae2e9-14fd-4c34-a3ab-39335a036ebd","Type":"ContainerDied","Data":"73b126b04cd308a261fe327078921a6f93cd1a902aaa4ba272d3ddf9e71614cb"}
Jul 10 02:54:04.105642 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:04.105603    2553 scope.go:117] "RemoveContainer" containerID="4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28"
Jul 10 02:54:04.114408 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:04.114388    2553 scope.go:117] "RemoveContainer" containerID="4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28"
Jul 10 02:54:04.114698 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:54:04.114676    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28\": container with ID starting with 4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28 not found: ID does not exist" containerID="4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28"
Jul 10 02:54:04.114783 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:04.114708    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28"} err="failed to get container status \"4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28\": rpc error: code = NotFound desc = could not find container \"4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28\": container with ID starting with 4ccdb081831a5a19b3830be1eb16dc51bfa63033c87d10a407f145433d904c28 not found: ID does not exist"
Jul 10 02:54:04.121387 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:04.121360    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"]
Jul 10 02:54:04.125432 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:04.125401    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-829dac-784d87997f-ksdlx"]
Jul 10 02:54:06.011780 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:06.011742    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5cae2e9-14fd-4c34-a3ab-39335a036ebd" path="/var/lib/kubelet/pods/d5cae2e9-14fd-4c34-a3ab-39335a036ebd/volumes"
Jul 10 02:54:08.060901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:08.060847    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:13.327746 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:13.327664    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:17.459649 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.459578    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b" podUID="1e6d4633-9e9f-49f6-a765-7c7a8ab7687f" containerName="main" containerID="cri-o://fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516" gracePeriod=45
Jul 10 02:54:17.722202 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.722134    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:54:17.807178 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.807141    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-home\") pod \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") "
Jul 10 02:54:17.807375 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.807189    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-dshm\") pod \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") "
Jul 10 02:54:17.807375 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.807241    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-model-cache\") pod \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") "
Jul 10 02:54:17.807375 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.807321    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-tls-certs\") pod \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") "
Jul 10 02:54:17.807375 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.807353    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w8gj\" (UniqueName: \"kubernetes.io/projected/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-kube-api-access-2w8gj\") pod \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") "
Jul 10 02:54:17.807593 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.807384    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-tmp-dir\") pod \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\" (UID: \"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f\") "
Jul 10 02:54:17.807593 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.807407    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-home" (OuterVolumeSpecName: "home") pod "1e6d4633-9e9f-49f6-a765-7c7a8ab7687f" (UID: "1e6d4633-9e9f-49f6-a765-7c7a8ab7687f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:54:17.807593 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.807535    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-model-cache" (OuterVolumeSpecName: "model-cache") pod "1e6d4633-9e9f-49f6-a765-7c7a8ab7687f" (UID: "1e6d4633-9e9f-49f6-a765-7c7a8ab7687f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:54:17.807743 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.807638    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1e6d4633-9e9f-49f6-a765-7c7a8ab7687f" (UID: "1e6d4633-9e9f-49f6-a765-7c7a8ab7687f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:54:17.807825 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.807806    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-model-cache\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:54:17.807879 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.807828    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-tmp-dir\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:54:17.807879 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.807837    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-home\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:54:17.809518 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.809491    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-dshm" (OuterVolumeSpecName: "dshm") pod "1e6d4633-9e9f-49f6-a765-7c7a8ab7687f" (UID: "1e6d4633-9e9f-49f6-a765-7c7a8ab7687f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:54:17.809655 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.809595    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-kube-api-access-2w8gj" (OuterVolumeSpecName: "kube-api-access-2w8gj") pod "1e6d4633-9e9f-49f6-a765-7c7a8ab7687f" (UID: "1e6d4633-9e9f-49f6-a765-7c7a8ab7687f"). InnerVolumeSpecName "kube-api-access-2w8gj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:54:17.809655 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.809615    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1e6d4633-9e9f-49f6-a765-7c7a8ab7687f" (UID: "1e6d4633-9e9f-49f6-a765-7c7a8ab7687f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:54:17.909157 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.909118    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-dshm\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:54:17.909157 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.909150    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-tls-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:54:17.909157 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:17.909161    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w8gj\" (UniqueName: \"kubernetes.io/projected/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f-kube-api-access-2w8gj\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:54:18.186489 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:18.186446    2553 generic.go:356] "Generic (PLEG): container finished" podID="1e6d4633-9e9f-49f6-a765-7c7a8ab7687f" containerID="fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516" exitCode=0
Jul 10 02:54:18.186489 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:18.186488    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"
Jul 10 02:54:18.186743 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:18.186521    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b" event={"ID":"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f","Type":"ContainerDied","Data":"fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516"}
Jul 10 02:54:18.186743 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:18.186568    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b" event={"ID":"1e6d4633-9e9f-49f6-a765-7c7a8ab7687f","Type":"ContainerDied","Data":"6163eca3bfc79b60f0abedcc8549437d30e2bbc628e0c603e51292b974eabced"}
Jul 10 02:54:18.186743 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:18.186588    2553 scope.go:117] "RemoveContainer" containerID="fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516"
Jul 10 02:54:18.196057 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:18.196038    2553 scope.go:117] "RemoveContainer" containerID="fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516"
Jul 10 02:54:18.196350 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:54:18.196326    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516\": container with ID starting with fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516 not found: ID does not exist" containerID="fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516"
Jul 10 02:54:18.196429 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:18.196361    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516"} err="failed to get container status \"fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516\": rpc error: code = NotFound desc = could not find container \"fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516\": container with ID starting with fa0500484fbc5030e990bbe35c91a2763dc764177a1b0abc2d06de87e08bb516 not found: ID does not exist"
Jul 10 02:54:18.203585 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:18.203553    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"]
Jul 10 02:54:18.205430 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:18.205408    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-1bc4ca/test-model-1bc4ca-kserve-867854bc4f-9cp9b"]
Jul 10 02:54:20.009143 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:20.009105    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e6d4633-9e9f-49f6-a765-7c7a8ab7687f" path="/var/lib/kubelet/pods/1e6d4633-9e9f-49f6-a765-7c7a8ab7687f/volumes"
Jul 10 02:54:44.657981 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:44.657940    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:44.890562 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:44.890534    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:45.161210 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:45.161175    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:45.300091 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:45.300054    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:45.696254 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:45.696205    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:45.794592 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:45.794556    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:45.894182 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:45.894149    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:46.054938 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.054905    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"]
Jul 10 02:54:46.055167 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.055143    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4" podUID="8b7ebf26-c892-4477-b4c6-b1292d961d60" containerName="maas-api" containerID="cri-o://c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193" gracePeriod=30
Jul 10 02:54:46.142909 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.142879    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:46.309030 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.308949    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:54:46.323614 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.323584    2553 generic.go:356] "Generic (PLEG): container finished" podID="8b7ebf26-c892-4477-b4c6-b1292d961d60" containerID="c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193" exitCode=0
Jul 10 02:54:46.323810 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.323628    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"
Jul 10 02:54:46.323810 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.323665    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4" event={"ID":"8b7ebf26-c892-4477-b4c6-b1292d961d60","Type":"ContainerDied","Data":"c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193"}
Jul 10 02:54:46.323810 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.323727    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4" event={"ID":"8b7ebf26-c892-4477-b4c6-b1292d961d60","Type":"ContainerDied","Data":"8020a09a27f723dbf705bfc6d7f1c1e2c634dc36d6b1bf60fec3c925b13e707e"}
Jul 10 02:54:46.323810 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.323760    2553 scope.go:117] "RemoveContainer" containerID="c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193"
Jul 10 02:54:46.332321 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.332302    2553 scope.go:117] "RemoveContainer" containerID="c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193"
Jul 10 02:54:46.332636 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:54:46.332619    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193\": container with ID starting with c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193 not found: ID does not exist" containerID="c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193"
Jul 10 02:54:46.332709 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.332647    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193"} err="failed to get container status \"c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193\": rpc error: code = NotFound desc = could not find container \"c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193\": container with ID starting with c4fdc95edc4fc5e436e61863efda3cb22e0a53bc13eac6573228328041fcc193 not found: ID does not exist"
Jul 10 02:54:46.376230 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.376192    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b7ebf26-c892-4477-b4c6-b1292d961d60-maas-api-tls\") pod \"8b7ebf26-c892-4477-b4c6-b1292d961d60\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") "
Jul 10 02:54:46.376409 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.376248    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjsxp\" (UniqueName: \"kubernetes.io/projected/8b7ebf26-c892-4477-b4c6-b1292d961d60-kube-api-access-hjsxp\") pod \"8b7ebf26-c892-4477-b4c6-b1292d961d60\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") "
Jul 10 02:54:46.376409 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.376327    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7ebf26-c892-4477-b4c6-b1292d961d60-openshift-service-ca\") pod \"8b7ebf26-c892-4477-b4c6-b1292d961d60\" (UID: \"8b7ebf26-c892-4477-b4c6-b1292d961d60\") "
Jul 10 02:54:46.376720 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.376696    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b7ebf26-c892-4477-b4c6-b1292d961d60-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8b7ebf26-c892-4477-b4c6-b1292d961d60" (UID: "8b7ebf26-c892-4477-b4c6-b1292d961d60"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:54:46.378388 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.378366    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b7ebf26-c892-4477-b4c6-b1292d961d60-kube-api-access-hjsxp" (OuterVolumeSpecName: "kube-api-access-hjsxp") pod "8b7ebf26-c892-4477-b4c6-b1292d961d60" (UID: "8b7ebf26-c892-4477-b4c6-b1292d961d60"). InnerVolumeSpecName "kube-api-access-hjsxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:54:46.378478 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.378432    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b7ebf26-c892-4477-b4c6-b1292d961d60-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8b7ebf26-c892-4477-b4c6-b1292d961d60" (UID: "8b7ebf26-c892-4477-b4c6-b1292d961d60"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:54:46.477162 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.477114    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b7ebf26-c892-4477-b4c6-b1292d961d60-maas-api-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:54:46.477162 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.477157    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjsxp\" (UniqueName: \"kubernetes.io/projected/8b7ebf26-c892-4477-b4c6-b1292d961d60-kube-api-access-hjsxp\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:54:46.477162 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.477167    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7ebf26-c892-4477-b4c6-b1292d961d60-openshift-service-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:54:46.651380 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.651191    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"]
Jul 10 02:54:46.654564 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:46.654532    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1bc4ca-699cb56899-94hz4"]
Jul 10 02:54:48.009189 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:48.009157    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b7ebf26-c892-4477-b4c6-b1292d961d60" path="/var/lib/kubelet/pods/8b7ebf26-c892-4477-b4c6-b1292d961d60/volumes"
Jul 10 02:54:51.443072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:51.443038    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:51.543605 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:51.543573    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:51.704011 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:51.703888    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:51.939429 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:51.939394    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:52.252731 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:52.252695    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:52.546890 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:52.546853    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:52.678882 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:52.678843    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:55.554454 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.554405    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:55.638271 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.638235    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:55.639292 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.639270    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"]
Jul 10 02:54:55.639767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.639747    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b7ebf26-c892-4477-b4c6-b1292d961d60" containerName="maas-api"
Jul 10 02:54:55.639767 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.639765    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b7ebf26-c892-4477-b4c6-b1292d961d60" containerName="maas-api"
Jul 10 02:54:55.639899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.639781    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e6d4633-9e9f-49f6-a765-7c7a8ab7687f" containerName="main"
Jul 10 02:54:55.639899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.639787    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e6d4633-9e9f-49f6-a765-7c7a8ab7687f" containerName="main"
Jul 10 02:54:55.639899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.639794    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5cae2e9-14fd-4c34-a3ab-39335a036ebd" containerName="maas-api"
Jul 10 02:54:55.639899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.639800    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5cae2e9-14fd-4c34-a3ab-39335a036ebd" containerName="maas-api"
Jul 10 02:54:55.639899 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.639892    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b7ebf26-c892-4477-b4c6-b1292d961d60" containerName="maas-api"
Jul 10 02:54:55.640082 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.639902    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e6d4633-9e9f-49f6-a765-7c7a8ab7687f" containerName="main"
Jul 10 02:54:55.640082 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.639909    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5cae2e9-14fd-4c34-a3ab-39335a036ebd" containerName="maas-api"
Jul 10 02:54:55.643306 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.643285    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:55.645811 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.645788    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-6e451c-serving-cert\""
Jul 10 02:54:55.653105 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.653078    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"]
Jul 10 02:54:55.710077 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.710037    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:55.763541 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.763504    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecaec26d-b5da-4b94-b36a-7ad32b95528c-openshift-service-ca\") pod \"maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:55.763541 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.763556    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecaec26d-b5da-4b94-b36a-7ad32b95528c-maas-api-tls\") pod \"maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:55.763789 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.763677    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvksc\" (UniqueName: \"kubernetes.io/projected/ecaec26d-b5da-4b94-b36a-7ad32b95528c-kube-api-access-tvksc\") pod \"maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:55.865028 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.864929    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvksc\" (UniqueName: \"kubernetes.io/projected/ecaec26d-b5da-4b94-b36a-7ad32b95528c-kube-api-access-tvksc\") pod \"maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:55.865182 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.865074    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecaec26d-b5da-4b94-b36a-7ad32b95528c-openshift-service-ca\") pod \"maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:55.865182 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.865105    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecaec26d-b5da-4b94-b36a-7ad32b95528c-maas-api-tls\") pod \"maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:55.865254 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:54:55.865221    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-serving-cert: secret "maas-api-e2e-api-a-6e451c-serving-cert" not found
Jul 10 02:54:55.865289 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:54:55.865285    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecaec26d-b5da-4b94-b36a-7ad32b95528c-maas-api-tls podName:ecaec26d-b5da-4b94-b36a-7ad32b95528c nodeName:}" failed. No retries permitted until 2026-07-10 02:54:56.365269618 +0000 UTC m=+1928.886247909 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ecaec26d-b5da-4b94-b36a-7ad32b95528c-maas-api-tls") pod "maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv" (UID: "ecaec26d-b5da-4b94-b36a-7ad32b95528c") : secret "maas-api-e2e-api-a-6e451c-serving-cert" not found
Jul 10 02:54:55.865745 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.865726    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecaec26d-b5da-4b94-b36a-7ad32b95528c-openshift-service-ca\") pod \"maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:55.884718 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:55.884688    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvksc\" (UniqueName: \"kubernetes.io/projected/ecaec26d-b5da-4b94-b36a-7ad32b95528c-kube-api-access-tvksc\") pod \"maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:56.061183 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:56.061152    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:56.161877 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:56.161791    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:56.261802 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:56.261768    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:54:56.369998 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:56.369942    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecaec26d-b5da-4b94-b36a-7ad32b95528c-maas-api-tls\") pod \"maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:56.372489 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:56.372465    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecaec26d-b5da-4b94-b36a-7ad32b95528c-maas-api-tls\") pod \"maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:56.556208 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:56.556169    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:56.700565 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:56.700540    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"]
Jul 10 02:54:56.702850 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:54:56.702818    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecaec26d_b5da_4b94_b36a_7ad32b95528c.slice/crio-0ca0521c642b42e52ffdc9777468fd5f747fd51d23366e2e3c376e2236bc8e37 WatchSource:0}: Error finding container 0ca0521c642b42e52ffdc9777468fd5f747fd51d23366e2e3c376e2236bc8e37: Status 404 returned error can't find the container with id 0ca0521c642b42e52ffdc9777468fd5f747fd51d23366e2e3c376e2236bc8e37
Jul 10 02:54:57.380050 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:57.380003    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv" event={"ID":"ecaec26d-b5da-4b94-b36a-7ad32b95528c","Type":"ContainerStarted","Data":"0ca0521c642b42e52ffdc9777468fd5f747fd51d23366e2e3c376e2236bc8e37"}
Jul 10 02:54:58.385870 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:58.385833    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv" event={"ID":"ecaec26d-b5da-4b94-b36a-7ad32b95528c","Type":"ContainerStarted","Data":"d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced"}
Jul 10 02:54:58.386267 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:58.385906    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:54:58.402744 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:54:58.402694    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv" podStartSLOduration=2.778873332 podStartE2EDuration="3.402677154s" totalImagesPullingTime="623.803822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:54:58.400681272 +0000 UTC m=+1930.921659588" watchObservedRunningTime="2026-07-10 02:54:58.402677154 +0000 UTC m=+1930.923655462"
Jul 10 02:55:00.057717 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:00.057657    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:00.493090 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:00.492984    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:00.795213 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:00.795181    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:01.053532 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:01.053450    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:03.613569 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.613537    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:03.676071 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.676038    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"]
Jul 10 02:55:03.679909 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.679882    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:03.682468 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.682448    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-37e4cb-serving-cert\""
Jul 10 02:55:03.692391 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.692364    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"]
Jul 10 02:55:03.693246 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.693212    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:03.744551 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.744505    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb745d7e-296a-4319-8524-a168a83812d6-maas-api-tls\") pod \"maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz\" (UID: \"eb745d7e-296a-4319-8524-a168a83812d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:03.744745 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.744573    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g42q\" (UniqueName: \"kubernetes.io/projected/eb745d7e-296a-4319-8524-a168a83812d6-kube-api-access-4g42q\") pod \"maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz\" (UID: \"eb745d7e-296a-4319-8524-a168a83812d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:03.744745 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.744623    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb745d7e-296a-4319-8524-a168a83812d6-openshift-service-ca\") pod \"maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz\" (UID: \"eb745d7e-296a-4319-8524-a168a83812d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:03.763567 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.763538    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:03.845440 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.845401    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb745d7e-296a-4319-8524-a168a83812d6-maas-api-tls\") pod \"maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz\" (UID: \"eb745d7e-296a-4319-8524-a168a83812d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:03.845597 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.845453    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4g42q\" (UniqueName: \"kubernetes.io/projected/eb745d7e-296a-4319-8524-a168a83812d6-kube-api-access-4g42q\") pod \"maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz\" (UID: \"eb745d7e-296a-4319-8524-a168a83812d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:03.845597 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.845486    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb745d7e-296a-4319-8524-a168a83812d6-openshift-service-ca\") pod \"maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz\" (UID: \"eb745d7e-296a-4319-8524-a168a83812d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:03.846135 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.846115    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb745d7e-296a-4319-8524-a168a83812d6-openshift-service-ca\") pod \"maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz\" (UID: \"eb745d7e-296a-4319-8524-a168a83812d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:03.848168 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.848143    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb745d7e-296a-4319-8524-a168a83812d6-maas-api-tls\") pod \"maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz\" (UID: \"eb745d7e-296a-4319-8524-a168a83812d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:03.856617 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.856592    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g42q\" (UniqueName: \"kubernetes.io/projected/eb745d7e-296a-4319-8524-a168a83812d6-kube-api-access-4g42q\") pod \"maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz\" (UID: \"eb745d7e-296a-4319-8524-a168a83812d6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:03.991458 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:03.991375    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:04.136642 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:04.136620    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"]
Jul 10 02:55:04.139424 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:55:04.139396    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb745d7e_296a_4319_8524_a168a83812d6.slice/crio-269a55537509ba4f47d7bc5fda821a2db7b6da04304d426fe3b927c9ddf2548c WatchSource:0}: Error finding container 269a55537509ba4f47d7bc5fda821a2db7b6da04304d426fe3b927c9ddf2548c: Status 404 returned error can't find the container with id 269a55537509ba4f47d7bc5fda821a2db7b6da04304d426fe3b927c9ddf2548c
Jul 10 02:55:04.168649 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:04.168624    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:04.273764 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:04.273680    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:04.396917 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:04.396888    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:55:04.417352 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:04.417311    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz" event={"ID":"eb745d7e-296a-4319-8524-a168a83812d6","Type":"ContainerStarted","Data":"269a55537509ba4f47d7bc5fda821a2db7b6da04304d426fe3b927c9ddf2548c"}
Jul 10 02:55:05.423461 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:05.423419    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz" event={"ID":"eb745d7e-296a-4319-8524-a168a83812d6","Type":"ContainerStarted","Data":"13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3"}
Jul 10 02:55:05.423873 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:05.423559    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:05.440246 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:05.440188    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz" podStartSLOduration=2.085958692 podStartE2EDuration="2.440172985s" totalImagesPullingTime="354.214293ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:55:05.439245986 +0000 UTC m=+1937.960224296" watchObservedRunningTime="2026-07-10 02:55:05.440172985 +0000 UTC m=+1937.961151294"
Jul 10 02:55:08.095394 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:08.095355    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:11.433947 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:11.433920    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:16.084812 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:16.084771    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:16.509460 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:16.509365    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:16.625385 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:16.625349    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:16.725620 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:16.725584    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:16.863619 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:16.863581    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"]
Jul 10 02:55:16.863859 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:16.863829    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv" podUID="ecaec26d-b5da-4b94-b36a-7ad32b95528c" containerName="maas-api" containerID="cri-o://d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced" gracePeriod=30
Jul 10 02:55:16.889244 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:16.889210    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:17.116774 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.116713    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:55:17.279283 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.279237    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvksc\" (UniqueName: \"kubernetes.io/projected/ecaec26d-b5da-4b94-b36a-7ad32b95528c-kube-api-access-tvksc\") pod \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") "
Jul 10 02:55:17.279485 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.279347    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecaec26d-b5da-4b94-b36a-7ad32b95528c-openshift-service-ca\") pod \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") "
Jul 10 02:55:17.279485 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.279395    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecaec26d-b5da-4b94-b36a-7ad32b95528c-maas-api-tls\") pod \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\" (UID: \"ecaec26d-b5da-4b94-b36a-7ad32b95528c\") "
Jul 10 02:55:17.279756 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.279727    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecaec26d-b5da-4b94-b36a-7ad32b95528c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ecaec26d-b5da-4b94-b36a-7ad32b95528c" (UID: "ecaec26d-b5da-4b94-b36a-7ad32b95528c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:55:17.281686 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.281645    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ecaec26d-b5da-4b94-b36a-7ad32b95528c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ecaec26d-b5da-4b94-b36a-7ad32b95528c" (UID: "ecaec26d-b5da-4b94-b36a-7ad32b95528c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:55:17.281686 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.281655    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecaec26d-b5da-4b94-b36a-7ad32b95528c-kube-api-access-tvksc" (OuterVolumeSpecName: "kube-api-access-tvksc") pod "ecaec26d-b5da-4b94-b36a-7ad32b95528c" (UID: "ecaec26d-b5da-4b94-b36a-7ad32b95528c"). InnerVolumeSpecName "kube-api-access-tvksc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:55:17.380907 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.380820    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecaec26d-b5da-4b94-b36a-7ad32b95528c-openshift-service-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:55:17.380907 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.380851    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ecaec26d-b5da-4b94-b36a-7ad32b95528c-maas-api-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:55:17.380907 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.380862    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvksc\" (UniqueName: \"kubernetes.io/projected/ecaec26d-b5da-4b94-b36a-7ad32b95528c-kube-api-access-tvksc\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:55:17.483123 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.483082    2553 generic.go:356] "Generic (PLEG): container finished" podID="ecaec26d-b5da-4b94-b36a-7ad32b95528c" containerID="d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced" exitCode=0
Jul 10 02:55:17.483321 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.483149    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"
Jul 10 02:55:17.483321 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.483161    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv" event={"ID":"ecaec26d-b5da-4b94-b36a-7ad32b95528c","Type":"ContainerDied","Data":"d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced"}
Jul 10 02:55:17.483321 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.483210    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv" event={"ID":"ecaec26d-b5da-4b94-b36a-7ad32b95528c","Type":"ContainerDied","Data":"0ca0521c642b42e52ffdc9777468fd5f747fd51d23366e2e3c376e2236bc8e37"}
Jul 10 02:55:17.483321 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.483236    2553 scope.go:117] "RemoveContainer" containerID="d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced"
Jul 10 02:55:17.492839 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.492818    2553 scope.go:117] "RemoveContainer" containerID="d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced"
Jul 10 02:55:17.493178 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:55:17.493158    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced\": container with ID starting with d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced not found: ID does not exist" containerID="d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced"
Jul 10 02:55:17.493250 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.493187    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced"} err="failed to get container status \"d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced\": rpc error: code = NotFound desc = could not find container \"d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced\": container with ID starting with d2779483971387efeeb4bdf759507c4b7729145208548b15f6ac7b4566747ced not found: ID does not exist"
Jul 10 02:55:17.505690 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.505656    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"]
Jul 10 02:55:17.508541 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:17.508517    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-6e451c-7bc896fcf9-lwbdv"]
Jul 10 02:55:18.015632 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:18.015591    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecaec26d-b5da-4b94-b36a-7ad32b95528c" path="/var/lib/kubelet/pods/ecaec26d-b5da-4b94-b36a-7ad32b95528c/volumes"
Jul 10 02:55:22.160901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:22.160871    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:22.266514 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:22.266478    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:22.406113 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:22.406079    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:22.632267 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:22.632233    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:22.788519 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:22.788478    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:23.174631 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.174597    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:23.275086 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.275048    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:23.375638 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.375607    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:23.475446 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.475342    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"]
Jul 10 02:55:23.475621 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.475592    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz" podUID="eb745d7e-296a-4319-8524-a168a83812d6" containerName="maas-api" containerID="cri-o://13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3" gracePeriod=30
Jul 10 02:55:23.499749 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.499722    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:23.722379 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.722351    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:23.737087 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.737014    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb745d7e-296a-4319-8524-a168a83812d6-maas-api-tls\") pod \"eb745d7e-296a-4319-8524-a168a83812d6\" (UID: \"eb745d7e-296a-4319-8524-a168a83812d6\") "
Jul 10 02:55:23.737209 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.737109    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4g42q\" (UniqueName: \"kubernetes.io/projected/eb745d7e-296a-4319-8524-a168a83812d6-kube-api-access-4g42q\") pod \"eb745d7e-296a-4319-8524-a168a83812d6\" (UID: \"eb745d7e-296a-4319-8524-a168a83812d6\") "
Jul 10 02:55:23.737209 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.737137    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb745d7e-296a-4319-8524-a168a83812d6-openshift-service-ca\") pod \"eb745d7e-296a-4319-8524-a168a83812d6\" (UID: \"eb745d7e-296a-4319-8524-a168a83812d6\") "
Jul 10 02:55:23.737538 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.737512    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb745d7e-296a-4319-8524-a168a83812d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eb745d7e-296a-4319-8524-a168a83812d6" (UID: "eb745d7e-296a-4319-8524-a168a83812d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 02:55:23.739187 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.739149    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb745d7e-296a-4319-8524-a168a83812d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eb745d7e-296a-4319-8524-a168a83812d6" (UID: "eb745d7e-296a-4319-8524-a168a83812d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:55:23.739561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.739264    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb745d7e-296a-4319-8524-a168a83812d6-kube-api-access-4g42q" (OuterVolumeSpecName: "kube-api-access-4g42q") pod "eb745d7e-296a-4319-8524-a168a83812d6" (UID: "eb745d7e-296a-4319-8524-a168a83812d6"). InnerVolumeSpecName "kube-api-access-4g42q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:55:23.838402 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.838358    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4g42q\" (UniqueName: \"kubernetes.io/projected/eb745d7e-296a-4319-8524-a168a83812d6-kube-api-access-4g42q\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:55:23.838402 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.838393    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb745d7e-296a-4319-8524-a168a83812d6-openshift-service-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:55:23.838402 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:23.838405    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb745d7e-296a-4319-8524-a168a83812d6-maas-api-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:55:24.520813 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:24.520779    2553 generic.go:356] "Generic (PLEG): container finished" podID="eb745d7e-296a-4319-8524-a168a83812d6" containerID="13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3" exitCode=0
Jul 10 02:55:24.521218 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:24.520841    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"
Jul 10 02:55:24.521218 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:24.520858    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz" event={"ID":"eb745d7e-296a-4319-8524-a168a83812d6","Type":"ContainerDied","Data":"13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3"}
Jul 10 02:55:24.521218 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:24.520919    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz" event={"ID":"eb745d7e-296a-4319-8524-a168a83812d6","Type":"ContainerDied","Data":"269a55537509ba4f47d7bc5fda821a2db7b6da04304d426fe3b927c9ddf2548c"}
Jul 10 02:55:24.521218 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:24.520948    2553 scope.go:117] "RemoveContainer" containerID="13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3"
Jul 10 02:55:24.529804 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:24.529785    2553 scope.go:117] "RemoveContainer" containerID="13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3"
Jul 10 02:55:24.530076 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:55:24.530055    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3\": container with ID starting with 13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3 not found: ID does not exist" containerID="13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3"
Jul 10 02:55:24.530132 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:24.530089    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3"} err="failed to get container status \"13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3\": rpc error: code = NotFound desc = could not find container \"13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3\": container with ID starting with 13274e46fb1ee5d6c19a982baf470fa4a08dac76982d7cd0f7b6f6b7291750a3 not found: ID does not exist"
Jul 10 02:55:24.539817 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:24.539784    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"]
Jul 10 02:55:24.541607 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:24.541587    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-37e4cb-6f67984b74-7xgxz"]
Jul 10 02:55:26.009681 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:26.009641    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb745d7e-296a-4319-8524-a168a83812d6" path="/var/lib/kubelet/pods/eb745d7e-296a-4319-8524-a168a83812d6/volumes"
Jul 10 02:55:29.013105 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:29.013070    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:29.076390 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:29.076356    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:29.332416 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:29.332382    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:29.483994 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:29.483949    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:29.803993 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:29.803936    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:30.106902 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:30.106823    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:30.319040 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:30.319010    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:32.759746 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.759705    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:32.860375 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.860329    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:32.882399 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.882363    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"]
Jul 10 02:55:32.882814 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.882797    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecaec26d-b5da-4b94-b36a-7ad32b95528c" containerName="maas-api"
Jul 10 02:55:32.882911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.882816    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecaec26d-b5da-4b94-b36a-7ad32b95528c" containerName="maas-api"
Jul 10 02:55:32.882911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.882832    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb745d7e-296a-4319-8524-a168a83812d6" containerName="maas-api"
Jul 10 02:55:32.882911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.882840    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb745d7e-296a-4319-8524-a168a83812d6" containerName="maas-api"
Jul 10 02:55:32.883099 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.882994    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecaec26d-b5da-4b94-b36a-7ad32b95528c" containerName="maas-api"
Jul 10 02:55:32.883099 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.883011    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb745d7e-296a-4319-8524-a168a83812d6" containerName="maas-api"
Jul 10 02:55:32.886187 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.886163    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:32.888603 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.888579    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-1d77d1-serving-cert\""
Jul 10 02:55:32.894766 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.894731    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"]
Jul 10 02:55:32.915629 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.915591    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/916324c7-1573-4589-862e-ebfcaee2ea28-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:32.915795 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.915701    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29sdm\" (UniqueName: \"kubernetes.io/projected/916324c7-1573-4589-862e-ebfcaee2ea28-kube-api-access-29sdm\") pod \"maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:32.915849 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.915810    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/916324c7-1573-4589-862e-ebfcaee2ea28-maas-api-tls\") pod \"maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:32.985190 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:32.985135    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:33.016716 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:33.016630    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/916324c7-1573-4589-862e-ebfcaee2ea28-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:33.016716 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:33.016680    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29sdm\" (UniqueName: \"kubernetes.io/projected/916324c7-1573-4589-862e-ebfcaee2ea28-kube-api-access-29sdm\") pod \"maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:33.016912 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:33.016738    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/916324c7-1573-4589-862e-ebfcaee2ea28-maas-api-tls\") pod \"maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:33.016912 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:55:33.016841    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-serving-cert: secret "maas-api-e2e-shared-a-1d77d1-serving-cert" not found
Jul 10 02:55:33.016912 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:55:33.016901    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/916324c7-1573-4589-862e-ebfcaee2ea28-maas-api-tls podName:916324c7-1573-4589-862e-ebfcaee2ea28 nodeName:}" failed. No retries permitted until 2026-07-10 02:55:33.516886296 +0000 UTC m=+1966.037864583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/916324c7-1573-4589-862e-ebfcaee2ea28-maas-api-tls") pod "maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m" (UID: "916324c7-1573-4589-862e-ebfcaee2ea28") : secret "maas-api-e2e-shared-a-1d77d1-serving-cert" not found
Jul 10 02:55:33.017333 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:33.017306    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/916324c7-1573-4589-862e-ebfcaee2ea28-openshift-service-ca\") pod \"maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:33.026442 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:33.026408    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29sdm\" (UniqueName: \"kubernetes.io/projected/916324c7-1573-4589-862e-ebfcaee2ea28-kube-api-access-29sdm\") pod \"maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:33.253791 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:33.253749    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:33.409874 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:33.409828    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:33.511073 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:33.511037    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:33.521317 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:33.521284    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/916324c7-1573-4589-862e-ebfcaee2ea28-maas-api-tls\") pod \"maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:33.523761 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:33.523739    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/916324c7-1573-4589-862e-ebfcaee2ea28-maas-api-tls\") pod \"maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:33.798004 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:33.797956    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:33.947058 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:33.947016    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"]
Jul 10 02:55:33.949655 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:55:33.949619    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916324c7_1573_4589_862e_ebfcaee2ea28.slice/crio-8148dd6185e800a4dc2ac9efcb5db2ea7ac21b4380e4cdc167091b25a3116bdd WatchSource:0}: Error finding container 8148dd6185e800a4dc2ac9efcb5db2ea7ac21b4380e4cdc167091b25a3116bdd: Status 404 returned error can't find the container with id 8148dd6185e800a4dc2ac9efcb5db2ea7ac21b4380e4cdc167091b25a3116bdd
Jul 10 02:55:34.578901 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:34.578854    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m" event={"ID":"916324c7-1573-4589-862e-ebfcaee2ea28","Type":"ContainerStarted","Data":"cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84"}
Jul 10 02:55:34.579134 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:34.578915    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m" event={"ID":"916324c7-1573-4589-862e-ebfcaee2ea28","Type":"ContainerStarted","Data":"8148dd6185e800a4dc2ac9efcb5db2ea7ac21b4380e4cdc167091b25a3116bdd"}
Jul 10 02:55:34.579134 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:34.578936    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:34.598277 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:34.598223    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m" podStartSLOduration=2.098417798 podStartE2EDuration="2.598204083s" totalImagesPullingTime="499.786285ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:55:34.596858351 +0000 UTC m=+1967.117836685" watchObservedRunningTime="2026-07-10 02:55:34.598204083 +0000 UTC m=+1967.119182392"
Jul 10 02:55:37.232140 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:37.232111    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:37.540954 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:37.540923    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:37.836101 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:37.836019    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:38.160601 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:38.160518    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:38.258638 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:38.258606    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:40.590326 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:40.590247    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 02:55:40.801561 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:40.801522    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:40.892250 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:40.892156    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:40.978301 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:40.978262    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"]
Jul 10 02:55:40.982198 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:40.982173    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:40.984621 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:40.984597    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-f94570-serving-cert\""
Jul 10 02:55:40.991916 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:40.991883    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"]
Jul 10 02:55:41.015403 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.015353    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:41.093878 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.093836    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71c76b81-1296-4316-b292-2a737986671e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f94570-865fc4798-tm8zt\" (UID: \"71c76b81-1296-4316-b292-2a737986671e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:41.094086 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.093953    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4z8w\" (UniqueName: \"kubernetes.io/projected/71c76b81-1296-4316-b292-2a737986671e-kube-api-access-w4z8w\") pod \"maas-api-e2e-shared-b-f94570-865fc4798-tm8zt\" (UID: \"71c76b81-1296-4316-b292-2a737986671e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:41.094086 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.094045    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71c76b81-1296-4316-b292-2a737986671e-maas-api-tls\") pod \"maas-api-e2e-shared-b-f94570-865fc4798-tm8zt\" (UID: \"71c76b81-1296-4316-b292-2a737986671e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:41.113985 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.113939    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:41.195072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.194947    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4z8w\" (UniqueName: \"kubernetes.io/projected/71c76b81-1296-4316-b292-2a737986671e-kube-api-access-w4z8w\") pod \"maas-api-e2e-shared-b-f94570-865fc4798-tm8zt\" (UID: \"71c76b81-1296-4316-b292-2a737986671e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:41.195072 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.195059    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71c76b81-1296-4316-b292-2a737986671e-maas-api-tls\") pod \"maas-api-e2e-shared-b-f94570-865fc4798-tm8zt\" (UID: \"71c76b81-1296-4316-b292-2a737986671e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:41.195296 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.195115    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71c76b81-1296-4316-b292-2a737986671e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f94570-865fc4798-tm8zt\" (UID: \"71c76b81-1296-4316-b292-2a737986671e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:41.195835 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.195809    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71c76b81-1296-4316-b292-2a737986671e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f94570-865fc4798-tm8zt\" (UID: \"71c76b81-1296-4316-b292-2a737986671e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:41.197649 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.197629    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71c76b81-1296-4316-b292-2a737986671e-maas-api-tls\") pod \"maas-api-e2e-shared-b-f94570-865fc4798-tm8zt\" (UID: \"71c76b81-1296-4316-b292-2a737986671e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:41.203975 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.203931    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4z8w\" (UniqueName: \"kubernetes.io/projected/71c76b81-1296-4316-b292-2a737986671e-kube-api-access-w4z8w\") pod \"maas-api-e2e-shared-b-f94570-865fc4798-tm8zt\" (UID: \"71c76b81-1296-4316-b292-2a737986671e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:41.295053 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.295010    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:41.451046 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.451017    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"]
Jul 10 02:55:41.453753 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:55:41.453726    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c76b81_1296_4316_b292_2a737986671e.slice/crio-d2bf27ab323fd8bcc463f106bcfe3934873cc970e2af2e5ec6596e03fa0291d3 WatchSource:0}: Error finding container d2bf27ab323fd8bcc463f106bcfe3934873cc970e2af2e5ec6596e03fa0291d3: Status 404 returned error can't find the container with id d2bf27ab323fd8bcc463f106bcfe3934873cc970e2af2e5ec6596e03fa0291d3
Jul 10 02:55:41.533527 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.533493    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:41.614196 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.614156    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt" event={"ID":"71c76b81-1296-4316-b292-2a737986671e","Type":"ContainerStarted","Data":"d2bf27ab323fd8bcc463f106bcfe3934873cc970e2af2e5ec6596e03fa0291d3"}
Jul 10 02:55:41.617582 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:41.617559    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:42.620142 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:42.620102    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt" event={"ID":"71c76b81-1296-4316-b292-2a737986671e","Type":"ContainerStarted","Data":"fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee"}
Jul 10 02:55:42.620539 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:42.620238    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:42.641995 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:42.641929    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt" podStartSLOduration=2.260681312 podStartE2EDuration="2.641912512s" totalImagesPullingTime="381.2312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:55:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:55:42.639869778 +0000 UTC m=+1975.160848098" watchObservedRunningTime="2026-07-10 02:55:42.641912512 +0000 UTC m=+1975.162890820"
Jul 10 02:55:45.281978 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:45.281930    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:48.630775 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:48.630741    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 02:55:54.149499 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:54.149463    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:55:55.476081 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:55:55.476044    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:00.652258 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:00.652212    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:02.275370 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:02.275335    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:02.375704 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:02.375671    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:14.611367 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:14.611330    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:19.325731 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.325685    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"]
Jul 10 02:56:19.329911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.329891    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.332829 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.332802    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f94570\"/\"auth-test-model-f94570-kserve-self-signed-certs\""
Jul 10 02:56:19.332829 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.332825    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f94570\"/\"default-dockercfg-w5nt9\""
Jul 10 02:56:19.333013 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.332836    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f94570\"/\"kube-root-ca.crt\""
Jul 10 02:56:19.333013 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.332810    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f94570\"/\"openshift-service-ca.crt\""
Jul 10 02:56:19.337608 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.337587    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"]
Jul 10 02:56:19.348387 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.348351    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:56:19.461930 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.461882    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-model-cache\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.462114 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.462004    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-home\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.462114 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.462042    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-tmp-dir\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.462189 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.462128    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-dshm\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.462189 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.462172    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caaecec3-cb5d-4456-9b21-efdcdcb35650-tls-certs\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.462254 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.462222    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn5z9\" (UniqueName: \"kubernetes.io/projected/caaecec3-cb5d-4456-9b21-efdcdcb35650-kube-api-access-sn5z9\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.563789 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.563750    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-dshm\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.563789 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.563795    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caaecec3-cb5d-4456-9b21-efdcdcb35650-tls-certs\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.564040 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.563833    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn5z9\" (UniqueName: \"kubernetes.io/projected/caaecec3-cb5d-4456-9b21-efdcdcb35650-kube-api-access-sn5z9\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.564040 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.563880    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-model-cache\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.564040 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.563932    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-home\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.564040 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.563981    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-tmp-dir\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.564325 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.564305    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-model-cache\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.564389 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.564354    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-tmp-dir\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.564389 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.564377    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-home\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.566162 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.566142    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-dshm\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.566297 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.566280    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caaecec3-cb5d-4456-9b21-efdcdcb35650-tls-certs\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.571860 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.571840    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn5z9\" (UniqueName: \"kubernetes.io/projected/caaecec3-cb5d-4456-9b21-efdcdcb35650-kube-api-access-sn5z9\") pod \"auth-test-model-f94570-kserve-6c8c657bd7-m6qcw\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") " pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.640025 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.639900    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:19.786453 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.786422    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"]
Jul 10 02:56:19.788443 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:56:19.788414    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcaaecec3_cb5d_4456_9b21_efdcdcb35650.slice/crio-6a35c9a7f353f49d757f30587bad03b19f3ab5a843a11700b35e4e7fc7d26b26 WatchSource:0}: Error finding container 6a35c9a7f353f49d757f30587bad03b19f3ab5a843a11700b35e4e7fc7d26b26: Status 404 returned error can't find the container with id 6a35c9a7f353f49d757f30587bad03b19f3ab5a843a11700b35e4e7fc7d26b26
Jul 10 02:56:19.800022 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:19.799989    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw" event={"ID":"caaecec3-cb5d-4456-9b21-efdcdcb35650","Type":"ContainerStarted","Data":"6a35c9a7f353f49d757f30587bad03b19f3ab5a843a11700b35e4e7fc7d26b26"}
Jul 10 02:56:20.806158 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:20.806122    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw" event={"ID":"caaecec3-cb5d-4456-9b21-efdcdcb35650","Type":"ContainerStarted","Data":"50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84"}
Jul 10 02:56:20.824789 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:20.824736    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw" podStartSLOduration=1.824719398 podStartE2EDuration="1.824719398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:56:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:56:20.823526939 +0000 UTC m=+2013.344505248" watchObservedRunningTime="2026-07-10 02:56:20.824719398 +0000 UTC m=+2013.345697707"
Jul 10 02:56:29.640627 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:29.640584    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:29.641062 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:29.640642    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:29.653091 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:29.653060    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:56:29.862032 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:56:29.861993    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:57:25.444228 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:57:25.444187    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:25.497618 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:57:25.497587    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:57:48.102186 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:57:48.102155    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:57:48.107861 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:57:48.107834    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 02:58:00.183092 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:00.183057    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:01.103266 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:01.103226    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"]
Jul 10 02:58:01.121054 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:01.121022    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:02.833913 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:02.833878    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:16.127502 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.127452    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw" podUID="caaecec3-cb5d-4456-9b21-efdcdcb35650" containerName="main" containerID="cri-o://50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84" gracePeriod=45
Jul 10 02:58:16.381391 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.381320    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:58:16.385274 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.385245    2553 generic.go:356] "Generic (PLEG): container finished" podID="caaecec3-cb5d-4456-9b21-efdcdcb35650" containerID="50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84" exitCode=0
Jul 10 02:58:16.385409 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.385287    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"
Jul 10 02:58:16.385409 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.385331    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw" event={"ID":"caaecec3-cb5d-4456-9b21-efdcdcb35650","Type":"ContainerDied","Data":"50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84"}
Jul 10 02:58:16.385409 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.385374    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw" event={"ID":"caaecec3-cb5d-4456-9b21-efdcdcb35650","Type":"ContainerDied","Data":"6a35c9a7f353f49d757f30587bad03b19f3ab5a843a11700b35e4e7fc7d26b26"}
Jul 10 02:58:16.385409 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.385392    2553 scope.go:117] "RemoveContainer" containerID="50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84"
Jul 10 02:58:16.394003 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.393986    2553 scope.go:117] "RemoveContainer" containerID="50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84"
Jul 10 02:58:16.394312 ip-10-0-130-224 kubenswrapper[2553]: E0710 02:58:16.394289    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84\": container with ID starting with 50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84 not found: ID does not exist" containerID="50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84"
Jul 10 02:58:16.394412 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.394318    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84"} err="failed to get container status \"50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84\": rpc error: code = NotFound desc = could not find container \"50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84\": container with ID starting with 50e9fae7e71233357053641f8cebd1e338656a5b1e3e940a7967df12c253dd84 not found: ID does not exist"
Jul 10 02:58:16.504811 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.504775    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-tmp-dir\") pod \"caaecec3-cb5d-4456-9b21-efdcdcb35650\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") "
Jul 10 02:58:16.504811 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.504815    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-model-cache\") pod \"caaecec3-cb5d-4456-9b21-efdcdcb35650\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") "
Jul 10 02:58:16.505125 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.504848    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caaecec3-cb5d-4456-9b21-efdcdcb35650-tls-certs\") pod \"caaecec3-cb5d-4456-9b21-efdcdcb35650\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") "
Jul 10 02:58:16.505125 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.504886    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn5z9\" (UniqueName: \"kubernetes.io/projected/caaecec3-cb5d-4456-9b21-efdcdcb35650-kube-api-access-sn5z9\") pod \"caaecec3-cb5d-4456-9b21-efdcdcb35650\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") "
Jul 10 02:58:16.505125 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.504905    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-dshm\") pod \"caaecec3-cb5d-4456-9b21-efdcdcb35650\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") "
Jul 10 02:58:16.505125 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.504924    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-home\") pod \"caaecec3-cb5d-4456-9b21-efdcdcb35650\" (UID: \"caaecec3-cb5d-4456-9b21-efdcdcb35650\") "
Jul 10 02:58:16.505333 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.505136    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "caaecec3-cb5d-4456-9b21-efdcdcb35650" (UID: "caaecec3-cb5d-4456-9b21-efdcdcb35650"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:58:16.505333 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.505226    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-model-cache" (OuterVolumeSpecName: "model-cache") pod "caaecec3-cb5d-4456-9b21-efdcdcb35650" (UID: "caaecec3-cb5d-4456-9b21-efdcdcb35650"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:58:16.505412 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.505324    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-home" (OuterVolumeSpecName: "home") pod "caaecec3-cb5d-4456-9b21-efdcdcb35650" (UID: "caaecec3-cb5d-4456-9b21-efdcdcb35650"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:58:16.507198 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.507171    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-dshm" (OuterVolumeSpecName: "dshm") pod "caaecec3-cb5d-4456-9b21-efdcdcb35650" (UID: "caaecec3-cb5d-4456-9b21-efdcdcb35650"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:58:16.507286 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.507244    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caaecec3-cb5d-4456-9b21-efdcdcb35650-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "caaecec3-cb5d-4456-9b21-efdcdcb35650" (UID: "caaecec3-cb5d-4456-9b21-efdcdcb35650"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:58:16.507286 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.507262    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caaecec3-cb5d-4456-9b21-efdcdcb35650-kube-api-access-sn5z9" (OuterVolumeSpecName: "kube-api-access-sn5z9") pod "caaecec3-cb5d-4456-9b21-efdcdcb35650" (UID: "caaecec3-cb5d-4456-9b21-efdcdcb35650"). InnerVolumeSpecName "kube-api-access-sn5z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:58:16.606293 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.606250    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-tmp-dir\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:58:16.606293 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.606285    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-model-cache\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:58:16.606293 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.606293    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/caaecec3-cb5d-4456-9b21-efdcdcb35650-tls-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:58:16.606293 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.606302    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn5z9\" (UniqueName: \"kubernetes.io/projected/caaecec3-cb5d-4456-9b21-efdcdcb35650-kube-api-access-sn5z9\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:58:16.606579 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.606311    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-dshm\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:58:16.606579 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.606320    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/caaecec3-cb5d-4456-9b21-efdcdcb35650-home\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:58:16.708102 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.708069    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"]
Jul 10 02:58:16.712083 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:16.712052    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/auth-test-model-f94570-kserve-6c8c657bd7-m6qcw"]
Jul 10 02:58:18.012983 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:18.010770    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caaecec3-cb5d-4456-9b21-efdcdcb35650" path="/var/lib/kubelet/pods/caaecec3-cb5d-4456-9b21-efdcdcb35650/volumes"
Jul 10 02:58:48.420608 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.420575    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"]
Jul 10 02:58:48.421048 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.421034    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caaecec3-cb5d-4456-9b21-efdcdcb35650" containerName="main"
Jul 10 02:58:48.421097 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.421050    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="caaecec3-cb5d-4456-9b21-efdcdcb35650" containerName="main"
Jul 10 02:58:48.421140 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.421130    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="caaecec3-cb5d-4456-9b21-efdcdcb35650" containerName="main"
Jul 10 02:58:48.425366 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.425345    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.429122 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.429092    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f94570\"/\"openshift-service-ca.crt\""
Jul 10 02:58:48.429122 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.429104    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f94570\"/\"sub-test-model-f94570-kserve-self-signed-certs\""
Jul 10 02:58:48.429300 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.429103    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f94570\"/\"kube-root-ca.crt\""
Jul 10 02:58:48.429300 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.429207    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f94570\"/\"default-dockercfg-w5nt9\""
Jul 10 02:58:48.435121 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.435097    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"]
Jul 10 02:58:48.445572 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.445547    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:48.493289 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.493255    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-tmp-dir\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.493469 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.493336    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-model-cache\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.493469 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.493367    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-dshm\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.493469 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.493392    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdcg8\" (UniqueName: \"kubernetes.io/projected/4736634d-0f6c-4ce6-9a68-5c17127f3366-kube-api-access-hdcg8\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.493469 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.493445    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-home\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.493611 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.493475    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4736634d-0f6c-4ce6-9a68-5c17127f3366-tls-certs\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.594084 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.594050    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-model-cache\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.594084 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.594094    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-dshm\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.594352 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.594120    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdcg8\" (UniqueName: \"kubernetes.io/projected/4736634d-0f6c-4ce6-9a68-5c17127f3366-kube-api-access-hdcg8\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.594352 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.594181    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-home\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.594352 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.594221    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4736634d-0f6c-4ce6-9a68-5c17127f3366-tls-certs\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.594352 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.594274    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-tmp-dir\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.594590 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.594519    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-model-cache\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.594653 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.594590    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-tmp-dir\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.594988 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.594936    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-home\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.597169 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.597137    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-dshm\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.597544 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.597523    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4736634d-0f6c-4ce6-9a68-5c17127f3366-tls-certs\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.607471 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.605986    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdcg8\" (UniqueName: \"kubernetes.io/projected/4736634d-0f6c-4ce6-9a68-5c17127f3366-kube-api-access-hdcg8\") pod \"sub-test-model-f94570-kserve-695f799cbf-v9ggw\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") " pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.735766 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.735726    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:48.876085 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:48.875999    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"]
Jul 10 02:58:48.879402 ip-10-0-130-224 kubenswrapper[2553]: W0710 02:58:48.879363    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4736634d_0f6c_4ce6_9a68_5c17127f3366.slice/crio-86d687d1bbb521cb2bf92199482a64ce9de0526abc6d29a8a70cf0a34be4be5e WatchSource:0}: Error finding container 86d687d1bbb521cb2bf92199482a64ce9de0526abc6d29a8a70cf0a34be4be5e: Status 404 returned error can't find the container with id 86d687d1bbb521cb2bf92199482a64ce9de0526abc6d29a8a70cf0a34be4be5e
Jul 10 02:58:49.551512 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:49.551473    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw" event={"ID":"4736634d-0f6c-4ce6-9a68-5c17127f3366","Type":"ContainerStarted","Data":"91d4d93c3ecd0bb472d31581e66857b25723a86880d01aa45169be87ee2ca4ee"}
Jul 10 02:58:49.551911 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:49.551522    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw" event={"ID":"4736634d-0f6c-4ce6-9a68-5c17127f3366","Type":"ContainerStarted","Data":"86d687d1bbb521cb2bf92199482a64ce9de0526abc6d29a8a70cf0a34be4be5e"}
Jul 10 02:58:49.570603 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:49.570411    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw" podStartSLOduration=1.570390395 podStartE2EDuration="1.570390395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 02:58:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 02:58:49.570241878 +0000 UTC m=+2162.091220188" watchObservedRunningTime="2026-07-10 02:58:49.570390395 +0000 UTC m=+2162.091368702"
Jul 10 02:58:53.382940 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:53.382903    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:58:58.736573 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:58.736528    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:58.736573 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:58.736580    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:58.748898 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:58.748869    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:58:59.612740 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:58:59.612706    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:59:26.362332 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:26.362278    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:59:27.739828 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:27.739782    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:59:28.607832 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:28.607790    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"]
Jul 10 02:59:28.630937 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:28.630906    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:59:40.723917 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:40.723878    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 02:59:43.633887 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:43.633810    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw" podUID="4736634d-0f6c-4ce6-9a68-5c17127f3366" containerName="main" containerID="cri-o://91d4d93c3ecd0bb472d31581e66857b25723a86880d01aa45169be87ee2ca4ee" gracePeriod=45
Jul 10 02:59:43.823053 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:43.823012    2553 generic.go:356] "Generic (PLEG): container finished" podID="4736634d-0f6c-4ce6-9a68-5c17127f3366" containerID="91d4d93c3ecd0bb472d31581e66857b25723a86880d01aa45169be87ee2ca4ee" exitCode=0
Jul 10 02:59:43.823265 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:43.823079    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw" event={"ID":"4736634d-0f6c-4ce6-9a68-5c17127f3366","Type":"ContainerDied","Data":"91d4d93c3ecd0bb472d31581e66857b25723a86880d01aa45169be87ee2ca4ee"}
Jul 10 02:59:43.920930 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:43.920899    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:59:44.039927 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.039896    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-tmp-dir\") pod \"4736634d-0f6c-4ce6-9a68-5c17127f3366\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") "
Jul 10 02:59:44.040208 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.039988    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-model-cache\") pod \"4736634d-0f6c-4ce6-9a68-5c17127f3366\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") "
Jul 10 02:59:44.040208 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.040043    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdcg8\" (UniqueName: \"kubernetes.io/projected/4736634d-0f6c-4ce6-9a68-5c17127f3366-kube-api-access-hdcg8\") pod \"4736634d-0f6c-4ce6-9a68-5c17127f3366\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") "
Jul 10 02:59:44.040208 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.040067    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-home\") pod \"4736634d-0f6c-4ce6-9a68-5c17127f3366\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") "
Jul 10 02:59:44.040208 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.040119    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4736634d-0f6c-4ce6-9a68-5c17127f3366-tls-certs\") pod \"4736634d-0f6c-4ce6-9a68-5c17127f3366\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") "
Jul 10 02:59:44.040208 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.040178    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-dshm\") pod \"4736634d-0f6c-4ce6-9a68-5c17127f3366\" (UID: \"4736634d-0f6c-4ce6-9a68-5c17127f3366\") "
Jul 10 02:59:44.040586 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.040241    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4736634d-0f6c-4ce6-9a68-5c17127f3366" (UID: "4736634d-0f6c-4ce6-9a68-5c17127f3366"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:59:44.040586 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.040317    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-model-cache" (OuterVolumeSpecName: "model-cache") pod "4736634d-0f6c-4ce6-9a68-5c17127f3366" (UID: "4736634d-0f6c-4ce6-9a68-5c17127f3366"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:59:44.040586 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.040557    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-home" (OuterVolumeSpecName: "home") pod "4736634d-0f6c-4ce6-9a68-5c17127f3366" (UID: "4736634d-0f6c-4ce6-9a68-5c17127f3366"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:59:44.040586 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.040563    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-tmp-dir\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:59:44.040795 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.040592    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-model-cache\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:59:44.042498 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.042465    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4736634d-0f6c-4ce6-9a68-5c17127f3366-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4736634d-0f6c-4ce6-9a68-5c17127f3366" (UID: "4736634d-0f6c-4ce6-9a68-5c17127f3366"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 02:59:44.042675 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.042656    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-dshm" (OuterVolumeSpecName: "dshm") pod "4736634d-0f6c-4ce6-9a68-5c17127f3366" (UID: "4736634d-0f6c-4ce6-9a68-5c17127f3366"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 02:59:44.042744 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.042679    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4736634d-0f6c-4ce6-9a68-5c17127f3366-kube-api-access-hdcg8" (OuterVolumeSpecName: "kube-api-access-hdcg8") pod "4736634d-0f6c-4ce6-9a68-5c17127f3366" (UID: "4736634d-0f6c-4ce6-9a68-5c17127f3366"). InnerVolumeSpecName "kube-api-access-hdcg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 02:59:44.142017 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.141975    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdcg8\" (UniqueName: \"kubernetes.io/projected/4736634d-0f6c-4ce6-9a68-5c17127f3366-kube-api-access-hdcg8\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:59:44.142017 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.142012    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-home\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:59:44.142017 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.142023    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4736634d-0f6c-4ce6-9a68-5c17127f3366-tls-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:59:44.142360 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.142035    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4736634d-0f6c-4ce6-9a68-5c17127f3366-dshm\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 02:59:44.829575 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.829539    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"
Jul 10 02:59:44.830085 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.829568    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw" event={"ID":"4736634d-0f6c-4ce6-9a68-5c17127f3366","Type":"ContainerDied","Data":"86d687d1bbb521cb2bf92199482a64ce9de0526abc6d29a8a70cf0a34be4be5e"}
Jul 10 02:59:44.830085 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.829634    2553 scope.go:117] "RemoveContainer" containerID="91d4d93c3ecd0bb472d31581e66857b25723a86880d01aa45169be87ee2ca4ee"
Jul 10 02:59:44.852017 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.851986    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"]
Jul 10 02:59:44.855935 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:44.855909    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/sub-test-model-f94570-kserve-695f799cbf-v9ggw"]
Jul 10 02:59:46.008948 ip-10-0-130-224 kubenswrapper[2553]: I0710 02:59:46.008911    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4736634d-0f6c-4ce6-9a68-5c17127f3366" path="/var/lib/kubelet/pods/4736634d-0f6c-4ce6-9a68-5c17127f3366/volumes"
Jul 10 03:00:12.304486 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.304402    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"]
Jul 10 03:00:12.304940 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.304831    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4736634d-0f6c-4ce6-9a68-5c17127f3366" containerName="main"
Jul 10 03:00:12.304940 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.304843    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4736634d-0f6c-4ce6-9a68-5c17127f3366" containerName="main"
Jul 10 03:00:12.304940 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.304904    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4736634d-0f6c-4ce6-9a68-5c17127f3366" containerName="main"
Jul 10 03:00:12.308033 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.308016    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.310811 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.310787    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f94570\"/\"default-dockercfg-w5nt9\""
Jul 10 03:00:12.311788 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.311770    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f94570\"/\"kube-root-ca.crt\""
Jul 10 03:00:12.311891 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.311871    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f94570\"/\"rate-test-model-f94570-kserve-self-signed-certs\""
Jul 10 03:00:12.311957 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.311872    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f94570\"/\"openshift-service-ca.crt\""
Jul 10 03:00:12.319207 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.319182    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"]
Jul 10 03:00:12.331285 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.331255    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:00:12.419345 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.419302    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-model-cache\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.419530 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.419356    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l2cg\" (UniqueName: \"kubernetes.io/projected/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-kube-api-access-7l2cg\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.419530 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.419386    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-tls-certs\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.419530 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.419407    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-home\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.419530 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.419437    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-tmp-dir\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.419530 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.419501    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-dshm\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.520259 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.520216    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-model-cache\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.520430 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.520269    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l2cg\" (UniqueName: \"kubernetes.io/projected/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-kube-api-access-7l2cg\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.520430 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.520291    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-tls-certs\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.520430 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.520406    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-home\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.520581 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.520479    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-tmp-dir\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.520581 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.520515    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-dshm\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.520718 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.520698    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-model-cache\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.520777 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.520735    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-home\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.520909 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.520885    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-tmp-dir\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.522575 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.522558    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-dshm\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.522873 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.522854    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-tls-certs\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.529085 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.529059    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l2cg\" (UniqueName: \"kubernetes.io/projected/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-kube-api-access-7l2cg\") pod \"rate-test-model-f94570-kserve-6c84656447-8q656\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") " pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.618810 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.618715    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:12.758879 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.758850    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"]
Jul 10 03:00:12.760973 ip-10-0-130-224 kubenswrapper[2553]: W0710 03:00:12.760931    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod037a6446_d69d_4be5_9ab9_97dc5ab5b6f6.slice/crio-c68f946fec0bcb9932ce6123249fc29946bb2c14bff9d046bad2b88729377769 WatchSource:0}: Error finding container c68f946fec0bcb9932ce6123249fc29946bb2c14bff9d046bad2b88729377769: Status 404 returned error can't find the container with id c68f946fec0bcb9932ce6123249fc29946bb2c14bff9d046bad2b88729377769
Jul 10 03:00:12.977217 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.977122    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656" event={"ID":"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6","Type":"ContainerStarted","Data":"bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e"}
Jul 10 03:00:12.977217 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.977165    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656" event={"ID":"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6","Type":"ContainerStarted","Data":"c68f946fec0bcb9932ce6123249fc29946bb2c14bff9d046bad2b88729377769"}
Jul 10 03:00:12.995544 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:12.995484    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656" podStartSLOduration=0.995467392 podStartE2EDuration="995.467392ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:00:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:00:12.994428789 +0000 UTC m=+2245.515407089" watchObservedRunningTime="2026-07-10 03:00:12.995467392 +0000 UTC m=+2245.516445701"
Jul 10 03:00:22.619667 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:22.619620    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:22.619667 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:22.619672    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:22.632377 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:22.632337    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:23.036173 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:23.036082    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:00:38.934141 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:38.934106    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:00:39.057170 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:39.057130    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:00:46.318050 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:46.318017    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:00:47.133186 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:47.133153    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"]
Jul 10 03:00:47.156357 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:47.156329    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:00:48.056286 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:48.056246    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7371-139815049020848"]
Jul 10 03:00:48.062382 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:48.062354    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139815049020848"
Jul 10 03:00:48.064783 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:48.064750    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139815049020848"]
Jul 10 03:00:48.065135 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:48.065114    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-ff2w2\""
Jul 10 03:00:48.162136 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:48.162106    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkww7\" (UniqueName: \"kubernetes.io/projected/94caf915-e9ab-4caf-85a7-9290aeb8b3c3-kube-api-access-bkww7\") pod \"test-curl-7371-139815049020848\" (UID: \"94caf915-e9ab-4caf-85a7-9290aeb8b3c3\") " pod="openshift-ingress/test-curl-7371-139815049020848"
Jul 10 03:00:48.263544 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:48.263512    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkww7\" (UniqueName: \"kubernetes.io/projected/94caf915-e9ab-4caf-85a7-9290aeb8b3c3-kube-api-access-bkww7\") pod \"test-curl-7371-139815049020848\" (UID: \"94caf915-e9ab-4caf-85a7-9290aeb8b3c3\") " pod="openshift-ingress/test-curl-7371-139815049020848"
Jul 10 03:00:48.285640 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:48.285608    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkww7\" (UniqueName: \"kubernetes.io/projected/94caf915-e9ab-4caf-85a7-9290aeb8b3c3-kube-api-access-bkww7\") pod \"test-curl-7371-139815049020848\" (UID: \"94caf915-e9ab-4caf-85a7-9290aeb8b3c3\") " pod="openshift-ingress/test-curl-7371-139815049020848"
Jul 10 03:00:48.373519 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:48.373415    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139815049020848"
Jul 10 03:00:48.509036 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:48.509008    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7371-139815049020848"]
Jul 10 03:00:48.510534 ip-10-0-130-224 kubenswrapper[2553]: W0710 03:00:48.510504    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94caf915_e9ab_4caf_85a7_9290aeb8b3c3.slice/crio-7bcdabed87fb97e73b0b3dc15ba531c1a1732df2020468eb7301566eda46f72a WatchSource:0}: Error finding container 7bcdabed87fb97e73b0b3dc15ba531c1a1732df2020468eb7301566eda46f72a: Status 404 returned error can't find the container with id 7bcdabed87fb97e73b0b3dc15ba531c1a1732df2020468eb7301566eda46f72a
Jul 10 03:00:48.511986 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:48.511944    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 03:00:49.150847 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:49.150805    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139815049020848" event={"ID":"94caf915-e9ab-4caf-85a7-9290aeb8b3c3","Type":"ContainerStarted","Data":"7bcdabed87fb97e73b0b3dc15ba531c1a1732df2020468eb7301566eda46f72a"}
Jul 10 03:00:50.156918 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:50.156878    2553 generic.go:356] "Generic (PLEG): container finished" podID="94caf915-e9ab-4caf-85a7-9290aeb8b3c3" containerID="80bff90fda98582db395e7caa84b54f308c096e4e3c35e9a072222c93149108d" exitCode=0
Jul 10 03:00:50.157325 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:50.156985    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7371-139815049020848" event={"ID":"94caf915-e9ab-4caf-85a7-9290aeb8b3c3","Type":"ContainerDied","Data":"80bff90fda98582db395e7caa84b54f308c096e4e3c35e9a072222c93149108d"}
Jul 10 03:00:51.303995 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:51.303951    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139815049020848"
Jul 10 03:00:51.325150 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:51.325118    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7371-139815049020848_94caf915-e9ab-4caf-85a7-9290aeb8b3c3/test-curl-7371-139815049020848/0.log"
Jul 10 03:00:51.347195 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:51.347160    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7371-139815049020848"]
Jul 10 03:00:51.349072 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:51.349049    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7371-139815049020848"]
Jul 10 03:00:51.396737 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:51.396697    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkww7\" (UniqueName: \"kubernetes.io/projected/94caf915-e9ab-4caf-85a7-9290aeb8b3c3-kube-api-access-bkww7\") pod \"94caf915-e9ab-4caf-85a7-9290aeb8b3c3\" (UID: \"94caf915-e9ab-4caf-85a7-9290aeb8b3c3\") "
Jul 10 03:00:51.398934 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:51.398908    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94caf915-e9ab-4caf-85a7-9290aeb8b3c3-kube-api-access-bkww7" (OuterVolumeSpecName: "kube-api-access-bkww7") pod "94caf915-e9ab-4caf-85a7-9290aeb8b3c3" (UID: "94caf915-e9ab-4caf-85a7-9290aeb8b3c3"). InnerVolumeSpecName "kube-api-access-bkww7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:00:51.497857 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:51.497756    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkww7\" (UniqueName: \"kubernetes.io/projected/94caf915-e9ab-4caf-85a7-9290aeb8b3c3-kube-api-access-bkww7\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:00:52.009296 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:52.009262    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94caf915-e9ab-4caf-85a7-9290aeb8b3c3" path="/var/lib/kubelet/pods/94caf915-e9ab-4caf-85a7-9290aeb8b3c3/volumes"
Jul 10 03:00:52.167492 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:52.167465    2553 scope.go:117] "RemoveContainer" containerID="80bff90fda98582db395e7caa84b54f308c096e4e3c35e9a072222c93149108d"
Jul 10 03:00:52.167674 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:52.167499    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7371-139815049020848"
Jul 10 03:00:54.883133 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:54.883095    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:00:54.937254 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:00:54.937216    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:02.154720 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.154674    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656" podUID="037a6446-d69d-4be5-9ab9-97dc5ab5b6f6" containerName="main" containerID="cri-o://bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e" gracePeriod=45
Jul 10 03:01:02.420931 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.420860    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:01:02.504304 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.504262    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-home\") pod \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") "
Jul 10 03:01:02.504506 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.504340    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-dshm\") pod \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") "
Jul 10 03:01:02.504506 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.504412    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-model-cache\") pod \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") "
Jul 10 03:01:02.504506 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.504461    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-tls-certs\") pod \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") "
Jul 10 03:01:02.504506 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.504489    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-tmp-dir\") pod \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") "
Jul 10 03:01:02.504715 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.504519    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-home" (OuterVolumeSpecName: "home") pod "037a6446-d69d-4be5-9ab9-97dc5ab5b6f6" (UID: "037a6446-d69d-4be5-9ab9-97dc5ab5b6f6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:01:02.504715 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.504535    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l2cg\" (UniqueName: \"kubernetes.io/projected/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-kube-api-access-7l2cg\") pod \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\" (UID: \"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6\") "
Jul 10 03:01:02.504812 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.504691    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-model-cache" (OuterVolumeSpecName: "model-cache") pod "037a6446-d69d-4be5-9ab9-97dc5ab5b6f6" (UID: "037a6446-d69d-4be5-9ab9-97dc5ab5b6f6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:01:02.504812 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.504765    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "037a6446-d69d-4be5-9ab9-97dc5ab5b6f6" (UID: "037a6446-d69d-4be5-9ab9-97dc5ab5b6f6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:01:02.505112 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.505008    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-model-cache\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:01:02.505112 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.505063    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-tmp-dir\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:01:02.505112 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.505077    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-home\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:01:02.506704 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.506668    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-dshm" (OuterVolumeSpecName: "dshm") pod "037a6446-d69d-4be5-9ab9-97dc5ab5b6f6" (UID: "037a6446-d69d-4be5-9ab9-97dc5ab5b6f6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 03:01:02.506841 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.506815    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "037a6446-d69d-4be5-9ab9-97dc5ab5b6f6" (UID: "037a6446-d69d-4be5-9ab9-97dc5ab5b6f6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 03:01:02.506913 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.506826    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-kube-api-access-7l2cg" (OuterVolumeSpecName: "kube-api-access-7l2cg") pod "037a6446-d69d-4be5-9ab9-97dc5ab5b6f6" (UID: "037a6446-d69d-4be5-9ab9-97dc5ab5b6f6"). InnerVolumeSpecName "kube-api-access-7l2cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:01:02.606501 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.606440    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-dshm\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:01:02.606501 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.606491    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-tls-certs\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:01:02.606501 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:02.606503    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l2cg\" (UniqueName: \"kubernetes.io/projected/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6-kube-api-access-7l2cg\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:01:03.194020 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:03.193958    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:03.225037 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:03.224998    2553 generic.go:356] "Generic (PLEG): container finished" podID="037a6446-d69d-4be5-9ab9-97dc5ab5b6f6" containerID="bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e" exitCode=0
Jul 10 03:01:03.225238 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:03.225046    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656" event={"ID":"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6","Type":"ContainerDied","Data":"bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e"}
Jul 10 03:01:03.225238 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:03.225064    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"
Jul 10 03:01:03.225238 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:03.225100    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656" event={"ID":"037a6446-d69d-4be5-9ab9-97dc5ab5b6f6","Type":"ContainerDied","Data":"c68f946fec0bcb9932ce6123249fc29946bb2c14bff9d046bad2b88729377769"}
Jul 10 03:01:03.225238 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:03.225122    2553 scope.go:117] "RemoveContainer" containerID="bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e"
Jul 10 03:01:03.234619 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:03.234601    2553 scope.go:117] "RemoveContainer" containerID="bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e"
Jul 10 03:01:03.234889 ip-10-0-130-224 kubenswrapper[2553]: E0710 03:01:03.234871    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e\": container with ID starting with bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e not found: ID does not exist" containerID="bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e"
Jul 10 03:01:03.234937 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:03.234899    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e"} err="failed to get container status \"bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e\": rpc error: code = NotFound desc = could not find container \"bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e\": container with ID starting with bed0ccbe763b248eca7ab6314e7b6f800b0f3c5bd07c3e522388a35f60b3103e not found: ID does not exist"
Jul 10 03:01:03.247326 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:03.247287    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"]
Jul 10 03:01:03.253063 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:03.253032    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f94570/rate-test-model-f94570-kserve-6c84656447-8q656"]
Jul 10 03:01:04.009192 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:04.009153    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="037a6446-d69d-4be5-9ab9-97dc5ab5b6f6" path="/var/lib/kubelet/pods/037a6446-d69d-4be5-9ab9-97dc5ab5b6f6/volumes"
Jul 10 03:01:04.564055 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:04.564017    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:06.565538 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:06.565504    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:06.956333 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:06.956244    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:07.056484 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.056448    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:07.157165 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.157124    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:07.252206 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.252116    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"]
Jul 10 03:01:07.252406 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.252381    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m" podUID="916324c7-1573-4589-862e-ebfcaee2ea28" containerName="maas-api" containerID="cri-o://cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84" gracePeriod=30
Jul 10 03:01:07.711876 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.711844    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 03:01:07.754330 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.754292    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29sdm\" (UniqueName: \"kubernetes.io/projected/916324c7-1573-4589-862e-ebfcaee2ea28-kube-api-access-29sdm\") pod \"916324c7-1573-4589-862e-ebfcaee2ea28\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") "
Jul 10 03:01:07.754526 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.754358    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/916324c7-1573-4589-862e-ebfcaee2ea28-maas-api-tls\") pod \"916324c7-1573-4589-862e-ebfcaee2ea28\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") "
Jul 10 03:01:07.754526 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.754432    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/916324c7-1573-4589-862e-ebfcaee2ea28-openshift-service-ca\") pod \"916324c7-1573-4589-862e-ebfcaee2ea28\" (UID: \"916324c7-1573-4589-862e-ebfcaee2ea28\") "
Jul 10 03:01:07.754838 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.754807    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/916324c7-1573-4589-862e-ebfcaee2ea28-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "916324c7-1573-4589-862e-ebfcaee2ea28" (UID: "916324c7-1573-4589-862e-ebfcaee2ea28"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 03:01:07.756593 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.756563    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/916324c7-1573-4589-862e-ebfcaee2ea28-kube-api-access-29sdm" (OuterVolumeSpecName: "kube-api-access-29sdm") pod "916324c7-1573-4589-862e-ebfcaee2ea28" (UID: "916324c7-1573-4589-862e-ebfcaee2ea28"). InnerVolumeSpecName "kube-api-access-29sdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:01:07.756593 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.756583    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/916324c7-1573-4589-862e-ebfcaee2ea28-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "916324c7-1573-4589-862e-ebfcaee2ea28" (UID: "916324c7-1573-4589-862e-ebfcaee2ea28"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 03:01:07.855743 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.855699    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/916324c7-1573-4589-862e-ebfcaee2ea28-openshift-service-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:01:07.855743 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.855734    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29sdm\" (UniqueName: \"kubernetes.io/projected/916324c7-1573-4589-862e-ebfcaee2ea28-kube-api-access-29sdm\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:01:07.855743 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:07.855748    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/916324c7-1573-4589-862e-ebfcaee2ea28-maas-api-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:01:08.167611 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:08.167525    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:08.252551 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:08.252515    2553 generic.go:356] "Generic (PLEG): container finished" podID="916324c7-1573-4589-862e-ebfcaee2ea28" containerID="cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84" exitCode=0
Jul 10 03:01:08.252725 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:08.252561    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"
Jul 10 03:01:08.252725 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:08.252593    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m" event={"ID":"916324c7-1573-4589-862e-ebfcaee2ea28","Type":"ContainerDied","Data":"cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84"}
Jul 10 03:01:08.252725 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:08.252653    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m" event={"ID":"916324c7-1573-4589-862e-ebfcaee2ea28","Type":"ContainerDied","Data":"8148dd6185e800a4dc2ac9efcb5db2ea7ac21b4380e4cdc167091b25a3116bdd"}
Jul 10 03:01:08.252725 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:08.252686    2553 scope.go:117] "RemoveContainer" containerID="cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84"
Jul 10 03:01:08.261455 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:08.261434    2553 scope.go:117] "RemoveContainer" containerID="cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84"
Jul 10 03:01:08.261717 ip-10-0-130-224 kubenswrapper[2553]: E0710 03:01:08.261695    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84\": container with ID starting with cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84 not found: ID does not exist" containerID="cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84"
Jul 10 03:01:08.261762 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:08.261725    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84"} err="failed to get container status \"cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84\": rpc error: code = NotFound desc = could not find container \"cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84\": container with ID starting with cc5e9e56b1679b757d63d08575f5414ed11426ea2a7d9a082f677b9f784ccc84 not found: ID does not exist"
Jul 10 03:01:08.270876 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:08.270847    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"]
Jul 10 03:01:08.275914 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:08.275885    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-1d77d1-656bb4c5bd-nl87m"]
Jul 10 03:01:10.008774 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:10.008739    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="916324c7-1573-4589-862e-ebfcaee2ea28" path="/var/lib/kubelet/pods/916324c7-1573-4589-862e-ebfcaee2ea28/volumes"
Jul 10 03:01:12.970850 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:12.970817    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:13.078605 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:13.078575    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:13.295350 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:13.295307    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:13.461087 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:13.461051    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:13.614227 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:13.614145    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:13.990165 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:13.990075    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:14.088139 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.088108    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:14.190805 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.190777    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:14.319897 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.319859    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"]
Jul 10 03:01:14.320210 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.320180    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt" podUID="71c76b81-1296-4316-b292-2a737986671e" containerName="maas-api" containerID="cri-o://fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee" gracePeriod=30
Jul 10 03:01:14.347593 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.347565    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:14.573900 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.573837    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 03:01:14.604881 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.604850    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71c76b81-1296-4316-b292-2a737986671e-openshift-service-ca\") pod \"71c76b81-1296-4316-b292-2a737986671e\" (UID: \"71c76b81-1296-4316-b292-2a737986671e\") "
Jul 10 03:01:14.605071 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.604917    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4z8w\" (UniqueName: \"kubernetes.io/projected/71c76b81-1296-4316-b292-2a737986671e-kube-api-access-w4z8w\") pod \"71c76b81-1296-4316-b292-2a737986671e\" (UID: \"71c76b81-1296-4316-b292-2a737986671e\") "
Jul 10 03:01:14.605071 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.605003    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71c76b81-1296-4316-b292-2a737986671e-maas-api-tls\") pod \"71c76b81-1296-4316-b292-2a737986671e\" (UID: \"71c76b81-1296-4316-b292-2a737986671e\") "
Jul 10 03:01:14.605284 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.605258    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71c76b81-1296-4316-b292-2a737986671e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "71c76b81-1296-4316-b292-2a737986671e" (UID: "71c76b81-1296-4316-b292-2a737986671e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 03:01:14.607160 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.607127    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71c76b81-1296-4316-b292-2a737986671e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "71c76b81-1296-4316-b292-2a737986671e" (UID: "71c76b81-1296-4316-b292-2a737986671e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 03:01:14.607160 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.607141    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71c76b81-1296-4316-b292-2a737986671e-kube-api-access-w4z8w" (OuterVolumeSpecName: "kube-api-access-w4z8w") pod "71c76b81-1296-4316-b292-2a737986671e" (UID: "71c76b81-1296-4316-b292-2a737986671e"). InnerVolumeSpecName "kube-api-access-w4z8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 03:01:14.706591 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.706553    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71c76b81-1296-4316-b292-2a737986671e-maas-api-tls\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:01:14.706591 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.706584    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71c76b81-1296-4316-b292-2a737986671e-openshift-service-ca\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:01:14.706591 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:14.706594    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4z8w\" (UniqueName: \"kubernetes.io/projected/71c76b81-1296-4316-b292-2a737986671e-kube-api-access-w4z8w\") on node \"ip-10-0-130-224.ec2.internal\" DevicePath \"\""
Jul 10 03:01:15.288904 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:15.288871    2553 generic.go:356] "Generic (PLEG): container finished" podID="71c76b81-1296-4316-b292-2a737986671e" containerID="fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee" exitCode=0
Jul 10 03:01:15.289416 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:15.288915    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"
Jul 10 03:01:15.289416 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:15.288980    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt" event={"ID":"71c76b81-1296-4316-b292-2a737986671e","Type":"ContainerDied","Data":"fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee"}
Jul 10 03:01:15.289416 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:15.289054    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt" event={"ID":"71c76b81-1296-4316-b292-2a737986671e","Type":"ContainerDied","Data":"d2bf27ab323fd8bcc463f106bcfe3934873cc970e2af2e5ec6596e03fa0291d3"}
Jul 10 03:01:15.289416 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:15.289090    2553 scope.go:117] "RemoveContainer" containerID="fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee"
Jul 10 03:01:15.298749 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:15.298728    2553 scope.go:117] "RemoveContainer" containerID="fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee"
Jul 10 03:01:15.299069 ip-10-0-130-224 kubenswrapper[2553]: E0710 03:01:15.299049    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee\": container with ID starting with fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee not found: ID does not exist" containerID="fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee"
Jul 10 03:01:15.299118 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:15.299081    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee"} err="failed to get container status \"fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee\": rpc error: code = NotFound desc = could not find container \"fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee\": container with ID starting with fa3e08e5cdba163c83fdf0196c812ee2cea8eee8251c1aaee98b05300ecd86ee not found: ID does not exist"
Jul 10 03:01:15.311098 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:15.311072    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"]
Jul 10 03:01:15.314308 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:15.314285    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-f94570-865fc4798-tm8zt"]
Jul 10 03:01:16.010431 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:16.010395    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71c76b81-1296-4316-b292-2a737986671e" path="/var/lib/kubelet/pods/71c76b81-1296-4316-b292-2a737986671e/volumes"
Jul 10 03:01:20.665531 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:20.665491    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:20.735612 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:20.735573    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:20.925929 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:20.925851    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66d74486d7-5xgdq_7956b83c-f621-48bf-99d4-80aaf753607d/authorino/0.log"
Jul 10 03:01:25.941028 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:25.940996    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dd68cb575-9lpm4_01c518a3-3433-4487-a42f-29b868e43b4d/manager/0.log"
Jul 10 03:01:26.286015 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:26.285918    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc46458b-g2l8q_33082935-cd72-4064-bb27-85001f92e31d/copy-manifests/0.log"
Jul 10 03:01:26.292957 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:26.292930    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc46458b-g2l8q_33082935-cd72-4064-bb27-85001f92e31d/manager/0.log"
Jul 10 03:01:26.873246 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:26.873219    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6b4cfccc4d-nfl42_9711ac9c-d874-4c26-80ab-5d8e97a5854e/maas-api/0.log"
Jul 10 03:01:27.301436 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:27.301409    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-w8kbv_ab720ff3-7d55-49c0-a2b2-008ee4a8ad77/postgres/0.log"
Jul 10 03:01:28.049284 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:28.049248    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66d74486d7-5xgdq_7956b83c-f621-48bf-99d4-80aaf753607d/authorino/0.log"
Jul 10 03:01:29.411525 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:29.411490    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f74c66c44-rqdgn_1130e493-92c1-4e54-8712-aad48a9ae4e7/kube-auth-proxy/0.log"
Jul 10 03:01:29.637879 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:29.637841    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-wtrvc_39e8a37e-529a-428d-86a0-2e62d76ebe5d/payload-pre-processing/0.log"
Jul 10 03:01:29.860026 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:29.859995    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54684b4666-zv2d2_449265a9-3f9e-4ef4-aec7-3439a8a67b57/router/0.log"
Jul 10 03:01:30.188420 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:30.188347    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-5jwdx_63895b2b-ccbe-4b4c-b52c-2f30fb377458/main/0.log"
Jul 10 03:01:30.405929 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:30.405899    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-bqx6w_24f84186-6d95-44f8-bafd-87b40634a85b/main/0.log"
Jul 10 03:01:34.971555 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.971517    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2z9m4/must-gather-2r2w7"]
Jul 10 03:01:34.971937 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.971913    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71c76b81-1296-4316-b292-2a737986671e" containerName="maas-api"
Jul 10 03:01:34.971937 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.971928    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="71c76b81-1296-4316-b292-2a737986671e" containerName="maas-api"
Jul 10 03:01:34.972072 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.971939    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94caf915-e9ab-4caf-85a7-9290aeb8b3c3" containerName="test-curl-7371-139815049020848"
Jul 10 03:01:34.972072 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.971945    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="94caf915-e9ab-4caf-85a7-9290aeb8b3c3" containerName="test-curl-7371-139815049020848"
Jul 10 03:01:34.972072 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.971975    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037a6446-d69d-4be5-9ab9-97dc5ab5b6f6" containerName="main"
Jul 10 03:01:34.972072 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.971982    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="037a6446-d69d-4be5-9ab9-97dc5ab5b6f6" containerName="main"
Jul 10 03:01:34.972072 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.971993    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916324c7-1573-4589-862e-ebfcaee2ea28" containerName="maas-api"
Jul 10 03:01:34.972072 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.971998    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="916324c7-1573-4589-862e-ebfcaee2ea28" containerName="maas-api"
Jul 10 03:01:34.972072 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.972061    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="037a6446-d69d-4be5-9ab9-97dc5ab5b6f6" containerName="main"
Jul 10 03:01:34.972072 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.972070    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="916324c7-1573-4589-862e-ebfcaee2ea28" containerName="maas-api"
Jul 10 03:01:34.972320 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.972078    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="94caf915-e9ab-4caf-85a7-9290aeb8b3c3" containerName="test-curl-7371-139815049020848"
Jul 10 03:01:34.972320 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.972084    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="71c76b81-1296-4316-b292-2a737986671e" containerName="maas-api"
Jul 10 03:01:34.975306 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.975279    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2z9m4/must-gather-2r2w7"
Jul 10 03:01:34.978266 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.978244    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2z9m4\"/\"kube-root-ca.crt\""
Jul 10 03:01:34.978397 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.978243    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2z9m4\"/\"openshift-service-ca.crt\""
Jul 10 03:01:34.978397 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.978245    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2z9m4\"/\"default-dockercfg-k6xcg\""
Jul 10 03:01:34.983986 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.983942    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2z9m4/must-gather-2r2w7"]
Jul 10 03:01:34.984177 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:34.984158    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:35.082010 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:35.081948    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:35.098305 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:35.098274    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7d108728-cf95-424d-af14-4efbfd033b50-must-gather-output\") pod \"must-gather-2r2w7\" (UID: \"7d108728-cf95-424d-af14-4efbfd033b50\") " pod="openshift-must-gather-2z9m4/must-gather-2r2w7"
Jul 10 03:01:35.098439 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:35.098317    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6457m\" (UniqueName: \"kubernetes.io/projected/7d108728-cf95-424d-af14-4efbfd033b50-kube-api-access-6457m\") pod \"must-gather-2r2w7\" (UID: \"7d108728-cf95-424d-af14-4efbfd033b50\") " pod="openshift-must-gather-2z9m4/must-gather-2r2w7"
Jul 10 03:01:35.199454 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:35.199411    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7d108728-cf95-424d-af14-4efbfd033b50-must-gather-output\") pod \"must-gather-2r2w7\" (UID: \"7d108728-cf95-424d-af14-4efbfd033b50\") " pod="openshift-must-gather-2z9m4/must-gather-2r2w7"
Jul 10 03:01:35.199454 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:35.199456    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6457m\" (UniqueName: \"kubernetes.io/projected/7d108728-cf95-424d-af14-4efbfd033b50-kube-api-access-6457m\") pod \"must-gather-2r2w7\" (UID: \"7d108728-cf95-424d-af14-4efbfd033b50\") " pod="openshift-must-gather-2z9m4/must-gather-2r2w7"
Jul 10 03:01:35.199840 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:35.199814    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7d108728-cf95-424d-af14-4efbfd033b50-must-gather-output\") pod \"must-gather-2r2w7\" (UID: \"7d108728-cf95-424d-af14-4efbfd033b50\") " pod="openshift-must-gather-2z9m4/must-gather-2r2w7"
Jul 10 03:01:35.207930 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:35.207890    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6457m\" (UniqueName: \"kubernetes.io/projected/7d108728-cf95-424d-af14-4efbfd033b50-kube-api-access-6457m\") pod \"must-gather-2r2w7\" (UID: \"7d108728-cf95-424d-af14-4efbfd033b50\") " pod="openshift-must-gather-2z9m4/must-gather-2r2w7"
Jul 10 03:01:35.285997 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:35.285876    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2z9m4/must-gather-2r2w7"
Jul 10 03:01:35.430088 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:35.430064    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2z9m4/must-gather-2r2w7"]
Jul 10 03:01:35.432275 ip-10-0-130-224 kubenswrapper[2553]: W0710 03:01:35.432246    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d108728_cf95_424d_af14_4efbfd033b50.slice/crio-ea9e61137dd3723e2e34e24e2073fb071d2be45db9aaf924d36467ddf388724a WatchSource:0}: Error finding container ea9e61137dd3723e2e34e24e2073fb071d2be45db9aaf924d36467ddf388724a: Status 404 returned error can't find the container with id ea9e61137dd3723e2e34e24e2073fb071d2be45db9aaf924d36467ddf388724a
Jul 10 03:01:36.400272 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:36.400178    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2z9m4/must-gather-2r2w7" event={"ID":"7d108728-cf95-424d-af14-4efbfd033b50","Type":"ContainerStarted","Data":"c6001586580862c601714f80d2aa0dd1ef3f25979f646186d04f94394b8f7846"}
Jul 10 03:01:36.400272 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:36.400238    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2z9m4/must-gather-2r2w7" event={"ID":"7d108728-cf95-424d-af14-4efbfd033b50","Type":"ContainerStarted","Data":"ea9e61137dd3723e2e34e24e2073fb071d2be45db9aaf924d36467ddf388724a"}
Jul 10 03:01:37.410240 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:37.410199    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2z9m4/must-gather-2r2w7" event={"ID":"7d108728-cf95-424d-af14-4efbfd033b50","Type":"ContainerStarted","Data":"c268854d9b2a7854f0eb5820541cbb05103bbeb50703bceb4c388d67af15847c"}
Jul 10 03:01:37.429245 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:37.429180    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2z9m4/must-gather-2r2w7" podStartSLOduration=2.6092224760000002 podStartE2EDuration="3.429156331s" totalImagesPullingTime="819.933855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:01:37.426779571 +0000 UTC m=+2329.947757882" watchObservedRunningTime="2026-07-10 03:01:37.429156331 +0000 UTC m=+2329.950134644"
Jul 10 03:01:37.940498 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:37.940458    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lk64x_fdf20648-a46e-4896-98b6-56734478f76c/global-pull-secret-syncer/0.log"
Jul 10 03:01:37.994375 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:37.994325    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log"
Jul 10 03:01:38.114643 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:38.114574    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-224.ec2.internal_a952e5b6d4e019797a19f89704bcb1d9/haproxy/0.log"
Jul 10 03:01:42.744989 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:42.741946    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66d74486d7-5xgdq_7956b83c-f621-48bf-99d4-80aaf753607d/authorino/0.log"
Jul 10 03:01:44.549274 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:44.549239    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38/alertmanager/0.log"
Jul 10 03:01:44.574893 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:44.574854    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38/config-reloader/0.log"
Jul 10 03:01:44.608059 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:44.608031    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38/kube-rbac-proxy-web/0.log"
Jul 10 03:01:44.630021 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:44.629992    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38/kube-rbac-proxy/0.log"
Jul 10 03:01:44.655251 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:44.655215    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38/kube-rbac-proxy-metric/0.log"
Jul 10 03:01:44.678755 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:44.678728    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38/prom-label-proxy/0.log"
Jul 10 03:01:44.704892 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:44.704837    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7d8b5a6c-2aca-4aa0-a7f6-a4b83cef3a38/init-config-reloader/0.log"
Jul 10 03:01:44.747795 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:44.747763    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-m98mv_80c914fd-447b-4090-b638-7709ffac5eb4/cluster-monitoring-operator/0.log"
Jul 10 03:01:44.883231 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:44.883143    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-6gt5k_59fe58e3-26b6-4687-978d-0f0624ff5851/monitoring-plugin/0.log"
Jul 10 03:01:45.078750 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.078722    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m4tk9_b892cbd4-5541-4cfc-a363-d9dbeeb6d323/node-exporter/0.log"
Jul 10 03:01:45.102978 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.102934    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m4tk9_b892cbd4-5541-4cfc-a363-d9dbeeb6d323/kube-rbac-proxy/0.log"
Jul 10 03:01:45.125282 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.125255    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m4tk9_b892cbd4-5541-4cfc-a363-d9dbeeb6d323/init-textfile/0.log"
Jul 10 03:01:45.156605 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.156513    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-6x5jb_af6b9938-3fc8-43a2-956c-3b4c11648538/kube-rbac-proxy-main/0.log"
Jul 10 03:01:45.181102 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.181076    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-6x5jb_af6b9938-3fc8-43a2-956c-3b4c11648538/kube-rbac-proxy-self/0.log"
Jul 10 03:01:45.207824 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.207786    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-6x5jb_af6b9938-3fc8-43a2-956c-3b4c11648538/openshift-state-metrics/0.log"
Jul 10 03:01:45.272581 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.272544    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa53d918-d255-4f4d-a728-6a3008b15259/prometheus/0.log"
Jul 10 03:01:45.302219 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.302189    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa53d918-d255-4f4d-a728-6a3008b15259/config-reloader/0.log"
Jul 10 03:01:45.332653 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.332625    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa53d918-d255-4f4d-a728-6a3008b15259/thanos-sidecar/0.log"
Jul 10 03:01:45.362032 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.361957    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa53d918-d255-4f4d-a728-6a3008b15259/kube-rbac-proxy-web/0.log"
Jul 10 03:01:45.396128 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.396096    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa53d918-d255-4f4d-a728-6a3008b15259/kube-rbac-proxy/0.log"
Jul 10 03:01:45.426025 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.422716    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa53d918-d255-4f4d-a728-6a3008b15259/kube-rbac-proxy-thanos/0.log"
Jul 10 03:01:45.456573 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.456521    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fa53d918-d255-4f4d-a728-6a3008b15259/init-config-reloader/0.log"
Jul 10 03:01:45.495982 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.495523    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xmgr5_c7aa07ae-4662-4645-b00b-647a1f0118b3/prometheus-operator/0.log"
Jul 10 03:01:45.523225 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.523188    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xmgr5_c7aa07ae-4662-4645-b00b-647a1f0118b3/kube-rbac-proxy/0.log"
Jul 10 03:01:45.585038 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.582709    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-6rvzd_70e7b402-c43e-4927-b28c-bdca448d1a0c/prometheus-operator-admission-webhook/0.log"
Jul 10 03:01:45.618114 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.618084    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6676bd8587-rhddh_c438d76f-473b-45aa-b8b8-1f3817389b3a/telemeter-client/0.log"
Jul 10 03:01:45.647042 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.646999    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6676bd8587-rhddh_c438d76f-473b-45aa-b8b8-1f3817389b3a/reload/0.log"
Jul 10 03:01:45.672543 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:45.672514    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6676bd8587-rhddh_c438d76f-473b-45aa-b8b8-1f3817389b3a/kube-rbac-proxy/0.log"
Jul 10 03:01:47.366002 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:47.365954    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-8lgvq_6666af78-fb87-4de2-83e3-a60d1c902d1a/networking-console-plugin/0.log"
Jul 10 03:01:48.030889 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.030853    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/2.log"
Jul 10 03:01:48.036551 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.036505    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-xx87v_602ea76a-cc86-439b-b144-893cb6d217de/console-operator/3.log"
Jul 10 03:01:48.580853 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.580817    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"]
Jul 10 03:01:48.586927 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.586902    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.594713 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.594676    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"]
Jul 10 03:01:48.756470 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.756428    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/307b8546-8a0b-4065-9fda-2c458180c71e-podres\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.756670 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.756479    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x4v4\" (UniqueName: \"kubernetes.io/projected/307b8546-8a0b-4065-9fda-2c458180c71e-kube-api-access-7x4v4\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.756670 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.756545    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/307b8546-8a0b-4065-9fda-2c458180c71e-proc\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.756670 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.756579    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307b8546-8a0b-4065-9fda-2c458180c71e-sys\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.756670 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.756647    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/307b8546-8a0b-4065-9fda-2c458180c71e-lib-modules\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.857821 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.857723    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/307b8546-8a0b-4065-9fda-2c458180c71e-podres\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.857821 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.857765    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x4v4\" (UniqueName: \"kubernetes.io/projected/307b8546-8a0b-4065-9fda-2c458180c71e-kube-api-access-7x4v4\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.857821 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.857794    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/307b8546-8a0b-4065-9fda-2c458180c71e-proc\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.858136 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.857843    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307b8546-8a0b-4065-9fda-2c458180c71e-sys\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.858136 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.857873    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/307b8546-8a0b-4065-9fda-2c458180c71e-proc\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.858136 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.857902    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/307b8546-8a0b-4065-9fda-2c458180c71e-podres\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.858136 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.857925    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/307b8546-8a0b-4065-9fda-2c458180c71e-lib-modules\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.858136 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.858020    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/307b8546-8a0b-4065-9fda-2c458180c71e-sys\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.858136 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.858049    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/307b8546-8a0b-4065-9fda-2c458180c71e-lib-modules\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.866593 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.866556    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x4v4\" (UniqueName: \"kubernetes.io/projected/307b8546-8a0b-4065-9fda-2c458180c71e-kube-api-access-7x4v4\") pod \"perf-node-gather-daemonset-2wc6h\" (UID: \"307b8546-8a0b-4065-9fda-2c458180c71e\") " pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:48.906367 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:48.906328    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:49.101437 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:49.101226    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"]
Jul 10 03:01:49.103988 ip-10-0-130-224 kubenswrapper[2553]: W0710 03:01:49.103921    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod307b8546_8a0b_4065_9fda_2c458180c71e.slice/crio-d51069ac6ddec2c97dc325dfd0e439ef5da8b9ec1a50dbae47b7460deab7db19 WatchSource:0}: Error finding container d51069ac6ddec2c97dc325dfd0e439ef5da8b9ec1a50dbae47b7460deab7db19: Status 404 returned error can't find the container with id d51069ac6ddec2c97dc325dfd0e439ef5da8b9ec1a50dbae47b7460deab7db19
Jul 10 03:01:49.392497 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:49.392401    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-wqst5_3a2b6ad9-2ee6-40b0-95d2-eb27870f9380/volume-data-source-validator/0.log"
Jul 10 03:01:49.499823 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:49.499772    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h" event={"ID":"307b8546-8a0b-4065-9fda-2c458180c71e","Type":"ContainerStarted","Data":"a867a9422b967360b76c7cc085f72ad1acd3bad9004988cad299f345545bed88"}
Jul 10 03:01:49.500056 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:49.499852    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h" event={"ID":"307b8546-8a0b-4065-9fda-2c458180c71e","Type":"ContainerStarted","Data":"d51069ac6ddec2c97dc325dfd0e439ef5da8b9ec1a50dbae47b7460deab7db19"}
Jul 10 03:01:49.500436 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:49.500414    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:49.518281 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:49.518215    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h" podStartSLOduration=1.518194098 podStartE2EDuration="1.518194098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:01:49.515871218 +0000 UTC m=+2342.036849527" watchObservedRunningTime="2026-07-10 03:01:49.518194098 +0000 UTC m=+2342.039172408"
Jul 10 03:01:50.503033 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:50.502990    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-clndt_88c82cab-f998-4fe1-91de-b6fad16e0241/dns/0.log"
Jul 10 03:01:50.523979 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:50.523927    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-clndt_88c82cab-f998-4fe1-91de-b6fad16e0241/kube-rbac-proxy/0.log"
Jul 10 03:01:50.643291 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:50.643267    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-shcs2_0eb86958-c22a-4c9f-8a28-394ab957d89d/dns-node-resolver/0.log"
Jul 10 03:01:51.211464 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:51.211436    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cfmmx_285629fb-127f-4594-889c-5ef466d88885/node-ca/0.log"
Jul 10 03:01:52.472618 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:52.472585    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f74c66c44-rqdgn_1130e493-92c1-4e54-8712-aad48a9ae4e7/kube-auth-proxy/0.log"
Jul 10 03:01:52.541985 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:52.541940    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-wtrvc_39e8a37e-529a-428d-86a0-2e62d76ebe5d/payload-pre-processing/0.log"
Jul 10 03:01:52.590833 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:52.590803    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54684b4666-zv2d2_449265a9-3f9e-4ef4-aec7-3439a8a67b57/router/0.log"
Jul 10 03:01:53.275322 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:53.275295    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2x8wh_8c772177-dfc8-4644-b0ea-3373ae628937/serve-healthcheck-canary/0.log"
Jul 10 03:01:53.813139 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:53.813108    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2bpbm_f75d5d7c-a255-473b-ae97-a105df6d4db8/kube-rbac-proxy/0.log"
Jul 10 03:01:53.835068 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:53.835036    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2bpbm_f75d5d7c-a255-473b-ae97-a105df6d4db8/exporter/0.log"
Jul 10 03:01:53.857408 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:53.857370    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2bpbm_f75d5d7c-a255-473b-ae97-a105df6d4db8/extractor/0.log"
Jul 10 03:01:55.516214 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:55.516187    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2z9m4/perf-node-gather-daemonset-2wc6h"
Jul 10 03:01:56.394226 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:56.394171    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dd68cb575-9lpm4_01c518a3-3433-4487-a42f-29b868e43b4d/manager/0.log"
Jul 10 03:01:56.529792 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:56.529765    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc46458b-g2l8q_33082935-cd72-4064-bb27-85001f92e31d/manager/0.log"
Jul 10 03:01:56.565798 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:56.565773    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fc46458b-g2l8q_33082935-cd72-4064-bb27-85001f92e31d/copy-manifests/0.log"
Jul 10 03:01:57.059394 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:57.059345    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8q8kj_8ecc2d80-ce74-4157-916a-523bcd88e568/konnectivity-agent/0.log" limit=1024
Jul 10 03:01:58.042265 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:58.042227    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5fcbd9fc8-rpsqc_d8601564-35c8-4f57-8d1d-52f21dd85944/manager/0.log"
Jul 10 03:01:59.517813 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:59.517723    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f74c66c44-rqdgn_1130e493-92c1-4e54-8712-aad48a9ae4e7/kube-auth-proxy/0.log"
Jul 10 03:01:59.561637 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:59.561599    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-wtrvc_39e8a37e-529a-428d-86a0-2e62d76ebe5d/payload-pre-processing/0.log"
Jul 10 03:01:59.599115 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:01:59.599083    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54684b4666-zv2d2_449265a9-3f9e-4ef4-aec7-3439a8a67b57/router/0.log"
Jul 10 03:02:01.084351 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:01.084319    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f74c66c44-rqdgn_1130e493-92c1-4e54-8712-aad48a9ae4e7/kube-auth-proxy/0.log"
Jul 10 03:02:01.133878 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:01.133789    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-wtrvc_39e8a37e-529a-428d-86a0-2e62d76ebe5d/payload-pre-processing/0.log"
Jul 10 03:02:01.166216 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:01.166182    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54684b4666-zv2d2_449265a9-3f9e-4ef4-aec7-3439a8a67b57/router/0.log"
Jul 10 03:02:04.711579 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:04.711553    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fcbt_6dbcad3f-1a69-439e-8a77-08a0a8d1100a/kube-multus-additional-cni-plugins/0.log"
Jul 10 03:02:04.733244 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:04.733213    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fcbt_6dbcad3f-1a69-439e-8a77-08a0a8d1100a/egress-router-binary-copy/0.log"
Jul 10 03:02:04.755049 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:04.755023    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fcbt_6dbcad3f-1a69-439e-8a77-08a0a8d1100a/cni-plugins/0.log"
Jul 10 03:02:04.775634 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:04.775607    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fcbt_6dbcad3f-1a69-439e-8a77-08a0a8d1100a/bond-cni-plugin/0.log"
Jul 10 03:02:04.799315 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:04.799288    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fcbt_6dbcad3f-1a69-439e-8a77-08a0a8d1100a/routeoverride-cni/0.log"
Jul 10 03:02:04.819249 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:04.819225    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fcbt_6dbcad3f-1a69-439e-8a77-08a0a8d1100a/whereabouts-cni-bincopy/0.log"
Jul 10 03:02:04.841875 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:04.841846    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8fcbt_6dbcad3f-1a69-439e-8a77-08a0a8d1100a/whereabouts-cni/0.log"
Jul 10 03:02:05.222203 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:05.222171    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mxc72_acc07a04-b6d3-4e2a-8912-c15de0d911d4/kube-multus/0.log"
Jul 10 03:02:05.244736 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:05.244701    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9hsmb_a6c70eaf-2325-49b0-9841-adc56047391a/network-metrics-daemon/0.log"
Jul 10 03:02:05.262885 ip-10-0-130-224 kubenswrapper[2553]: I0710 03:02:05.262858    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9hsmb_a6c70eaf-2325-49b0-9841-adc56047391a/kube-rbac-proxy/0.log"