Jul 23 15:48:07.236231 ip-10-0-135-218 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 23 15:48:07.236243 ip-10-0-135-218 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 23 15:48:07.236250 ip-10-0-135-218 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 23 15:48:07.236469 ip-10-0-135-218 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 23 15:48:18.500576 ip-10-0-135-218 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 23 15:48:18.500595 ip-10-0-135-218 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d09509773a00467faeb83cd940a36708 --
Jul 23 15:50:13.959626 ip-10-0-135-218 systemd[1]: Starting Kubernetes Kubelet...
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.340897    2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346554    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346571    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346580    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346587    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346592    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346596    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346600    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:50:14.458388 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346603    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:50:14.421938 ip-10-0-135-218 systemd[1]: Started Kubernetes Kubelet.
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346606    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346609    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346614    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346617    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346621    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346624    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346627    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346629    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346632    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346635    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346637    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346640    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346642    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346645    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346648    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346652    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346654    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346657    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:50:14.676418 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346660    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346663    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346666    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346668    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346671    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346674    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346678    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346681    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346685    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346687    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346690    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346693    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346695    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346698    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346701    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346703    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346706    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346708    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346711    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346714    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:50:14.686673 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346717    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346720    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346723    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346725    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346728    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346730    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346733    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346736    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346739    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346742    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346745    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346748    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346751    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346754    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346757    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346760    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346762    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346766    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346768    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346772    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:50:14.687435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346775    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346777    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346780    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346782    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346786    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346788    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346791    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346793    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346796    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346799    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346802    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346806    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346810    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346813    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346817    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346819    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346822    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346825    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346827    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:50:14.688136 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346830    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346832    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346835    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346838    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346841    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346843    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346846    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346849    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346852    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346855    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346858    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346860    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346863    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.346866    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348183    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348192    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348197    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348200    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348203    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348205    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:50:14.688782 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348208    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348211    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348214    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348217    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348220    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348223    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348226    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348229    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348231    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348234    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348237    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348239    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348242    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348245    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348248    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348251    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348253    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348256    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348260    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348264    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:50:14.689485 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348267    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348271    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348273    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348276    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348279    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348281    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348284    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348287    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348290    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348293    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348295    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348301    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348304    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348306    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348309    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348311    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348315    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348317    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348320    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:50:14.690146 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348323    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348326    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348328    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348333    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348336    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348339    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348342    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348345    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348348    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348350    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348353    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348355    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348358    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348362    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348364    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348368    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348370    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348373    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348376    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:50:14.690771 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348378    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348381    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348383    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348386    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348389    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348394    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348396    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348399    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348401    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348404    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348406    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348409    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348413    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348416    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348419    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348422    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348426    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348431    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348433    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348436    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:50:14.691411 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348438    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348441    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348444    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348446    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348449    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348452    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348454    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348457    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348459    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348462    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348465    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348468    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348471    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348473    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348475    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348873    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348878    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348884    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348887    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348889    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:50:14.692499 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348893    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348895    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348898    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348901    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348903    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348906    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348909    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348911    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348914    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348918    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348921    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348923    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348926    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348928    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348931    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348934    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348936    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348939    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348941    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348944    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:50:14.693161 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348947    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348950    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348953    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348955    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348958    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348960    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348963    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348966    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348969    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348972    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348975    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348979    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348983    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348987    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348990    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348993    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.348997    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349001    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349004    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:50:14.693824 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349022    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349025    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349029    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349032    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349035    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349037    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349040    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349042    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349045    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349048    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349050    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349053    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349055    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349058    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349062    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349066    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349070    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349072    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349075    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349078    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:50:14.694468 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349080    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349083    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349087    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349090    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349092    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349095    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349097    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349100    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349102    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349105    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349107    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349110    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349113    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349116    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349120    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349123    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349126    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349128    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349131    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349133    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:50:14.695296 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349136    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349138    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349141    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349143    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349146    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349149    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349151    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349153    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349157    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349159    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349161    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349164    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349166    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349169    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349172    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349255    2570 flags.go:64] FLAG: --address="0.0.0.0"
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349265    2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349274    2570 flags.go:64] FLAG: --anonymous-auth="true"
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349281    2570 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349287    2570 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349292    2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 23 15:50:14.695862 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349298    2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349302    2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349306    2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349309    2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349313    2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349318    2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349321    2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349324    2570 flags.go:64] FLAG: --cgroup-root=""
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349327    2570 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349330    2570 flags.go:64] FLAG: --client-ca-file=""
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349333    2570 flags.go:64] FLAG: --cloud-provider="external"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349336    2570 flags.go:64] FLAG: --cluster-dns="[]"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349341    2570 flags.go:64] FLAG: --cluster-domain=""
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349344    2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349348    2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349352    2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349356    2570 flags.go:64] FLAG: --container-log-max-files="5"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349360    2570 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349363    2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349366    2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349370    2570 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349373    2570 flags.go:64] FLAG: --contention-profiling="false"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349377    2570 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349380    2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 23 15:50:14.696521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349383    2570 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349387    2570 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349392    2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349395    2570 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349398    2570 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349401    2570 flags.go:64] FLAG: --enable-load-reader="false"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349404    2570 flags.go:64] FLAG: --enable-server="true"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349407    2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349411    2570 flags.go:64] FLAG: --event-burst="100"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349415    2570 flags.go:64] FLAG: --event-qps="50"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349418    2570 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349421    2570 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349424    2570 flags.go:64] FLAG: --eviction-hard=""
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349430    2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349433    2570 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349436    2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349439    2570 flags.go:64] FLAG: --eviction-soft=""
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349442    2570 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349445    2570 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349448    2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349451    2570 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349455    2570 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349457    2570 flags.go:64] FLAG: --fail-swap-on="true"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349461    2570 flags.go:64] FLAG: --feature-gates=""
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349465    2570 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 23 15:50:14.697199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349468    2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349471    2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349475    2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349478    2570 flags.go:64] FLAG: --healthz-port="10248"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349482    2570 flags.go:64] FLAG: --help="false"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349485    2570 flags.go:64] FLAG: --hostname-override="ip-10-0-135-218.ec2.internal"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349488    2570 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349491    2570 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349495    2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349499    2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349502    2570 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349505    2570 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349508    2570 flags.go:64] FLAG: --image-service-endpoint=""
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349511    2570 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349514    2570 flags.go:64] FLAG: --kube-api-burst="100"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349518    2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349521    2570 flags.go:64] FLAG: --kube-api-qps="50"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349524    2570 flags.go:64] FLAG: --kube-reserved=""
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349527    2570 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349530    2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349534    2570 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349537    2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349540    2570 flags.go:64] FLAG: --lock-file=""
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349543    2570 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 23 15:50:14.697947 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349546    2570 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349549    2570 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349555    2570 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349558    2570 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349561    2570 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349563    2570 flags.go:64] FLAG: --logging-format="text"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349566    2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349570    2570 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349572    2570 flags.go:64] FLAG: --manifest-url=""
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349575    2570 flags.go:64] FLAG: --manifest-url-header=""
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349580    2570 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349583    2570 flags.go:64] FLAG: --max-open-files="1000000"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349587    2570 flags.go:64] FLAG: --max-pods="110"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349590    2570 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349593    2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349596    2570 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349601    2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349604    2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349606    2570 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349609    2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349618    2570 flags.go:64] FLAG: --node-status-max-images="50"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349622    2570 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349625    2570 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 23 15:50:14.698659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349628    2570 flags.go:64] FLAG: --pod-cidr=""
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349631    2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349637    2570 flags.go:64] FLAG: --pod-manifest-path=""
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349640    2570 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349643    2570 flags.go:64] FLAG: --pods-per-core="0"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349649    2570 flags.go:64] FLAG: --port="10250"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349652    2570 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349655    2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ef491ca6ea8f3828"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349658    2570 flags.go:64] FLAG: --qos-reserved=""
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349661    2570 flags.go:64] FLAG: --read-only-port="10255"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349664    2570 flags.go:64] FLAG: --register-node="true"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349667    2570 flags.go:64] FLAG: --register-with-taints=""
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349671    2570 flags.go:64] FLAG: --registry-burst="10"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349674    2570 flags.go:64] FLAG: --registry-qps="5"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349677    2570 flags.go:64] FLAG: --reserved-cpus=""
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349680    2570 flags.go:64] FLAG: --reserved-memory=""
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349684    2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349687    2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349690    2570 flags.go:64] FLAG: --rotate-certificates="false"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349693    2570 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349696    2570 flags.go:64] FLAG: --runonce="false"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349699    2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349702    2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349706    2570 flags.go:64] FLAG: --seccomp-default="false"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349709    2570 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 23 15:50:14.699534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349712    2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349716    2570 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349720    2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349723    2570 flags.go:64] FLAG: --storage-driver-password="root"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349726    2570 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349729    2570 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349732    2570 flags.go:64] FLAG: --storage-driver-user="root"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349735    2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349738    2570 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349741    2570 flags.go:64] FLAG: --system-cgroups=""
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349744    2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349749    2570 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349754    2570 flags.go:64] FLAG: --tls-cert-file=""
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349756    2570 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349761    2570 flags.go:64] FLAG: --tls-min-version=""
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349764    2570 flags.go:64] FLAG: --tls-private-key-file=""
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349767    2570 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349770    2570 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349773    2570 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349776    2570 flags.go:64] FLAG: --v="2"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349780    2570 flags.go:64] FLAG: --version="false"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349784    2570 flags.go:64] FLAG: --vmodule=""
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349788    2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.349791    2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349960    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:50:14.700643 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349967    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349970    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349974    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349977    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349980    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349983    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349992    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349994    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.349998    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350001    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350004    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350026    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350030    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350033    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350035    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350038    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350041    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350044    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350046    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350050    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:50:14.701670 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350053    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350056    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350059    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350061    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350064    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350067    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350069    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350072    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350074    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350077    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350079    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350082    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350085    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350088    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350091    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350093    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350096    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350098    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350101    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350111    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:50:14.903423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350115    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350118    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350121    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350124    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350128    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350131    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350134    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350136    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350139    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350142    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350144    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350148    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350151    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350154    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350156    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350159    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350161    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350164    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350167    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:50:14.904193 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350169    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350172    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350175    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350177    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350180    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350182    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350185    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350187    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350190    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350194    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350197    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350200    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350203    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350213    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350216    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350219    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350222    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350224    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350227    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:50:14.904852 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350229    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350232    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350235    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350237    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350240    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350244    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350247    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350249    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350252    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350254    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350257    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350260    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350263    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350266    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350270    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350273    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350276    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350278    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350281    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:50:14.905453 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.350284    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.350880    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.362728    2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.362748    2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.362775    2570 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.362780    2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362847    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362854    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362860    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362864    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362867    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362871    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362876    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362881    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:50:14.906006 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362884    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362887    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362890    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362893    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362897    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362900    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362903    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362905    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362908    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362911    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362913    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362916    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362919    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362922    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362925    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362928    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362930    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362933    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362936    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362938    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:50:14.906526 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362941    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362944    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362947    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362951    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362955    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362959    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362963    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362965    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362968    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362972    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362975    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362978    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362981    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362983    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362986    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362988    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362992    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362995    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.362998    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:50:14.907113 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363001    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363003    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363023    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363028    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363032    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363035    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363039    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363042    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363045    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363047    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363050    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363053    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363055    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363058    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363060    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363063    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363066    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363068    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363071    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363075    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:50:14.907691 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363078    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363080    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363083    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363086    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363088    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363091    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363094    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363101    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363106    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363112    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363115    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363125    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363130    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363133    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363137    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363140    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363142    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363145    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363148    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:50:14.908302 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363150    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363153    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363155    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363158    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363161    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363164    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363166    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363169    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363173    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363177    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363181    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363185    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363189    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.363195    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363324    2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 23 15:50:14.908884 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363333    2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363338    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363342    2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363344    2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363347    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363350    2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363353    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363357    2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363360    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363362    2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363365    2570 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363368    2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363371    2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363373    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363376    2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363378    2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363381    2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363384    2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363386    2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363389    2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 23 15:50:14.909351 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363391    2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363394    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363396    2570 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363399    2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363402    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363405    2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363409    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363414    2570 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363420    2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363425    2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363430    2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363433    2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363436    2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363439    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363441    2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363443    2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363446    2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363448    2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363451    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363455    2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 23 15:50:14.909943 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363458    2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363461    2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363463    2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363466    2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363469    2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363472    2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363475    2570 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363477    2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363480    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363484    2570 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363488    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363493    2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363496    2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363499    2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363503    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363506    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363509    2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363511    2570 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363514    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 23 15:50:14.910538 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363517    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363520    2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363523    2570 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363526    2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363529    2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363532    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363535    2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363537    2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363540    2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363542    2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363545    2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363547    2570 feature_gate.go:328] unrecognized feature gate: Example
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363551    2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363554    2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363556    2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363560    2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363564    2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363568    2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363574    2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363576    2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 23 15:50:14.911133 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363579    2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363581    2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363583    2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363586    2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363589    2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363591    2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363594    2570 feature_gate.go:328] unrecognized feature gate: Example2
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363596    2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363599    2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363603    2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363606    2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363609    2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363612    2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363614    2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363617    2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363622    2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363624    2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363627    2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 23 15:50:14.911715 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:14.363630    2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 23 15:50:14.912269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.363638    2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 23 15:50:14.912269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.363785    2570 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 23 15:50:14.912269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.366245    2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 23 15:50:14.912269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.367799    2570 server.go:1019] "Starting client certificate rotation"
Jul 23 15:50:14.912269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.367905    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 15:50:14.912269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.367942    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 23 15:50:14.912269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.370252    2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 15:50:14.912269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.371709    2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 23 15:50:14.912269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.381484    2570 log.go:25] "Validated CRI v1 runtime API"
Jul 23 15:50:14.912269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.385505    2570 log.go:25] "Validated CRI v1 image API"
Jul 23 15:50:14.912269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.386400    2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 23 15:50:14.912269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.393306    2570 fs.go:135] Filesystem UUIDs: map[58208d0f-2d46-4fff-8032-97f7d158dfff:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b053bf53-d3d2-4903-b6b0-cfef8291cd07:/dev/nvme0n1p4]
Jul 23 15:50:14.912654 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.393325    2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 23 15:50:14.912765 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.399722    2570 manager.go:216] Machine: {Timestamp:2026-07-23 15:50:14.398515907 +0000 UTC m=+0.322370532 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102977 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a5d38b55242e4005ac87019ebbc37 SystemUUID:ec2a5d38-b552-42e4-005a-c87019ebbc37 BootID:d0950977-3a00-467f-aeb8-3cd940a36708 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:72:86:6f:29:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:72:86:6f:29:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:8d:72:d8:35:d9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 23 15:50:14.912765 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.399837    2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 23 15:50:14.912765 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.399926    2570 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 23 15:50:14.912765 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.403512    2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 23 15:50:14.912765 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.403753    2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-218.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 23 15:50:14.912765 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.404320    2570 topology_manager.go:138] "Creating topology manager with none policy"
Jul 23 15:50:14.912765 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.404332    2570 container_manager_linux.go:309] "Creating device plugin manager"
Jul 23 15:50:14.912765 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.404340    2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.404356    2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.405062    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.406050    2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.409556    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.409687    2570 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.409714    2570 kubelet.go:486] "Attempting to sync node with API server"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.409724    2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.409735    2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.409744    2570 kubelet.go:398] "Adding apiserver pod source"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.409753    2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.410173    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.410191    2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.412318    2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.415038    2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.415066    2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.416364    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.416378    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.416384    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.416391    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.416403    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.416412    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.416421    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.416428    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.416434    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.416440    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.416458    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.416465    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.417255    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.417265    2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.419398    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.419403    2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-218.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.419526    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.420681    2570 server.go:1268] "Started kubelet"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.422272    2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.424004    2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.424104    2570 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.425419    2570 server.go:310] "Adding debug handlers to kubelet server"
Jul 23 15:50:14.913057 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.425461    2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.428671    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-218.ec2.internal.18c4f5fbdbe93867  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-218.ec2.internal,UID:ip-10-0-135-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-218.ec2.internal,},FirstTimestamp:2026-07-23 15:50:14.420650087 +0000 UTC m=+0.344504712,LastTimestamp:2026-07-23 15:50:14.420650087 +0000 UTC m=+0.344504712,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-218.ec2.internal,}"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.430665    2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.433655    2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.433676    2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.433797    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.434646    2570 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.434667    2570 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.434651    2570 factory.go:55] Registering systemd factory
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.434709    2570 factory.go:223] Registration of the systemd container factory successfully
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.434803    2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.434805    2570 reconstruct.go:97] "Volume reconstruction finished"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.434828    2570 reconciler.go:29] "Reconciler: start to sync state"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.434950    2570 factory.go:153] Registering CRI-O factory
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.434965    2570 factory.go:223] Registration of the crio container factory successfully
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.435056    2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.435083    2570 factory.go:103] Registering Raw factory
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.435118    2570 manager.go:1196] Started watching for new ooms in manager
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.435626    2570 manager.go:349] Starting recovery of all containers
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.441565    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c4rhf"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.448779    2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.448905    2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-218.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.452233    2570 manager.go:354] Recovery completed
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.452418    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c4rhf"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.457484    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.459768    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.459811    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.459829    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.460414    2570 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.460425    2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.460441    2570 state_mem.go:36] "Initialized new in-memory state store"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.460467    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:14.914217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.461132    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.461162    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.461175    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.461551    2570 policy_none.go:49] "None policy: Start"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.461567    2570 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.461578    2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.462241    2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-218.ec2.internal.18c4f5fbde3e6c5c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-218.ec2.internal,UID:ip-10-0-135-218.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-218.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-218.ec2.internal,},FirstTimestamp:2026-07-23 15:50:14.45978838 +0000 UTC m=+0.383643010,LastTimestamp:2026-07-23 15:50:14.45978838 +0000 UTC m=+0.383643010,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-218.ec2.internal,}"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.462701    2570 policy_none.go:47] "Start"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.514903    2570 manager.go:337] "Starting Device Plugin manager"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.514945    2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.514956    2570 server.go:87] "Starting device plugin registration server"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.515273    2570 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.515284    2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.515471    2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.515623    2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.515633    2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.516257    2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.516309    2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.594990    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.596384    2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.596421    2570 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.596454    2570 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.596501    2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.598918    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.615905    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.616979    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.617012    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.617038    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.617066    2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.624756    2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.624785    2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-218.ec2.internal\": node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.640347    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.697317    2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal"]
Jul 23 15:50:15.145912 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.697419    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.699097    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.699129    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.699140    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.700492    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.700647    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.700683    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.701442    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.701468    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.701478    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.702153    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.702188    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.702207    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.702698    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.702726    2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.703552    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientMemory"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.703590    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasNoDiskPressure"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.703604    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeHasSufficientPID"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.731233    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-218.ec2.internal\" not found" node="ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.736082    2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-218.ec2.internal\" not found" node="ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.737178    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b336876c7020fb78e54d8649d256ea31-config\") pod \"kube-apiserver-proxy-ip-10-0-135-218.ec2.internal\" (UID: \"b336876c7020fb78e54d8649d256ea31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.737206    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ddef1e22938f212ae084186c40fb22a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"1ddef1e22938f212ae084186c40fb22a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.737229    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ddef1e22938f212ae084186c40fb22a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"1ddef1e22938f212ae084186c40fb22a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.740702    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.147747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.837925    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ddef1e22938f212ae084186c40fb22a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"1ddef1e22938f212ae084186c40fb22a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.149410 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.837959    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ddef1e22938f212ae084186c40fb22a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"1ddef1e22938f212ae084186c40fb22a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.149410 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.837978    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b336876c7020fb78e54d8649d256ea31-config\") pod \"kube-apiserver-proxy-ip-10-0-135-218.ec2.internal\" (UID: \"b336876c7020fb78e54d8649d256ea31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.149410 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.838010    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b336876c7020fb78e54d8649d256ea31-config\") pod \"kube-apiserver-proxy-ip-10-0-135-218.ec2.internal\" (UID: \"b336876c7020fb78e54d8649d256ea31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.149410 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.838038    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ddef1e22938f212ae084186c40fb22a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"1ddef1e22938f212ae084186c40fb22a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.149410 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:14.838043    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ddef1e22938f212ae084186c40fb22a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal\" (UID: \"1ddef1e22938f212ae084186c40fb22a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.149410 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.840803    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.149410 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:14.940937    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.149410 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.040817    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.149410 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.040849    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:15.149410 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:15.042053    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.149410 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:15.142997    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.391737 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:15.243383    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.391737 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.272604    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:15.391737 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.325063    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:15.391737 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:15.344472    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.391737 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.368270    2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 23 15:50:15.391737 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.368467    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 15:50:15.391737 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.368475    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 15:50:15.391737 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.368488    2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 23 15:50:15.596572 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:15.444990    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.596572 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.457906    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 15:45:14 +0000 UTC" deadline="2028-02-21 04:39:00.992277579 +0000 UTC"
Jul 23 15:50:15.596572 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.457954    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13860h48m45.534326679s"
Jul 23 15:50:15.596572 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:15.545092    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.795540 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:15.645820    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:15.795540 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:15.655856    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb336876c7020fb78e54d8649d256ea31.slice/crio-f7c37ae9217061108aa50b80086500391d9d187874b5412bbf0ba875d605710f WatchSource:0}: Error finding container f7c37ae9217061108aa50b80086500391d9d187874b5412bbf0ba875d605710f: Status 404 returned error can't find the container with id f7c37ae9217061108aa50b80086500391d9d187874b5412bbf0ba875d605710f
Jul 23 15:50:15.795540 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.660972    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:50:15.795540 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:15.746735    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:16.025396 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:15.847716    2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-218.ec2.internal\" not found"
Jul 23 15:50:16.025396 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.915892    2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:16.025396 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.934450    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:16.025396 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.945846    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 15:50:16.025396 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.947104    2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal"
Jul 23 15:50:16.025396 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:15.958175    2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 23 15:50:16.260184 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:16.179939    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ddef1e22938f212ae084186c40fb22a.slice/crio-e664b80dde800460080c67ba9cf270aaf218cd45976c28bae7916e5cab46bbfd WatchSource:0}: Error finding container e664b80dde800460080c67ba9cf270aaf218cd45976c28bae7916e5cab46bbfd: Status 404 returned error can't find the container with id e664b80dde800460080c67ba9cf270aaf218cd45976c28bae7916e5cab46bbfd
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.414438    2570 apiserver.go:52] "Watching apiserver"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.423128    2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.423500    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-7cdws","openshift-dns/node-resolver-9k4dp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal","openshift-network-operator/iptables-alerter-p6mmx","openshift-ovn-kubernetes/ovnkube-node-56lz5","kube-system/global-pull-secret-syncer-v7clr","kube-system/konnectivity-agent-6khxq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss","openshift-image-registry/node-ca-vcvbr","openshift-multus/multus-59bvr","openshift-multus/multus-additional-cni-plugins-vlhlb","openshift-multus/network-metrics-daemon-4wml4","openshift-network-diagnostics/network-check-target-fdhds","kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal"]
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.428860    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6khxq"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.430672    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:16.430763    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.432001    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.433281    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p6mmx"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.434474    2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.434633    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.435961    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:16.436040    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.436521    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.436666    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.436744    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4zzrj\""
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.437076    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.437294    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vcvbr"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.437848    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-92z6n\""
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.437919    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.438586    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.438983    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.440177    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9k4dp"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.441546    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.441610    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.441856    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.454114 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.446393    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 23 15:50:16.455610 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.447102    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 23 15:50:16.455610 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.447492    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 23 15:50:16.455610 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.447559    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z2ndl\""
Jul 23 15:50:16.455610 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.447622    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 23 15:50:16.455610 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.448731    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 23 15:50:16.455610 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.448917    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 23 15:50:16.455610 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.448732    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zmdl4\""
Jul 23 15:50:16.458184 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.457599    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 23 15:50:16.458184 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.457608    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 23 15:50:16.458184 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.457648    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 23 15:50:16.458184 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.457846    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nsthw\""
Jul 23 15:50:16.458184 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.457874    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 23 15:50:16.458184 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.458007    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 23 15:50:16.458184 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.458057    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 23 15:50:16.458184 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.458101    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 23 15:50:16.458184 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.458112    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 23 15:50:16.458184 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.458165    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:50:16.458777 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.458261    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.458777 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.458436    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 23 15:50:16.458777 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.458578    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04224bad-0656-4c75-8a5e-070734e85017-iptables-alerter-script\") pod \"iptables-alerter-p6mmx\" (UID: \"04224bad-0656-4c75-8a5e-070734e85017\") " pod="openshift-network-operator/iptables-alerter-p6mmx"
Jul 23 15:50:16.458777 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.458699    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwwh\" (UniqueName: \"kubernetes.io/projected/04224bad-0656-4c75-8a5e-070734e85017-kube-api-access-lgwwh\") pod \"iptables-alerter-p6mmx\" (UID: \"04224bad-0656-4c75-8a5e-070734e85017\") " pod="openshift-network-operator/iptables-alerter-p6mmx"
Jul 23 15:50:16.459304 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.459304 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459160    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-ovnkube-config\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.459304 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459195    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnfnm\" (UniqueName: \"kubernetes.io/projected/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-kube-api-access-qnfnm\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.459304 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459226    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/631c3f7e-3c49-43fe-b4ca-610a73cd960e-dbus\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:16.459304 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459278    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-etc-selinux\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459318    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459338    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459368    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-registration-dir\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459396    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-sys-fs\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:16.459409    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-run-netns\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459451    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-socket-dir\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459472    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-run-openvswitch\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459486    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8dfn9\""
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459530    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-run-ovn\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459573    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-log-socket\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459619    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-ovn-node-metrics-cert\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.459668 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459657    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a54fffa1-1035-4460-929e-bc6c8289348b-konnectivity-ca\") pod \"konnectivity-agent-6khxq\" (UID: \"a54fffa1-1035-4460-929e-bc6c8289348b\") " pod="kube-system/konnectivity-agent-6khxq"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459686    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cps8w\" (UniqueName: \"kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w\") pod \"network-check-target-fdhds\" (UID: \"e95b191f-0eb7-4e14-83a9-ef22527e0036\") " pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459721    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-kubelet\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459754    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-run-systemd\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459783    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-var-lib-openvswitch\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459810    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-node-log\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459838    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-cni-netd\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459865    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-ovnkube-script-lib\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a54fffa1-1035-4460-929e-bc6c8289348b-agent-certs\") pod \"konnectivity-agent-6khxq\" (UID: \"a54fffa1-1035-4460-929e-bc6c8289348b\") " pod="kube-system/konnectivity-agent-6khxq"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459929    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459955    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04224bad-0656-4c75-8a5e-070734e85017-host-slash\") pod \"iptables-alerter-p6mmx\" (UID: \"04224bad-0656-4c75-8a5e-070734e85017\") " pod="openshift-network-operator/iptables-alerter-p6mmx"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.459979    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-etc-openvswitch\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.460035    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-env-overrides\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.460058    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-systemd-units\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.460570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.460082    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-slash\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.461271 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.460104    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-cni-bin\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.461271 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.460127    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/631c3f7e-3c49-43fe-b4ca-610a73cd960e-kubelet-config\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:16.461271 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.460151    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-device-dir\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.461271 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.460175    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-run-ovn-kubernetes\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.461271 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.460252    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtldr\" (UniqueName: \"kubernetes.io/projected/68520f46-5970-4691-834d-b47df20705d9-kube-api-access-jtldr\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.461271 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.460272    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 23 15:50:16.461271 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.460396    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-569r9\""
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.465757    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.470065    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r7jtb\""
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.470241    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.470329    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8mfh4\""
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.470602    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.476401    2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.521092    2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hgpzp"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.532591    2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hgpzp"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.536279    2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.560770    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-run-netns\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.560829    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-hostroot\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.560869    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ecb48312-fb80-4132-9010-86f28d0f9891-multus-daemon-config\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.560902    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-slash\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.560927    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-sysconfig\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.560949    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afbd575c-46b7-4aae-bc60-6c04faa47aef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.560976    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afbd575c-46b7-4aae-bc60-6c04faa47aef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.560999    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs72x\" (UniqueName: \"kubernetes.io/projected/afbd575c-46b7-4aae-bc60-6c04faa47aef-kube-api-access-zs72x\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561022    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-slash\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.663673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561048    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/631c3f7e-3c49-43fe-b4ca-610a73cd960e-kubelet-config\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561092    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-run-ovn-kubernetes\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561143    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-run-ovn-kubernetes\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561152    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/631c3f7e-3c49-43fe-b4ca-610a73cd960e-kubelet-config\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561173    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-os-release\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561191    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afbd575c-46b7-4aae-bc60-6c04faa47aef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561218    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtldr\" (UniqueName: \"kubernetes.io/projected/68520f46-5970-4691-834d-b47df20705d9-kube-api-access-jtldr\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04224bad-0656-4c75-8a5e-070734e85017-iptables-alerter-script\") pod \"iptables-alerter-p6mmx\" (UID: \"04224bad-0656-4c75-8a5e-070734e85017\") " pod="openshift-network-operator/iptables-alerter-p6mmx"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561353    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnfnm\" (UniqueName: \"kubernetes.io/projected/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-kube-api-access-qnfnm\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561422    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-etc-selinux\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561447    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-run\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561451    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561469    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-host\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.665928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561494    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-run-multus-certs\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561522    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-run-netns\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561545    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f807ec5-5297-4b0d-b04e-9250b909df3a-host\") pod \"node-ca-vcvbr\" (UID: \"2f807ec5-5297-4b0d-b04e-9250b909df3a\") " pod="openshift-image-registry/node-ca-vcvbr"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561569    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-run-openvswitch\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561594    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-ovn-node-metrics-cert\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561618    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-ovnkube-script-lib\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561621    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-run-netns\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561623    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-etc-selinux\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561656    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-sysctl-conf\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561666    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-run-openvswitch\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561698    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxnkh\" (UniqueName: \"kubernetes.io/projected/22081b84-205f-4c98-b817-8055589ea584-kube-api-access-fxnkh\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561732    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-system-cni-dir\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561766    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-var-lib-kubelet\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561795    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-kubelet\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.669743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561820    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-run-systemd\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561848    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-node-log\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561859    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-kubelet\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561874    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-run-systemd\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561879    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-multus-cni-dir\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561908    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561939    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04224bad-0656-4c75-8a5e-070734e85017-host-slash\") pod \"iptables-alerter-p6mmx\" (UID: \"04224bad-0656-4c75-8a5e-070734e85017\") " pod="openshift-network-operator/iptables-alerter-p6mmx"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561911    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-node-log\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561966    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2f807ec5-5297-4b0d-b04e-9250b909df3a-serviceca\") pod \"node-ca-vcvbr\" (UID: \"2f807ec5-5297-4b0d-b04e-9250b909df3a\") " pod="openshift-image-registry/node-ca-vcvbr"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.561990    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/04224bad-0656-4c75-8a5e-070734e85017-iptables-alerter-script\") pod \"iptables-alerter-p6mmx\" (UID: \"04224bad-0656-4c75-8a5e-070734e85017\") " pod="openshift-network-operator/iptables-alerter-p6mmx"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562023    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/04224bad-0656-4c75-8a5e-070734e85017-host-slash\") pod \"iptables-alerter-p6mmx\" (UID: \"04224bad-0656-4c75-8a5e-070734e85017\") " pod="openshift-network-operator/iptables-alerter-p6mmx"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562062    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-kubernetes\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562094    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c9wq\" (UniqueName: \"kubernetes.io/projected/ecb48312-fb80-4132-9010-86f28d0f9891-kube-api-access-9c9wq\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562125    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-systemd-units\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.671849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562148    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-cni-bin\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562163    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-modprobe-d\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562179    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-var-lib-cni-multus\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562106    2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eabd10ab-eefb-4fb3-a01f-deb9751c945e-tmp-dir\") pod \"node-resolver-9k4dp\" (UID: \"eabd10ab-eefb-4fb3-a01f-deb9751c945e\") " pod="openshift-dns/node-resolver-9k4dp"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562217    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-systemd-units\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562221    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-device-dir\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562233    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-cni-bin\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562246    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-sysctl-d\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562256    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-ovnkube-script-lib\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562265    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-cnibin\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562267    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-device-dir\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562292    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-multus-conf-dir\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562312    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwkm2\" (UniqueName: \"kubernetes.io/projected/eca674e0-139e-42c0-b87a-03d0e60e43ce-kube-api-access-rwkm2\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:16.672534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562338    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwwh\" (UniqueName: \"kubernetes.io/projected/04224bad-0656-4c75-8a5e-070734e85017-kube-api-access-lgwwh\") pod \"iptables-alerter-p6mmx\" (UID: \"04224bad-0656-4c75-8a5e-070734e85017\") " pod="openshift-network-operator/iptables-alerter-p6mmx"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-ovnkube-config\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562380    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-systemd\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562394    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-sys\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562408    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22081b84-205f-4c98-b817-8055589ea584-tmp\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562426    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/631c3f7e-3c49-43fe-b4ca-610a73cd960e-dbus\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562448    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-var-lib-kubelet\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562469    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-multus-socket-dir-parent\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562494    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6q2f\" (UniqueName: \"kubernetes.io/projected/eabd10ab-eefb-4fb3-a01f-deb9751c945e-kube-api-access-l6q2f\") pod \"node-resolver-9k4dp\" (UID: \"eabd10ab-eefb-4fb3-a01f-deb9751c945e\") " pod="openshift-dns/node-resolver-9k4dp"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562514    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afbd575c-46b7-4aae-bc60-6c04faa47aef-cnibin\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562536    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562556    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-registration-dir\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562582    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-sys-fs\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562607    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-registration-dir\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.673238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562615    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/631c3f7e-3c49-43fe-b4ca-610a73cd960e-dbus\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562644    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xztlh\" (UniqueName: \"kubernetes.io/projected/2f807ec5-5297-4b0d-b04e-9250b909df3a-kube-api-access-xztlh\") pod \"node-ca-vcvbr\" (UID: \"2f807ec5-5297-4b0d-b04e-9250b909df3a\") " pod="openshift-image-registry/node-ca-vcvbr"
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:16.562683    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecb48312-fb80-4132-9010-86f28d0f9891-cni-binary-copy\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562681    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-sys-fs\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:16.562767    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret podName:631c3f7e-3c49-43fe-b4ca-610a73cd960e nodeName:}" failed. No retries permitted until 2026-07-23 15:50:17.062735964 +0000 UTC m=+2.986590593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret") pod "global-pull-secret-syncer-v7clr" (UID: "631c3f7e-3c49-43fe-b4ca-610a73cd960e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562781    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afbd575c-46b7-4aae-bc60-6c04faa47aef-os-release\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562800    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-ovnkube-config\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562801    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afbd575c-46b7-4aae-bc60-6c04faa47aef-cni-binary-copy\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562874    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-socket-dir\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562901    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-run-ovn\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562933    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-log-socket\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562971    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-run-ovn\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562974    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-log-socket\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.673772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.562987    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-lib-modules\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563028    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-socket-dir\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563042    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-run-k8s-cni-cncf-io\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563065    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a54fffa1-1035-4460-929e-bc6c8289348b-konnectivity-ca\") pod \"konnectivity-agent-6khxq\" (UID: \"a54fffa1-1035-4460-929e-bc6c8289348b\") " pod="kube-system/konnectivity-agent-6khxq"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563081    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cps8w\" (UniqueName: \"kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w\") pod \"network-check-target-fdhds\" (UID: \"e95b191f-0eb7-4e14-83a9-ef22527e0036\") " pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563097    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-var-lib-openvswitch\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563117    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-cni-netd\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563133    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-var-lib-cni-bin\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563153    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-etc-kubernetes\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563171    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eabd10ab-eefb-4fb3-a01f-deb9751c945e-hosts-file\") pod \"node-resolver-9k4dp\" (UID: \"eabd10ab-eefb-4fb3-a01f-deb9751c945e\") " pod="openshift-dns/node-resolver-9k4dp"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563197    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afbd575c-46b7-4aae-bc60-6c04faa47aef-system-cni-dir\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563205    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-host-cni-netd\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563224    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a54fffa1-1035-4460-929e-bc6c8289348b-agent-certs\") pod \"konnectivity-agent-6khxq\" (UID: \"a54fffa1-1035-4460-929e-bc6c8289348b\") " pod="kube-system/konnectivity-agent-6khxq"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.674392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563258    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-var-lib-openvswitch\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563293    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-etc-openvswitch\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563301    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/68520f46-5970-4691-834d-b47df20705d9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563406    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-env-overrides\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563445    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-etc-openvswitch\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/22081b84-205f-4c98-b817-8055589ea584-etc-tuned\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.563775    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-env-overrides\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.565806    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-ovn-node-metrics-cert\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.565911    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a54fffa1-1035-4460-929e-bc6c8289348b-agent-certs\") pod \"konnectivity-agent-6khxq\" (UID: \"a54fffa1-1035-4460-929e-bc6c8289348b\") " pod="kube-system/konnectivity-agent-6khxq"
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.567092    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a54fffa1-1035-4460-929e-bc6c8289348b-konnectivity-ca\") pod \"konnectivity-agent-6khxq\" (UID: \"a54fffa1-1035-4460-929e-bc6c8289348b\") " pod="kube-system/konnectivity-agent-6khxq"
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:16.580273    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:16.580293    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:16.580303    2570 projected.go:196] Error preparing data for projected volume kube-api-access-cps8w for pod openshift-network-diagnostics/network-check-target-fdhds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:16.580376    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w podName:e95b191f-0eb7-4e14-83a9-ef22527e0036 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:17.080360521 +0000 UTC m=+3.004215134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cps8w" (UniqueName: "kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w") pod "network-check-target-fdhds" (UID: "e95b191f-0eb7-4e14-83a9-ef22527e0036") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:16.674968 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.583076    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnfnm\" (UniqueName: \"kubernetes.io/projected/b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7-kube-api-access-qnfnm\") pod \"ovnkube-node-56lz5\" (UID: \"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7\") " pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.584284    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtldr\" (UniqueName: \"kubernetes.io/projected/68520f46-5970-4691-834d-b47df20705d9-kube-api-access-jtldr\") pod \"aws-ebs-csi-driver-node-px8ss\" (UID: \"68520f46-5970-4691-834d-b47df20705d9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.584276    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwwh\" (UniqueName: \"kubernetes.io/projected/04224bad-0656-4c75-8a5e-070734e85017-kube-api-access-lgwwh\") pod \"iptables-alerter-p6mmx\" (UID: \"04224bad-0656-4c75-8a5e-070734e85017\") " pod="openshift-network-operator/iptables-alerter-p6mmx"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.601678    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" event={"ID":"1ddef1e22938f212ae084186c40fb22a","Type":"ContainerStarted","Data":"e664b80dde800460080c67ba9cf270aaf218cd45976c28bae7916e5cab46bbfd"}
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.602708    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" event={"ID":"b336876c7020fb78e54d8649d256ea31","Type":"ContainerStarted","Data":"f7c37ae9217061108aa50b80086500391d9d187874b5412bbf0ba875d605710f"}
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.663902    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22081b84-205f-4c98-b817-8055589ea584-tmp\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.663938    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-var-lib-kubelet\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.663955    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-multus-socket-dir-parent\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664030    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-multus-socket-dir-parent\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664080    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6q2f\" (UniqueName: \"kubernetes.io/projected/eabd10ab-eefb-4fb3-a01f-deb9751c945e-kube-api-access-l6q2f\") pod \"node-resolver-9k4dp\" (UID: \"eabd10ab-eefb-4fb3-a01f-deb9751c945e\") " pod="openshift-dns/node-resolver-9k4dp"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664114    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afbd575c-46b7-4aae-bc60-6c04faa47aef-cnibin\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664146    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-var-lib-kubelet\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xztlh\" (UniqueName: \"kubernetes.io/projected/2f807ec5-5297-4b0d-b04e-9250b909df3a-kube-api-access-xztlh\") pod \"node-ca-vcvbr\" (UID: \"2f807ec5-5297-4b0d-b04e-9250b909df3a\") " pod="openshift-image-registry/node-ca-vcvbr"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664207    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecb48312-fb80-4132-9010-86f28d0f9891-cni-binary-copy\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664226    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/afbd575c-46b7-4aae-bc60-6c04faa47aef-cnibin\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.675851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664234    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afbd575c-46b7-4aae-bc60-6c04faa47aef-os-release\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664263    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afbd575c-46b7-4aae-bc60-6c04faa47aef-cni-binary-copy\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664294    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-lib-modules\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664325    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-run-k8s-cni-cncf-io\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664346    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/afbd575c-46b7-4aae-bc60-6c04faa47aef-os-release\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664395    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-run-k8s-cni-cncf-io\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664424    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-var-lib-cni-bin\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-etc-kubernetes\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664481    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eabd10ab-eefb-4fb3-a01f-deb9751c945e-hosts-file\") pod \"node-resolver-9k4dp\" (UID: \"eabd10ab-eefb-4fb3-a01f-deb9751c945e\") " pod="openshift-dns/node-resolver-9k4dp"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664486    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-var-lib-cni-bin\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664508    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afbd575c-46b7-4aae-bc60-6c04faa47aef-system-cni-dir\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664449    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-lib-modules\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664538    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-etc-kubernetes\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/22081b84-205f-4c98-b817-8055589ea584-etc-tuned\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664570    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/eabd10ab-eefb-4fb3-a01f-deb9751c945e-hosts-file\") pod \"node-resolver-9k4dp\" (UID: \"eabd10ab-eefb-4fb3-a01f-deb9751c945e\") " pod="openshift-dns/node-resolver-9k4dp"
Jul 23 15:50:16.676386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-run-netns\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664605    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-hostroot\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664580    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/afbd575c-46b7-4aae-bc60-6c04faa47aef-system-cni-dir\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664645    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-hostroot\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664636    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ecb48312-fb80-4132-9010-86f28d0f9891-multus-daemon-config\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664682    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-sysconfig\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664708    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afbd575c-46b7-4aae-bc60-6c04faa47aef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afbd575c-46b7-4aae-bc60-6c04faa47aef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664766    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs72x\" (UniqueName: \"kubernetes.io/projected/afbd575c-46b7-4aae-bc60-6c04faa47aef-kube-api-access-zs72x\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664780    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ecb48312-fb80-4132-9010-86f28d0f9891-cni-binary-copy\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664795    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-os-release\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664858    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-os-release\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664938    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/afbd575c-46b7-4aae-bc60-6c04faa47aef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664608    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-run-netns\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665060    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-sysconfig\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.679848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665099    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ecb48312-fb80-4132-9010-86f28d0f9891-multus-daemon-config\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.664795    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/afbd575c-46b7-4aae-bc60-6c04faa47aef-cni-binary-copy\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665333    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/afbd575c-46b7-4aae-bc60-6c04faa47aef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665362    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afbd575c-46b7-4aae-bc60-6c04faa47aef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665390    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-run\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665408    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-host\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665432    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-run-multus-certs\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665456    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f807ec5-5297-4b0d-b04e-9250b909df3a-host\") pod \"node-ca-vcvbr\" (UID: \"2f807ec5-5297-4b0d-b04e-9250b909df3a\") " pod="openshift-image-registry/node-ca-vcvbr"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665464    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-host\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665482    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-sysctl-conf\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665503    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-run-multus-certs\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665506    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxnkh\" (UniqueName: \"kubernetes.io/projected/22081b84-205f-4c98-b817-8055589ea584-kube-api-access-fxnkh\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665537    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-run\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665543    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-system-cni-dir\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665580    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-var-lib-kubelet\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.680459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665611    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-multus-cni-dir\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665621    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-system-cni-dir\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665626    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-sysctl-conf\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665636    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665657    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-var-lib-kubelet\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665662    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2f807ec5-5297-4b0d-b04e-9250b909df3a-serviceca\") pod \"node-ca-vcvbr\" (UID: \"2f807ec5-5297-4b0d-b04e-9250b909df3a\") " pod="openshift-image-registry/node-ca-vcvbr"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-kubernetes\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665751    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2f807ec5-5297-4b0d-b04e-9250b909df3a-host\") pod \"node-ca-vcvbr\" (UID: \"2f807ec5-5297-4b0d-b04e-9250b909df3a\") " pod="openshift-image-registry/node-ca-vcvbr"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:16.666163    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:16.666228    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs podName:eca674e0-139e-42c0-b87a-03d0e60e43ce nodeName:}" failed. No retries permitted until 2026-07-23 15:50:17.1662109 +0000 UTC m=+3.090065518 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs") pod "network-metrics-daemon-4wml4" (UID: "eca674e0-139e-42c0-b87a-03d0e60e43ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.665706    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c9wq\" (UniqueName: \"kubernetes.io/projected/ecb48312-fb80-4132-9010-86f28d0f9891-kube-api-access-9c9wq\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.666361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-modprobe-d\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.666397    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-var-lib-cni-multus\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.666429    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eabd10ab-eefb-4fb3-a01f-deb9751c945e-tmp-dir\") pod \"node-resolver-9k4dp\" (UID: \"eabd10ab-eefb-4fb3-a01f-deb9751c945e\") " pod="openshift-dns/node-resolver-9k4dp"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.666720    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eabd10ab-eefb-4fb3-a01f-deb9751c945e-tmp-dir\") pod \"node-resolver-9k4dp\" (UID: \"eabd10ab-eefb-4fb3-a01f-deb9751c945e\") " pod="openshift-dns/node-resolver-9k4dp"
Jul 23 15:50:16.681945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.666755    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2f807ec5-5297-4b0d-b04e-9250b909df3a-serviceca\") pod \"node-ca-vcvbr\" (UID: \"2f807ec5-5297-4b0d-b04e-9250b909df3a\") " pod="openshift-image-registry/node-ca-vcvbr"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.666782    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-multus-cni-dir\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.666853    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-kubernetes\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.666880    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-modprobe-d\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.666926    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/22081b84-205f-4c98-b817-8055589ea584-etc-tuned\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.666931    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-host-var-lib-cni-multus\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667003    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22081b84-205f-4c98-b817-8055589ea584-tmp\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667091    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-sysctl-d\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667127    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-cnibin\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667156    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/afbd575c-46b7-4aae-bc60-6c04faa47aef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667163    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-multus-conf-dir\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667197    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwkm2\" (UniqueName: \"kubernetes.io/projected/eca674e0-139e-42c0-b87a-03d0e60e43ce-kube-api-access-rwkm2\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667239    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-cnibin\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667243    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-systemd\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667376    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-sysctl-d\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.799157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667282    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-sys\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667469    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-etc-systemd\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667558    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ecb48312-fb80-4132-9010-86f28d0f9891-multus-conf-dir\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.667640    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22081b84-205f-4c98-b817-8055589ea584-sys\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.673880    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6q2f\" (UniqueName: \"kubernetes.io/projected/eabd10ab-eefb-4fb3-a01f-deb9751c945e-kube-api-access-l6q2f\") pod \"node-resolver-9k4dp\" (UID: \"eabd10ab-eefb-4fb3-a01f-deb9751c945e\") " pod="openshift-dns/node-resolver-9k4dp"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.674836    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xztlh\" (UniqueName: \"kubernetes.io/projected/2f807ec5-5297-4b0d-b04e-9250b909df3a-kube-api-access-xztlh\") pod \"node-ca-vcvbr\" (UID: \"2f807ec5-5297-4b0d-b04e-9250b909df3a\") " pod="openshift-image-registry/node-ca-vcvbr"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.676999    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c9wq\" (UniqueName: \"kubernetes.io/projected/ecb48312-fb80-4132-9010-86f28d0f9891-kube-api-access-9c9wq\") pod \"multus-59bvr\" (UID: \"ecb48312-fb80-4132-9010-86f28d0f9891\") " pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.677848    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs72x\" (UniqueName: \"kubernetes.io/projected/afbd575c-46b7-4aae-bc60-6c04faa47aef-kube-api-access-zs72x\") pod \"multus-additional-cni-plugins-vlhlb\" (UID: \"afbd575c-46b7-4aae-bc60-6c04faa47aef\") " pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.681413    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwkm2\" (UniqueName: \"kubernetes.io/projected/eca674e0-139e-42c0-b87a-03d0e60e43ce-kube-api-access-rwkm2\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.681957    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxnkh\" (UniqueName: \"kubernetes.io/projected/22081b84-205f-4c98-b817-8055589ea584-kube-api-access-fxnkh\") pod \"tuned-7cdws\" (UID: \"22081b84-205f-4c98-b817-8055589ea584\") " pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.738413    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6khxq"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:16.749212    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda54fffa1_1035_4460_929e_bc6c8289348b.slice/crio-406dd8142bafadf873f3792bbb6943bcd0ee41d8de97d582a739d39eaf4b104c WatchSource:0}: Error finding container 406dd8142bafadf873f3792bbb6943bcd0ee41d8de97d582a739d39eaf4b104c: Status 404 returned error can't find the container with id 406dd8142bafadf873f3792bbb6943bcd0ee41d8de97d582a739d39eaf4b104c
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.758386    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:16.767915    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68520f46_5970_4691_834d_b47df20705d9.slice/crio-dee97c529392231a7d99c21831b0c9072cb82ba7fed236d6db00e9ecc33e9995 WatchSource:0}: Error finding container dee97c529392231a7d99c21831b0c9072cb82ba7fed236d6db00e9ecc33e9995: Status 404 returned error can't find the container with id dee97c529392231a7d99c21831b0c9072cb82ba7fed236d6db00e9ecc33e9995
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.772117    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p6mmx"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.772183    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.776885    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vcvbr"
Jul 23 15:50:16.805746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.783511    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7cdws"
Jul 23 15:50:16.807304 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:16.788161    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04224bad_0656_4c75_8a5e_070734e85017.slice/crio-216a0edc962e6fd58c09b370974560ac80c7b88936b33cf112c216fe63643cbc WatchSource:0}: Error finding container 216a0edc962e6fd58c09b370974560ac80c7b88936b33cf112c216fe63643cbc: Status 404 returned error can't find the container with id 216a0edc962e6fd58c09b370974560ac80c7b88936b33cf112c216fe63643cbc
Jul 23 15:50:16.807304 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.791760    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9k4dp"
Jul 23 15:50:16.807304 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:16.793575    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb60e3acf_c04e_4c3e_9e2a_ae41a9f7efd7.slice/crio-d58fb779c69f6af7c928b070e958b79ed67ef529bd5223483b89bb1664bbefb0 WatchSource:0}: Error finding container d58fb779c69f6af7c928b070e958b79ed67ef529bd5223483b89bb1664bbefb0: Status 404 returned error can't find the container with id d58fb779c69f6af7c928b070e958b79ed67ef529bd5223483b89bb1664bbefb0
Jul 23 15:50:16.807304 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:16.794539    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f807ec5_5297_4b0d_b04e_9250b909df3a.slice/crio-4cb4f0bd7780ad5599cda498316e07dcc2bf83c96f7bee4ece35e58d3906301a WatchSource:0}: Error finding container 4cb4f0bd7780ad5599cda498316e07dcc2bf83c96f7bee4ece35e58d3906301a: Status 404 returned error can't find the container with id 4cb4f0bd7780ad5599cda498316e07dcc2bf83c96f7bee4ece35e58d3906301a
Jul 23 15:50:16.807304 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.797480    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-59bvr"
Jul 23 15:50:16.807304 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.806716    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vlhlb"
Jul 23 15:50:16.811047 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:16.809338    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeabd10ab_eefb_4fb3_a01f_deb9751c945e.slice/crio-551c19d30c919d22fb6eff55e733a706812ba3678d80d971a8f789e2d03ae0ac WatchSource:0}: Error finding container 551c19d30c919d22fb6eff55e733a706812ba3678d80d971a8f789e2d03ae0ac: Status 404 returned error can't find the container with id 551c19d30c919d22fb6eff55e733a706812ba3678d80d971a8f789e2d03ae0ac
Jul 23 15:50:16.922007 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:16.921277    2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:17.125243 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.093396    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:17.125243 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.093438    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cps8w\" (UniqueName: \"kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w\") pod \"network-check-target-fdhds\" (UID: \"e95b191f-0eb7-4e14-83a9-ef22527e0036\") " pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:17.125243 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:17.093555    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:17.125243 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:17.093624    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret podName:631c3f7e-3c49-43fe-b4ca-610a73cd960e nodeName:}" failed. No retries permitted until 2026-07-23 15:50:18.093602122 +0000 UTC m=+4.017456757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret") pod "global-pull-secret-syncer-v7clr" (UID: "631c3f7e-3c49-43fe-b4ca-610a73cd960e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:17.125243 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:17.093562    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:17.125243 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:17.093682    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:17.125243 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:17.093702    2570 projected.go:196] Error preparing data for projected volume kube-api-access-cps8w for pod openshift-network-diagnostics/network-check-target-fdhds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:17.125243 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:17.093757    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w podName:e95b191f-0eb7-4e14-83a9-ef22527e0036 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:18.093742144 +0000 UTC m=+4.017596756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cps8w" (UniqueName: "kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w") pod "network-check-target-fdhds" (UID: "e95b191f-0eb7-4e14-83a9-ef22527e0036") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:17.194499 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.194460    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:17.194672 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:17.194616    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:17.194715 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:17.194679    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs podName:eca674e0-139e-42c0-b87a-03d0e60e43ce nodeName:}" failed. No retries permitted until 2026-07-23 15:50:18.194662898 +0000 UTC m=+4.118517510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs") pod "network-metrics-daemon-4wml4" (UID: "eca674e0-139e-42c0-b87a-03d0e60e43ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:17.430097 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.429999    2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:17.534784 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.534740    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 15:45:16 +0000 UTC" deadline="2028-05-04 22:17:23.599328282 +0000 UTC"
Jul 23 15:50:17.534784 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.534782    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15630h27m6.064550729s"
Jul 23 15:50:17.596977 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.596942    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:17.597184 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:17.597094    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:17.614513 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.614454    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-59bvr" event={"ID":"ecb48312-fb80-4132-9010-86f28d0f9891","Type":"ContainerStarted","Data":"fd5614dcb36a8d1ea1b50eb30df6cfba131b3eb85688b95b241d74464336dc12"}
Jul 23 15:50:17.617313 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.617279    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7cdws" event={"ID":"22081b84-205f-4c98-b817-8055589ea584","Type":"ContainerStarted","Data":"ae77022c49f31e561844f9603275ea7e7bd03fd224b7054a5b1eacb14b8bbb7d"}
Jul 23 15:50:17.620702 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.620661    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vcvbr" event={"ID":"2f807ec5-5297-4b0d-b04e-9250b909df3a","Type":"ContainerStarted","Data":"4cb4f0bd7780ad5599cda498316e07dcc2bf83c96f7bee4ece35e58d3906301a"}
Jul 23 15:50:17.623269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.623240    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5" event={"ID":"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7","Type":"ContainerStarted","Data":"d58fb779c69f6af7c928b070e958b79ed67ef529bd5223483b89bb1664bbefb0"}
Jul 23 15:50:17.626409 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.626382    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss" event={"ID":"68520f46-5970-4691-834d-b47df20705d9","Type":"ContainerStarted","Data":"dee97c529392231a7d99c21831b0c9072cb82ba7fed236d6db00e9ecc33e9995"}
Jul 23 15:50:17.629813 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.629787    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6khxq" event={"ID":"a54fffa1-1035-4460-929e-bc6c8289348b","Type":"ContainerStarted","Data":"406dd8142bafadf873f3792bbb6943bcd0ee41d8de97d582a739d39eaf4b104c"}
Jul 23 15:50:17.631965 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.631936    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlhlb" event={"ID":"afbd575c-46b7-4aae-bc60-6c04faa47aef","Type":"ContainerStarted","Data":"0cd94441ae2be537f751fbe959850db18f6288c1569f7aff7edc19cde1edd67e"}
Jul 23 15:50:17.634380 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.634300    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9k4dp" event={"ID":"eabd10ab-eefb-4fb3-a01f-deb9751c945e","Type":"ContainerStarted","Data":"551c19d30c919d22fb6eff55e733a706812ba3678d80d971a8f789e2d03ae0ac"}
Jul 23 15:50:17.637601 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:17.637533    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p6mmx" event={"ID":"04224bad-0656-4c75-8a5e-070734e85017","Type":"ContainerStarted","Data":"216a0edc962e6fd58c09b370974560ac80c7b88936b33cf112c216fe63643cbc"}
Jul 23 15:50:18.013671 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:18.013637    2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 23 15:50:18.108360 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:18.107742    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cps8w\" (UniqueName: \"kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w\") pod \"network-check-target-fdhds\" (UID: \"e95b191f-0eb7-4e14-83a9-ef22527e0036\") " pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:18.108360 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:18.107812    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:18.108360 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:18.107940    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:18.108360 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:18.107988    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret podName:631c3f7e-3c49-43fe-b4ca-610a73cd960e nodeName:}" failed. No retries permitted until 2026-07-23 15:50:20.107976119 +0000 UTC m=+6.031830731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret") pod "global-pull-secret-syncer-v7clr" (UID: "631c3f7e-3c49-43fe-b4ca-610a73cd960e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:18.108360 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:18.108146    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:18.108360 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:18.108170    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:18.108360 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:18.108183    2570 projected.go:196] Error preparing data for projected volume kube-api-access-cps8w for pod openshift-network-diagnostics/network-check-target-fdhds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:18.108360 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:18.108234    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w podName:e95b191f-0eb7-4e14-83a9-ef22527e0036 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:20.108220126 +0000 UTC m=+6.032074742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cps8w" (UniqueName: "kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w") pod "network-check-target-fdhds" (UID: "e95b191f-0eb7-4e14-83a9-ef22527e0036") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:18.208874 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:18.208834    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:18.209089 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:18.208990    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:18.209152 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:18.209121    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs podName:eca674e0-139e-42c0-b87a-03d0e60e43ce nodeName:}" failed. No retries permitted until 2026-07-23 15:50:20.209097413 +0000 UTC m=+6.132952030 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs") pod "network-metrics-daemon-4wml4" (UID: "eca674e0-139e-42c0-b87a-03d0e60e43ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:18.535926 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:18.535862    2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 15:45:16 +0000 UTC" deadline="2027-12-28 07:04:29.799318555 +0000 UTC"
Jul 23 15:50:18.535926 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:18.535925    2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12543h14m11.263397294s"
Jul 23 15:50:18.600718 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:18.599895    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:18.600718 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:18.600052    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:18.600718 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:18.600487    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:18.600718 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:18.600581    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:19.598046 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:19.597535    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:19.598046 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:19.597676    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:20.126031 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:20.125222    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cps8w\" (UniqueName: \"kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w\") pod \"network-check-target-fdhds\" (UID: \"e95b191f-0eb7-4e14-83a9-ef22527e0036\") " pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:20.126031 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:20.125323    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:20.126031 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:20.125445    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:20.126031 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:20.125506    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret podName:631c3f7e-3c49-43fe-b4ca-610a73cd960e nodeName:}" failed. No retries permitted until 2026-07-23 15:50:24.125487834 +0000 UTC m=+10.049342451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret") pod "global-pull-secret-syncer-v7clr" (UID: "631c3f7e-3c49-43fe-b4ca-610a73cd960e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:20.126031 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:20.125908    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:20.126031 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:20.125927    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:20.126031 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:20.125940    2570 projected.go:196] Error preparing data for projected volume kube-api-access-cps8w for pod openshift-network-diagnostics/network-check-target-fdhds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:20.126031 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:20.125982    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w podName:e95b191f-0eb7-4e14-83a9-ef22527e0036 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:24.12596838 +0000 UTC m=+10.049822996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cps8w" (UniqueName: "kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w") pod "network-check-target-fdhds" (UID: "e95b191f-0eb7-4e14-83a9-ef22527e0036") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:20.226956 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:20.226353    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:20.226956 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:20.226550    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:20.226956 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:20.226617    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs podName:eca674e0-139e-42c0-b87a-03d0e60e43ce nodeName:}" failed. No retries permitted until 2026-07-23 15:50:24.226597286 +0000 UTC m=+10.150451901 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs") pod "network-metrics-daemon-4wml4" (UID: "eca674e0-139e-42c0-b87a-03d0e60e43ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:20.599517 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:20.598920    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:20.599517 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:20.598874    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:20.599517 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:20.599079    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:20.599517 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:20.599135    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:21.597948 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:21.597470    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:21.597948 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:21.597603    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:22.598739 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:22.598055    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:22.598739 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:22.598200    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:22.598739 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:22.598634    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:22.598739 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:22.598743    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:23.597186 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:23.597147    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:23.597379 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:23.597285    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:24.159324 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:24.159283    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:24.159732 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:24.159346    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cps8w\" (UniqueName: \"kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w\") pod \"network-check-target-fdhds\" (UID: \"e95b191f-0eb7-4e14-83a9-ef22527e0036\") " pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:24.159732 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:24.159423    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:24.159732 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:24.159471    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:24.159732 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:24.159491    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:24.159732 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:24.159505    2570 projected.go:196] Error preparing data for projected volume kube-api-access-cps8w for pod openshift-network-diagnostics/network-check-target-fdhds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:24.159732 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:24.159492    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret podName:631c3f7e-3c49-43fe-b4ca-610a73cd960e nodeName:}" failed. No retries permitted until 2026-07-23 15:50:32.159473378 +0000 UTC m=+18.083327994 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret") pod "global-pull-secret-syncer-v7clr" (UID: "631c3f7e-3c49-43fe-b4ca-610a73cd960e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:24.159732 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:24.159584    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w podName:e95b191f-0eb7-4e14-83a9-ef22527e0036 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:32.159557815 +0000 UTC m=+18.083412436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cps8w" (UniqueName: "kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w") pod "network-check-target-fdhds" (UID: "e95b191f-0eb7-4e14-83a9-ef22527e0036") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:24.260132 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:24.260084    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:24.260319 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:24.260274    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:24.260381 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:24.260345    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs podName:eca674e0-139e-42c0-b87a-03d0e60e43ce nodeName:}" failed. No retries permitted until 2026-07-23 15:50:32.260319648 +0000 UTC m=+18.184174267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs") pod "network-metrics-daemon-4wml4" (UID: "eca674e0-139e-42c0-b87a-03d0e60e43ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:24.599530 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:24.598953    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:24.599530 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:24.599096    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:24.599530 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:24.599138    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:24.599530 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:24.599268    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:25.597454 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:25.597417    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:25.597849 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:25.597578    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:26.596893 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:26.596856    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:26.597074 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:26.596913    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:26.597074 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:26.597023    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:26.597204 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:26.597137    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:27.597225 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:27.597193    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:27.597665 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:27.597310    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:28.600697 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:28.600612    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:28.601213 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:28.600763    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:28.601213 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:28.600811    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:28.601213 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:28.600924    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:29.597482 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:29.597440    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:29.597682 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:29.597558    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:30.597039 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:30.596992    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:30.597441 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:30.596994    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:30.597441 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:30.597158    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:30.597441 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:30.597224    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:31.597384 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:31.597345    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:31.597851 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:31.597464    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:32.223932 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:32.223837    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:32.223932 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:32.223885    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cps8w\" (UniqueName: \"kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w\") pod \"network-check-target-fdhds\" (UID: \"e95b191f-0eb7-4e14-83a9-ef22527e0036\") " pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:32.224189 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:32.223988    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:32.224189 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:32.224002    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:32.224189 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:32.224033    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:32.224189 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:32.224044    2570 projected.go:196] Error preparing data for projected volume kube-api-access-cps8w for pod openshift-network-diagnostics/network-check-target-fdhds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:32.224189 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:32.224070    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret podName:631c3f7e-3c49-43fe-b4ca-610a73cd960e nodeName:}" failed. No retries permitted until 2026-07-23 15:50:48.224051378 +0000 UTC m=+34.147906005 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret") pod "global-pull-secret-syncer-v7clr" (UID: "631c3f7e-3c49-43fe-b4ca-610a73cd960e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:32.224189 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:32.224088    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w podName:e95b191f-0eb7-4e14-83a9-ef22527e0036 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:48.224078967 +0000 UTC m=+34.147933593 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cps8w" (UniqueName: "kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w") pod "network-check-target-fdhds" (UID: "e95b191f-0eb7-4e14-83a9-ef22527e0036") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:32.325316 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:32.325275    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:32.325506 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:32.325420    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:32.325506 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:32.325476    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs podName:eca674e0-139e-42c0-b87a-03d0e60e43ce nodeName:}" failed. No retries permitted until 2026-07-23 15:50:48.325461449 +0000 UTC m=+34.249316061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs") pod "network-metrics-daemon-4wml4" (UID: "eca674e0-139e-42c0-b87a-03d0e60e43ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:32.597766 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:32.597677    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:32.598230 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:32.597677    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:32.598230 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:32.597821    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:32.598230 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:32.597908    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:33.597484 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:33.597443    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:33.597658 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:33.597571    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:34.598562 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:34.598520    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:34.599049 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:34.598657    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:34.599049 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:34.598710    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:34.599049 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:34.598816    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:35.597601 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:35.597566    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:35.597764 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:35.597680    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:36.597222 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.596942    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:36.597772 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:36.597362    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:36.597772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.597678    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:36.597894 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:36.597771    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:36.697973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.697476    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" event={"ID":"b336876c7020fb78e54d8649d256ea31","Type":"ContainerStarted","Data":"20030a9e05ee3e2ae5a5010175317e40b13013f5f5d76e318442bcd8b4072809"}
Jul 23 15:50:36.699964 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.699889    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-59bvr" event={"ID":"ecb48312-fb80-4132-9010-86f28d0f9891","Type":"ContainerStarted","Data":"724d8fb06fc6243f97405059a56efaab0598d85366bbf42ae2d9d1befb255297"}
Jul 23 15:50:36.703298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.703221    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7cdws" event={"ID":"22081b84-205f-4c98-b817-8055589ea584","Type":"ContainerStarted","Data":"8e51a4631e5249238169c1b051d82a8e1f76a7a38f6b3de5a9c9068e7a7a4ed3"}
Jul 23 15:50:36.705376 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.705316    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vcvbr" event={"ID":"2f807ec5-5297-4b0d-b04e-9250b909df3a","Type":"ContainerStarted","Data":"3be538540a8a28a0a44ad4996dd0b94968f62e8a68690d2e9e43eef2cac30c5d"}
Jul 23 15:50:36.708693 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.708523    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5" event={"ID":"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7","Type":"ContainerStarted","Data":"bf880d7e4d73d7265166c4285bcc5eb1ff15be0685882e14101649fb15d77471"}
Jul 23 15:50:36.708693 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.708618    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5" event={"ID":"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7","Type":"ContainerStarted","Data":"a59034f526fe43b0dc3d4f74bea9f4e395d8311ec6f1ff235b9ed86b372f8415"}
Jul 23 15:50:36.712739 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.712466    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-218.ec2.internal" podStartSLOduration=21.71244491 podStartE2EDuration="21.71244491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:36.711457593 +0000 UTC m=+22.635312227" watchObservedRunningTime="2026-07-23 15:50:36.71244491 +0000 UTC m=+22.636299548"
Jul 23 15:50:36.713312 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.713181    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6khxq" event={"ID":"a54fffa1-1035-4460-929e-bc6c8289348b","Type":"ContainerStarted","Data":"e38b445d4df536268d734c0131fb257ea35004903bf9e8895f92ef096e40b0b8"}
Jul 23 15:50:36.727544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.727475    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7cdws" podStartSLOduration=3.2304853319999998 podStartE2EDuration="22.727435049s" totalImagesPullingTime="19.496949717s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:36.727328532 +0000 UTC m=+22.651183167" watchObservedRunningTime="2026-07-23 15:50:36.727435049 +0000 UTC m=+22.651289684"
Jul 23 15:50:36.743876 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.743818    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vcvbr" podStartSLOduration=11.369426303000001 podStartE2EDuration="22.743803232s" totalImagesPullingTime="11.374376929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:36.743595238 +0000 UTC m=+22.667449876" watchObservedRunningTime="2026-07-23 15:50:36.743803232 +0000 UTC m=+22.667657908"
Jul 23 15:50:36.760422 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.760374    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-59bvr" podStartSLOduration=3.22939518 podStartE2EDuration="22.760358812s" totalImagesPullingTime="19.530963632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:36.760276551 +0000 UTC m=+22.684131184" watchObservedRunningTime="2026-07-23 15:50:36.760358812 +0000 UTC m=+22.684213445"
Jul 23 15:50:36.798037 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:36.797914    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6khxq" podStartSLOduration=11.377419111 podStartE2EDuration="22.797895826s" totalImagesPullingTime="11.420476715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:36.797803414 +0000 UTC m=+22.721658049" watchObservedRunningTime="2026-07-23 15:50:36.797895826 +0000 UTC m=+22.721750459"
Jul 23 15:50:37.597564 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.597474    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:37.598156 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:37.597583    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:37.718208 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.718174    2570 generic.go:356] "Generic (PLEG): container finished" podID="1ddef1e22938f212ae084186c40fb22a" containerID="dde742aea28580cf11ae1f2da242da0de94267b08d4bc9ec5ff189c379a1a02b" exitCode=0
Jul 23 15:50:37.718461 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.718265    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" event={"ID":"1ddef1e22938f212ae084186c40fb22a","Type":"ContainerDied","Data":"dde742aea28580cf11ae1f2da242da0de94267b08d4bc9ec5ff189c379a1a02b"}
Jul 23 15:50:37.721287 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.721258    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5" event={"ID":"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7","Type":"ContainerStarted","Data":"486891f73d56294d0b1e28c439ac788e0b7bb67dfef87be0a4ac5ab079393856"}
Jul 23 15:50:37.721413 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.721331    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5" event={"ID":"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7","Type":"ContainerStarted","Data":"956b36c57c94cda97af619e6616d113760b4ee0252334f1e02b9e7ee3ab88499"}
Jul 23 15:50:37.721413 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.721364    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5" event={"ID":"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7","Type":"ContainerStarted","Data":"23d6203dcd6d05313aff1dcef595791c47aea57e7a63b52695b86185ed9d258a"}
Jul 23 15:50:37.721413 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.721400    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5" event={"ID":"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7","Type":"ContainerStarted","Data":"e05da6a921c5508f89e2563b2df66f6732e3bfcb0db03961782a489fd17ef6fc"}
Jul 23 15:50:37.722745 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.722712    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss" event={"ID":"68520f46-5970-4691-834d-b47df20705d9","Type":"ContainerStarted","Data":"5b29549ce7135fc76f290ce28645477d306594b90f0773ef39e76d922bce82f4"}
Jul 23 15:50:37.723955 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.723932    2570 generic.go:356] "Generic (PLEG): container finished" podID="afbd575c-46b7-4aae-bc60-6c04faa47aef" containerID="f1445a1b7904553b1cc636d200e417bf12f89d7882169d101ba8f8a8968b0d43" exitCode=0
Jul 23 15:50:37.724060 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.724004    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlhlb" event={"ID":"afbd575c-46b7-4aae-bc60-6c04faa47aef","Type":"ContainerDied","Data":"f1445a1b7904553b1cc636d200e417bf12f89d7882169d101ba8f8a8968b0d43"}
Jul 23 15:50:37.725493 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.725447    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9k4dp" event={"ID":"eabd10ab-eefb-4fb3-a01f-deb9751c945e","Type":"ContainerStarted","Data":"cad46f5e5192ac36508d398f0585398c1b8b993832eb75016af1fbad544ded5b"}
Jul 23 15:50:37.726823 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.726800    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p6mmx" event={"ID":"04224bad-0656-4c75-8a5e-070734e85017","Type":"ContainerStarted","Data":"841ba079014b65ffecea057e4f65bf7e6ab7562f33c0fa3d03437d7031ed1bf4"}
Jul 23 15:50:37.748491 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.748443    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p6mmx" podStartSLOduration=8.677337866 podStartE2EDuration="23.748426709s" totalImagesPullingTime="15.071088843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:37.748123598 +0000 UTC m=+23.671978231" watchObservedRunningTime="2026-07-23 15:50:37.748426709 +0000 UTC m=+23.672281343"
Jul 23 15:50:37.763429 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:37.763235    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9k4dp" podStartSLOduration=4.28212247 podStartE2EDuration="23.76321985s" totalImagesPullingTime="19.48109738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:37.763069043 +0000 UTC m=+23.686923677" watchObservedRunningTime="2026-07-23 15:50:37.76321985 +0000 UTC m=+23.687074483"
Jul 23 15:50:38.597346 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:38.597315    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:38.597630 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:38.597315    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:38.597630 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:38.597459    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:38.597630 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:38.597507    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:38.731570 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:38.731534    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" event={"ID":"1ddef1e22938f212ae084186c40fb22a","Type":"ContainerStarted","Data":"a64520ce31734bcc108f8231e52fd9b74952952635cb56d0e932937a78694eb5"}
Jul 23 15:50:38.748340 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:38.748285    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-218.ec2.internal" podStartSLOduration=22.748264493 podStartE2EDuration="22.748264493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:38.748265953 +0000 UTC m=+24.672120596" watchObservedRunningTime="2026-07-23 15:50:38.748264493 +0000 UTC m=+24.672119130"
Jul 23 15:50:38.800534 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:38.800499    2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 23 15:50:39.536164 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:39.535945    2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T15:50:38.800523612Z","UUID":"7fb32c08-a63e-40e8-88b3-77ac4b221191","Handler":null,"Name":"","Endpoint":""}
Jul 23 15:50:39.537696 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:39.537669    2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 23 15:50:39.537829 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:39.537717    2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 23 15:50:39.597047 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:39.596993    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:39.597218 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:39.597165    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:39.740280 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:39.740245    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5" event={"ID":"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7","Type":"ContainerStarted","Data":"9901b9191bcd0452214bd338cb6c4f94dfdeeead222ffd20d497efd0ef921b39"}
Jul 23 15:50:39.743545 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:39.743512    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss" event={"ID":"68520f46-5970-4691-834d-b47df20705d9","Type":"ContainerStarted","Data":"b37b1837727017d5f46ae37f4a9d2269cc781162619e22dd1e4ceb4888ce35d8"}
Jul 23 15:50:39.770917 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:39.770887    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6khxq"
Jul 23 15:50:39.771580 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:39.771564    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6khxq"
Jul 23 15:50:40.597253 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:40.597212    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:40.597484 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:40.597356    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:40.597484 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:40.597434    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:40.597611 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:40.597558    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:40.747400 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:40.747362    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss" event={"ID":"68520f46-5970-4691-834d-b47df20705d9","Type":"ContainerStarted","Data":"b4dc4a44d03d05175aad96726d84bffd32e8dcfc8e6af23c7a01b90e0bd66bf2"}
Jul 23 15:50:40.747883 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:40.747569    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6khxq"
Jul 23 15:50:40.748004 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:40.747984    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6khxq"
Jul 23 15:50:40.767078 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:40.767028    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-px8ss" podStartSLOduration=4.23120394 podStartE2EDuration="26.766993497s" totalImagesPullingTime="22.535789557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:40.765801776 +0000 UTC m=+26.689656411" watchObservedRunningTime="2026-07-23 15:50:40.766993497 +0000 UTC m=+26.690848130"
Jul 23 15:50:41.596807 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:41.596714    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:41.597001 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:41.596842    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:42.600701 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:42.600532    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:42.601240 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:42.600605    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:42.601240 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:42.600773    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:42.601240 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:42.600852    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:42.755060 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:42.755000    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5" event={"ID":"b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7","Type":"ContainerStarted","Data":"35f847af07f6e061310ed39629dae0ee916b3ad7e615e025ac983cb57b236992"}
Jul 23 15:50:42.755290 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:42.755266    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:42.755374 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:42.755348    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:42.757410 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:42.757386    2570 generic.go:356] "Generic (PLEG): container finished" podID="afbd575c-46b7-4aae-bc60-6c04faa47aef" containerID="700fea844bc9b6c4877ac34382e048789b7c433eb4cfcb84c3576e292cddee1e" exitCode=0
Jul 23 15:50:42.757523 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:42.757417    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlhlb" event={"ID":"afbd575c-46b7-4aae-bc60-6c04faa47aef","Type":"ContainerDied","Data":"700fea844bc9b6c4877ac34382e048789b7c433eb4cfcb84c3576e292cddee1e"}
Jul 23 15:50:42.771685 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:42.771657    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:42.771814 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:42.771762    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:42.786361 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:42.786315    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5" podStartSLOduration=9.211344309 podStartE2EDuration="28.786297914s" totalImagesPullingTime="19.574953605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:42.785696913 +0000 UTC m=+28.709551550" watchObservedRunningTime="2026-07-23 15:50:42.786297914 +0000 UTC m=+28.710152548"
Jul 23 15:50:43.597144 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:43.597107    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:43.597318 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:43.597247    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:43.762281 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:43.762249    2570 generic.go:356] "Generic (PLEG): container finished" podID="afbd575c-46b7-4aae-bc60-6c04faa47aef" containerID="b56aabae5774ebd37a5f288e856e002f9098add2f5033c3073019833769ddbd4" exitCode=0
Jul 23 15:50:43.762757 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:43.762339    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlhlb" event={"ID":"afbd575c-46b7-4aae-bc60-6c04faa47aef","Type":"ContainerDied","Data":"b56aabae5774ebd37a5f288e856e002f9098add2f5033c3073019833769ddbd4"}
Jul 23 15:50:43.762757 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:43.762721    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:50:44.304369 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:44.304181    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v7clr"]
Jul 23 15:50:44.304530 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:44.304455    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:44.304574 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:44.304554    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:44.306273 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:44.306244    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fdhds"]
Jul 23 15:50:44.306412 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:44.306364    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:44.306498 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:44.306474    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:44.306909 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:44.306891    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4wml4"]
Jul 23 15:50:44.306999 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:44.306988    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:44.307103 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:44.307086    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:45.596711 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:45.596635    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:45.597168 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:45.596652    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:45.597168 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:45.596744    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:45.597168 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:45.596763    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:45.597168 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:45.596887    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:45.597168 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:45.596973    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:45.769628 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:45.769595    2570 generic.go:356] "Generic (PLEG): container finished" podID="afbd575c-46b7-4aae-bc60-6c04faa47aef" containerID="62bd566eb3e4e80592878b77d1630704c287b220b83be5889d22507f473ebb12" exitCode=0
Jul 23 15:50:45.769785 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:45.769631    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlhlb" event={"ID":"afbd575c-46b7-4aae-bc60-6c04faa47aef","Type":"ContainerDied","Data":"62bd566eb3e4e80592878b77d1630704c287b220b83be5889d22507f473ebb12"}
Jul 23 15:50:47.597695 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:47.597616    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:47.598134 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:47.597616    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:47.598134 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:47.597780    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4wml4" podUID="eca674e0-139e-42c0-b87a-03d0e60e43ce"
Jul 23 15:50:47.598134 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:47.597838    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v7clr" podUID="631c3f7e-3c49-43fe-b4ca-610a73cd960e"
Jul 23 15:50:47.598134 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:47.597616    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:47.598134 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:47.597934    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdhds" podUID="e95b191f-0eb7-4e14-83a9-ef22527e0036"
Jul 23 15:50:48.238519 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:48.238478    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:48.238705 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:48.238545    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cps8w\" (UniqueName: \"kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w\") pod \"network-check-target-fdhds\" (UID: \"e95b191f-0eb7-4e14-83a9-ef22527e0036\") " pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:48.238705 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:48.238689    2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:48.238832 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:48.238764    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 23 15:50:48.238832 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:48.238785    2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 23 15:50:48.238832 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:48.238798    2570 projected.go:196] Error preparing data for projected volume kube-api-access-cps8w for pod openshift-network-diagnostics/network-check-target-fdhds: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:48.238832 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:48.238804    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret podName:631c3f7e-3c49-43fe-b4ca-610a73cd960e nodeName:}" failed. No retries permitted until 2026-07-23 15:51:20.238729308 +0000 UTC m=+66.162583941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret") pod "global-pull-secret-syncer-v7clr" (UID: "631c3f7e-3c49-43fe-b4ca-610a73cd960e") : object "kube-system"/"original-pull-secret" not registered
Jul 23 15:50:48.239050 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:48.238852    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w podName:e95b191f-0eb7-4e14-83a9-ef22527e0036 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:20.238834994 +0000 UTC m=+66.162689612 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cps8w" (UniqueName: "kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w") pod "network-check-target-fdhds" (UID: "e95b191f-0eb7-4e14-83a9-ef22527e0036") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 23 15:50:48.339744 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:48.339654    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:48.339895 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:48.339821    2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:48.339895 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:48.339886    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs podName:eca674e0-139e-42c0-b87a-03d0e60e43ce nodeName:}" failed. No retries permitted until 2026-07-23 15:51:20.339869201 +0000 UTC m=+66.263723815 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs") pod "network-metrics-daemon-4wml4" (UID: "eca674e0-139e-42c0-b87a-03d0e60e43ce") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 23 15:50:49.357913 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.357879    2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-218.ec2.internal" event="NodeReady"
Jul 23 15:50:49.358410 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.358039    2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 23 15:50:49.399257 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.399218    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6c966b5f54-k856m"]
Jul 23 15:50:49.423281 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.423247    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wkrfk"]
Jul 23 15:50:49.423452 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.423394    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.426089 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.425935    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 23 15:50:49.426089 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.425967    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-69gss\""
Jul 23 15:50:49.426691 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.426430    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 23 15:50:49.426691 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.426465    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 23 15:50:49.435408 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.435388    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 23 15:50:49.439655 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.439622    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-crv9s"]
Jul 23 15:50:49.439758 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.439737    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wkrfk"
Jul 23 15:50:49.442306 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.442276    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 23 15:50:49.442441 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.442311    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 23 15:50:49.442572 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.442550    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q8tlr\""
Jul 23 15:50:49.442682 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.442613    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 23 15:50:49.448044 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.447986    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-certificates\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.448044 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.448033    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2e75568-9d55-4a31-8cfc-adf3c6879a2e-cert\") pod \"ingress-canary-wkrfk\" (UID: \"b2e75568-9d55-4a31-8cfc-adf3c6879a2e\") " pod="openshift-ingress-canary/ingress-canary-wkrfk"
Jul 23 15:50:49.448217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.448057    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-bound-sa-token\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.448217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.448093    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2qtr\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-kube-api-access-b2qtr\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.448217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.448118    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdgd6\" (UniqueName: \"kubernetes.io/projected/b2e75568-9d55-4a31-8cfc-adf3c6879a2e-kube-api-access-tdgd6\") pod \"ingress-canary-wkrfk\" (UID: \"b2e75568-9d55-4a31-8cfc-adf3c6879a2e\") " pod="openshift-ingress-canary/ingress-canary-wkrfk"
Jul 23 15:50:49.448217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.448196    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af0e4e30-578d-479f-9f9f-d7be0848f528-installation-pull-secrets\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.448430 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.448293    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af0e4e30-578d-479f-9f9f-d7be0848f528-image-registry-private-configuration\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.448430 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.448322    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.448430 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.448356    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af0e4e30-578d-479f-9f9f-d7be0848f528-ca-trust-extracted\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.448430 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.448385    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af0e4e30-578d-479f-9f9f-d7be0848f528-trusted-ca\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.449986 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.449959    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c966b5f54-k856m"]
Jul 23 15:50:49.450105 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.450000    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wkrfk"]
Jul 23 15:50:49.450105 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.450036    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-crv9s"]
Jul 23 15:50:49.450105 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.450090    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:49.453967 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.453945    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c4nf5\""
Jul 23 15:50:49.454117 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.453988    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 23 15:50:49.454117 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.454055    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 23 15:50:49.549216 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549175    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-bound-sa-token\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.549424 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549242    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b042f20-34c4-4c4d-afd9-b3616288a7c0-tmp-dir\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:49.549424 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549279    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2qtr\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-kube-api-access-b2qtr\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.549424 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549298    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdgd6\" (UniqueName: \"kubernetes.io/projected/b2e75568-9d55-4a31-8cfc-adf3c6879a2e-kube-api-access-tdgd6\") pod \"ingress-canary-wkrfk\" (UID: \"b2e75568-9d55-4a31-8cfc-adf3c6879a2e\") " pod="openshift-ingress-canary/ingress-canary-wkrfk"
Jul 23 15:50:49.549424 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549331    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af0e4e30-578d-479f-9f9f-d7be0848f528-installation-pull-secrets\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.549424 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549402    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af0e4e30-578d-479f-9f9f-d7be0848f528-image-registry-private-configuration\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.549671 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549428    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.549671 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549453    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af0e4e30-578d-479f-9f9f-d7be0848f528-ca-trust-extracted\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.549671 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549476    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af0e4e30-578d-479f-9f9f-d7be0848f528-trusted-ca\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.549671 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549501    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b042f20-34c4-4c4d-afd9-b3616288a7c0-config-volume\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:49.549671 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-certificates\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.549671 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549551    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2e75568-9d55-4a31-8cfc-adf3c6879a2e-cert\") pod \"ingress-canary-wkrfk\" (UID: \"b2e75568-9d55-4a31-8cfc-adf3c6879a2e\") " pod="openshift-ingress-canary/ingress-canary-wkrfk"
Jul 23 15:50:49.549671 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549568    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf46g\" (UniqueName: \"kubernetes.io/projected/3b042f20-34c4-4c4d-afd9-b3616288a7c0-kube-api-access-wf46g\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:49.549671 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.549606    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:49.550078 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:49.549716    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 15:50:49.550078 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:49.549736    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c966b5f54-k856m: secret "image-registry-tls" not found
Jul 23 15:50:49.550078 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:49.549799    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls podName:af0e4e30-578d-479f-9f9f-d7be0848f528 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:50.049777715 +0000 UTC m=+35.973632347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls") pod "image-registry-6c966b5f54-k856m" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528") : secret "image-registry-tls" not found
Jul 23 15:50:49.550078 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.550052    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af0e4e30-578d-479f-9f9f-d7be0848f528-ca-trust-extracted\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.550624 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.550595    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-certificates\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.551180 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.551158    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af0e4e30-578d-479f-9f9f-d7be0848f528-trusted-ca\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.555320 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.555184    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af0e4e30-578d-479f-9f9f-d7be0848f528-image-registry-private-configuration\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.555433 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.555177    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b2e75568-9d55-4a31-8cfc-adf3c6879a2e-cert\") pod \"ingress-canary-wkrfk\" (UID: \"b2e75568-9d55-4a31-8cfc-adf3c6879a2e\") " pod="openshift-ingress-canary/ingress-canary-wkrfk"
Jul 23 15:50:49.555742 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.555717    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af0e4e30-578d-479f-9f9f-d7be0848f528-installation-pull-secrets\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.559412 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.559385    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2qtr\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-kube-api-access-b2qtr\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.559539 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.559456    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-bound-sa-token\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:49.560076 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.560054    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdgd6\" (UniqueName: \"kubernetes.io/projected/b2e75568-9d55-4a31-8cfc-adf3c6879a2e-kube-api-access-tdgd6\") pod \"ingress-canary-wkrfk\" (UID: \"b2e75568-9d55-4a31-8cfc-adf3c6879a2e\") " pod="openshift-ingress-canary/ingress-canary-wkrfk"
Jul 23 15:50:49.596931 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.596890    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:50:49.596931 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.596935    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:50:49.597168 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.597025    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:50:49.599923 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.599897    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 15:50:49.600047 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.599925    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 15:50:49.600047 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.599936    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 15:50:49.600160 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.600071    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xglcr\""
Jul 23 15:50:49.600338 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.600310    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 15:50:49.600459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.600367    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9k2x\""
Jul 23 15:50:49.650273 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.650227    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b042f20-34c4-4c4d-afd9-b3616288a7c0-config-volume\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:49.650273 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.650277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf46g\" (UniqueName: \"kubernetes.io/projected/3b042f20-34c4-4c4d-afd9-b3616288a7c0-kube-api-access-wf46g\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:49.650557 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.650306    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:49.650688 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.650660    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b042f20-34c4-4c4d-afd9-b3616288a7c0-tmp-dir\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:49.650827 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.650712    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3b042f20-34c4-4c4d-afd9-b3616288a7c0-tmp-dir\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:49.650827 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:49.650738    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:50:49.650827 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:49.650801    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls podName:3b042f20-34c4-4c4d-afd9-b3616288a7c0 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:50.150781116 +0000 UTC m=+36.074635727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls") pod "dns-default-crv9s" (UID: "3b042f20-34c4-4c4d-afd9-b3616288a7c0") : secret "dns-default-metrics-tls" not found
Jul 23 15:50:49.651005 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.650923    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3b042f20-34c4-4c4d-afd9-b3616288a7c0-config-volume\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:49.662579 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.662555    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf46g\" (UniqueName: \"kubernetes.io/projected/3b042f20-34c4-4c4d-afd9-b3616288a7c0-kube-api-access-wf46g\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:49.750774 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:49.750739    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wkrfk"
Jul 23 15:50:50.053864 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:50.053823    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:50.054202 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:50.053970    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 15:50:50.054202 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:50.053985    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c966b5f54-k856m: secret "image-registry-tls" not found
Jul 23 15:50:50.054202 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:50.054069    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls podName:af0e4e30-578d-479f-9f9f-d7be0848f528 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:51.054048362 +0000 UTC m=+36.977902974 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls") pod "image-registry-6c966b5f54-k856m" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528") : secret "image-registry-tls" not found
Jul 23 15:50:50.154845 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:50.154802    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:50.155066 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:50.154976    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:50:50.155120 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:50.155070    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls podName:3b042f20-34c4-4c4d-afd9-b3616288a7c0 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:51.155052519 +0000 UTC m=+37.078907130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls") pod "dns-default-crv9s" (UID: "3b042f20-34c4-4c4d-afd9-b3616288a7c0") : secret "dns-default-metrics-tls" not found
Jul 23 15:50:50.636911 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:50.636871    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wkrfk"]
Jul 23 15:50:50.695421 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:50:50.695391    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e75568_9d55_4a31_8cfc_adf3c6879a2e.slice/crio-12c0ec33451769675c9efe6d8f3ad09b058d52f7bb69d70d475f9a0a05af58a9 WatchSource:0}: Error finding container 12c0ec33451769675c9efe6d8f3ad09b058d52f7bb69d70d475f9a0a05af58a9: Status 404 returned error can't find the container with id 12c0ec33451769675c9efe6d8f3ad09b058d52f7bb69d70d475f9a0a05af58a9
Jul 23 15:50:50.783348 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:50.783318    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wkrfk" event={"ID":"b2e75568-9d55-4a31-8cfc-adf3c6879a2e","Type":"ContainerStarted","Data":"12c0ec33451769675c9efe6d8f3ad09b058d52f7bb69d70d475f9a0a05af58a9"}
Jul 23 15:50:51.061749 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:51.061654    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:51.061927 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:51.061824    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 15:50:51.061927 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:51.061848    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c966b5f54-k856m: secret "image-registry-tls" not found
Jul 23 15:50:51.061927 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:51.061917    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls podName:af0e4e30-578d-479f-9f9f-d7be0848f528 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:53.061897317 +0000 UTC m=+38.985751934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls") pod "image-registry-6c966b5f54-k856m" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528") : secret "image-registry-tls" not found
Jul 23 15:50:51.162969 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:51.162925    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:51.163185 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:51.163126    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:50:51.163251 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:51.163214    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls podName:3b042f20-34c4-4c4d-afd9-b3616288a7c0 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:53.16318984 +0000 UTC m=+39.087044456 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls") pod "dns-default-crv9s" (UID: "3b042f20-34c4-4c4d-afd9-b3616288a7c0") : secret "dns-default-metrics-tls" not found
Jul 23 15:50:51.788926 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:51.788889    2570 generic.go:356] "Generic (PLEG): container finished" podID="afbd575c-46b7-4aae-bc60-6c04faa47aef" containerID="26ae58f8cf63cb6b0dbc15827087d5b6ef532e1507c9ef76594759e137620537" exitCode=0
Jul 23 15:50:51.789614 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:51.788940    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlhlb" event={"ID":"afbd575c-46b7-4aae-bc60-6c04faa47aef","Type":"ContainerDied","Data":"26ae58f8cf63cb6b0dbc15827087d5b6ef532e1507c9ef76594759e137620537"}
Jul 23 15:50:52.795420 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:52.795380    2570 generic.go:356] "Generic (PLEG): container finished" podID="afbd575c-46b7-4aae-bc60-6c04faa47aef" containerID="eaf4feaabe1470cdff878cb1f1e7f8a11f7e3f3826debccca4bd782d40229bd3" exitCode=0
Jul 23 15:50:52.796034 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:52.795440    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlhlb" event={"ID":"afbd575c-46b7-4aae-bc60-6c04faa47aef","Type":"ContainerDied","Data":"eaf4feaabe1470cdff878cb1f1e7f8a11f7e3f3826debccca4bd782d40229bd3"}
Jul 23 15:50:53.078586 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:53.078333    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:53.078586 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:53.078492    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 15:50:53.078586 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:53.078567    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c966b5f54-k856m: secret "image-registry-tls" not found
Jul 23 15:50:53.078793 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:53.078622    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls podName:af0e4e30-578d-479f-9f9f-d7be0848f528 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:57.078606094 +0000 UTC m=+43.002460705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls") pod "image-registry-6c966b5f54-k856m" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528") : secret "image-registry-tls" not found
Jul 23 15:50:53.179144 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:53.179107    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:53.179316 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:53.179235    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:50:53.179316 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:53.179294    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls podName:3b042f20-34c4-4c4d-afd9-b3616288a7c0 nodeName:}" failed. No retries permitted until 2026-07-23 15:50:57.179279779 +0000 UTC m=+43.103134391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls") pod "dns-default-crv9s" (UID: "3b042f20-34c4-4c4d-afd9-b3616288a7c0") : secret "dns-default-metrics-tls" not found
Jul 23 15:50:53.561269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:53.561232    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:53.641869 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:53.641834    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:53.801410 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:53.801378    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vlhlb" event={"ID":"afbd575c-46b7-4aae-bc60-6c04faa47aef","Type":"ContainerStarted","Data":"f88f5771d0b1bd051fa5a466114ab49f2f0483f8c58a33e95842da2c47384e40"}
Jul 23 15:50:53.802751 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:53.802727    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wkrfk" event={"ID":"b2e75568-9d55-4a31-8cfc-adf3c6879a2e","Type":"ContainerStarted","Data":"d9680516693c12a34aa6f11645ce1208895dc7bcca3b248f9a6bb65bc5a709d3"}
Jul 23 15:50:53.826625 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:53.826505    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vlhlb" podStartSLOduration=12.816345778 podStartE2EDuration="39.826482563s" totalImagesPullingTime="27.010136785s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:53.826246065 +0000 UTC m=+39.750100709" watchObservedRunningTime="2026-07-23 15:50:53.826482563 +0000 UTC m=+39.750337200"
Jul 23 15:50:53.987837 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:53.987808    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:54.250309 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:54.250279    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:54.352050 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:54.352003    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:54.418993 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:54.418967    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:56.760149 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:56.760119    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:56.811192 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:56.811162    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:57.109502 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:57.109399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:50:57.109653 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:57.109549    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 15:50:57.109653 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:57.109566    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c966b5f54-k856m: secret "image-registry-tls" not found
Jul 23 15:50:57.109653 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:57.109622    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls podName:af0e4e30-578d-479f-9f9f-d7be0848f528 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:05.109605856 +0000 UTC m=+51.033460472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls") pod "image-registry-6c966b5f54-k856m" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528") : secret "image-registry-tls" not found
Jul 23 15:50:57.209732 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:57.209702    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:50:57.209854 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:57.209817    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:50:57.209895 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:50:57.209864    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls podName:3b042f20-34c4-4c4d-afd9-b3616288a7c0 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:05.209852135 +0000 UTC m=+51.133706747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls") pod "dns-default-crv9s" (UID: "3b042f20-34c4-4c4d-afd9-b3616288a7c0") : secret "dns-default-metrics-tls" not found
Jul 23 15:50:57.726765 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:57.726734    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:57.787550 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:57.787528    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:58.910895 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:58.910864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:58.965854 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:58.965822    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:59.600658 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:59.600630    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:59.667226 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:59.667194    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:50:59.960043 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:59.959929    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wkrfk" podStartSLOduration=8.55858505 podStartE2EDuration="10.959912912s" totalImagesPullingTime="2.401327862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:50:53.861568456 +0000 UTC m=+39.785423090" watchObservedRunningTime="2026-07-23 15:50:59.959912912 +0000 UTC m=+45.883767560"
Jul 23 15:50:59.960447 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:59.960430    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t7dx2"]
Jul 23 15:50:59.991607 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:59.991576    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t7dx2"]
Jul 23 15:50:59.991741 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:59.991686    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:50:59.994169 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:59.994145    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 23 15:50:59.994850 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:59.994827    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 23 15:50:59.994971 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:59.994912    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 23 15:50:59.995372 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:59.995357    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n8xfp\""
Jul 23 15:50:59.996194 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:50:59.996180    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 23 15:51:00.023141 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.023116    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:00.030275 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.030253    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.030377 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.030284    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.030377 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.030312    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5nql\" (UniqueName: \"kubernetes.io/projected/cc5039e4-b159-4539-a98a-6e823a828796-kube-api-access-z5nql\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.030441 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.030388    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc5039e4-b159-4539-a98a-6e823a828796-crio-socket\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.030478 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.030450    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc5039e4-b159-4539-a98a-6e823a828796-data-volume\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.130859 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.130825    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc5039e4-b159-4539-a98a-6e823a828796-data-volume\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.130965 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.130879    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.130965 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.130909    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.130965 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.130944    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5nql\" (UniqueName: \"kubernetes.io/projected/cc5039e4-b159-4539-a98a-6e823a828796-kube-api-access-z5nql\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.131123 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.130985    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc5039e4-b159-4539-a98a-6e823a828796-crio-socket\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.131123 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:00.131029    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:00.131123 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:00.131065    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:51:00.131123 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:00.131097    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls podName:cc5039e4-b159-4539-a98a-6e823a828796 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:00.631078769 +0000 UTC m=+46.554933397 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7dx2" (UID: "cc5039e4-b159-4539-a98a-6e823a828796") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:00.131311 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:00.131135    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm podName:cc5039e4-b159-4539-a98a-6e823a828796 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:00.63111519 +0000 UTC m=+46.554969805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7dx2" (UID: "cc5039e4-b159-4539-a98a-6e823a828796") : configmap "kube-rbac-proxy" not found
Jul 23 15:51:00.131311 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.131217    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cc5039e4-b159-4539-a98a-6e823a828796-crio-socket\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.131311 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.131239    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc5039e4-b159-4539-a98a-6e823a828796-data-volume\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.137604 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.137553    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:00.140728 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.140709    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5nql\" (UniqueName: \"kubernetes.io/projected/cc5039e4-b159-4539-a98a-6e823a828796-kube-api-access-z5nql\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.256993 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.256966    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:00.336308 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.336273    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:00.635334 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.635239    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.635334 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.635279    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:00.635564 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:00.635427    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:00.635564 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:00.635475    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:51:00.635564 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:00.635503    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls podName:cc5039e4-b159-4539-a98a-6e823a828796 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:01.635483082 +0000 UTC m=+47.559337695 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7dx2" (UID: "cc5039e4-b159-4539-a98a-6e823a828796") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:00.635564 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:00.635521    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm podName:cc5039e4-b159-4539-a98a-6e823a828796 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:01.63551233 +0000 UTC m=+47.559366943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7dx2" (UID: "cc5039e4-b159-4539-a98a-6e823a828796") : configmap "kube-rbac-proxy" not found
Jul 23 15:51:00.691188 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.691142    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:00.788712 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.788670    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:00.967552 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:00.967523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:01.049179 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:01.049144    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:01.103240 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:01.103208    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:01.644526 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:01.644483    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:01.644730 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:01.644541    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:01.644730 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:01.644614    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:51:01.644730 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:01.644659    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:01.644730 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:01.644671    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm podName:cc5039e4-b159-4539-a98a-6e823a828796 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:03.644655958 +0000 UTC m=+49.568510571 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7dx2" (UID: "cc5039e4-b159-4539-a98a-6e823a828796") : configmap "kube-rbac-proxy" not found
Jul 23 15:51:01.644897 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:01.644753    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls podName:cc5039e4-b159-4539-a98a-6e823a828796 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:03.644733975 +0000 UTC m=+49.568588586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7dx2" (UID: "cc5039e4-b159-4539-a98a-6e823a828796") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:01.954129 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:01.954046    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9k4dp_eabd10ab-eefb-4fb3-a01f-deb9751c945e/dns-node-resolver/0.log"
Jul 23 15:51:02.614225 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:02.614184    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:02.667230 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:02.667184    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:03.155438 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:03.155408    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vcvbr_2f807ec5-5297-4b0d-b04e-9250b909df3a/node-ca/0.log"
Jul 23 15:51:03.627030 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:03.626986    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:03.660273 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:03.660239    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:03.660406 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:03.660277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:03.660446 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:03.660406    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:03.660446 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:03.660420    2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 23 15:51:03.660512 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:03.660490    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls podName:cc5039e4-b159-4539-a98a-6e823a828796 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:07.660472677 +0000 UTC m=+53.584327289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7dx2" (UID: "cc5039e4-b159-4539-a98a-6e823a828796") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:03.660512 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:03.660508    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm podName:cc5039e4-b159-4539-a98a-6e823a828796 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:07.660500592 +0000 UTC m=+53.584355204 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7dx2" (UID: "cc5039e4-b159-4539-a98a-6e823a828796") : configmap "kube-rbac-proxy" not found
Jul 23 15:51:03.955392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:03.955290    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wkrfk_b2e75568-9d55-4a31-8cfc-adf3c6879a2e/serve-healthcheck-canary/0.log"
Jul 23 15:51:05.095916 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:05.095881    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:05.172894 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:05.172861    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:51:05.173087 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:05.172976    2570 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 23 15:51:05.173087 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:05.172990    2570 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6c966b5f54-k856m: secret "image-registry-tls" not found
Jul 23 15:51:05.173087 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:05.173056    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls podName:af0e4e30-578d-479f-9f9f-d7be0848f528 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:21.173042795 +0000 UTC m=+67.096897408 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls") pod "image-registry-6c966b5f54-k856m" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528") : secret "image-registry-tls" not found
Jul 23 15:51:05.273403 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:05.273369    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:51:05.273554 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:05.273509    2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 23 15:51:05.273594 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:05.273563    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls podName:3b042f20-34c4-4c4d-afd9-b3616288a7c0 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:21.27354952 +0000 UTC m=+67.197404131 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls") pod "dns-default-crv9s" (UID: "3b042f20-34c4-4c4d-afd9-b3616288a7c0") : secret "dns-default-metrics-tls" not found
Jul 23 15:51:06.451052 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:06.451002    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:07.661842 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:07.661810    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:07.692438 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:07.692399    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:07.692438 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:07.692444    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:07.692644 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:07.692552    2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:07.692644 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:07.692622    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls podName:cc5039e4-b159-4539-a98a-6e823a828796 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:15.692603535 +0000 UTC m=+61.616458151 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7dx2" (UID: "cc5039e4-b159-4539-a98a-6e823a828796") : secret "insights-runtime-extractor-tls" not found
Jul 23 15:51:07.692956 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:07.692937    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cc5039e4-b159-4539-a98a-6e823a828796-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:08.493480 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:08.493442    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:08.594226 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:08.594188    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:09.514314 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:09.514276    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:09.837890 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:09.837791    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:09.908974 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:09.908943    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:10.171850 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:10.171725    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:10.754715 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:10.754664    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:11.121077 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:11.120995    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:11.220226 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:11.220198    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:11.354118 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:11.354094    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:11.475219 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:11.475175    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:11.576560 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:11.576529    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:11.952980 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:11.952889    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:12.154859 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:12.154827    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:12.212858 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:12.212756    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:12.557525 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:12.557460    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:13.165074 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:13.165027    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:13.264226 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:13.264183    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:13.365391 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:13.365341    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:13.565902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:13.565816    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:13.888800 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:13.888721    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:13.989950 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:13.989915    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:14.367050 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:14.366977    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:14.470365 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:14.470336    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:14.571722 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:14.571692    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:14.784410 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:14.784380    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-56lz5"
Jul 23 15:51:15.157056 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:15.156921    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:15.567646 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:15.567597    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:15.755339 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:15.755296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:15.757680 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:15.757656    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cc5039e4-b159-4539-a98a-6e823a828796-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7dx2\" (UID: \"cc5039e4-b159-4539-a98a-6e823a828796\") " pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:15.764966 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:15.764939    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:15.903731 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:15.903647    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n8xfp\""
Jul 23 15:51:15.911332 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:15.911306    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t7dx2"
Jul 23 15:51:16.045357 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:16.045324    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t7dx2"]
Jul 23 15:51:16.049504 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:16.049474    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5039e4_b159_4539_a98a_6e823a828796.slice/crio-2c91333d703eb84c44a4424ed22c7b5f9f953acd1ceece1692672bb4328e9b89 WatchSource:0}: Error finding container 2c91333d703eb84c44a4424ed22c7b5f9f953acd1ceece1692672bb4328e9b89: Status 404 returned error can't find the container with id 2c91333d703eb84c44a4424ed22c7b5f9f953acd1ceece1692672bb4328e9b89
Jul 23 15:51:16.159024 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:16.158925    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:16.774879 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:16.774833    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:16.857924 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:16.857839    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7dx2" event={"ID":"cc5039e4-b159-4539-a98a-6e823a828796","Type":"ContainerStarted","Data":"2c91333d703eb84c44a4424ed22c7b5f9f953acd1ceece1692672bb4328e9b89"}
Jul 23 15:51:17.152065 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:17.151940    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:17.553980 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:17.553927    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:17.753763 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:17.753720    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:18.164045 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:18.163993    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:18.352064 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:18.352031    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:20.295728 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.295691    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:51:20.296242 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.295736    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cps8w\" (UniqueName: \"kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w\") pod \"network-check-target-fdhds\" (UID: \"e95b191f-0eb7-4e14-83a9-ef22527e0036\") " pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:51:20.299195 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.299169    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 23 15:51:20.299323 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.299179    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 23 15:51:20.308688 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.308661    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/631c3f7e-3c49-43fe-b4ca-610a73cd960e-original-pull-secret\") pod \"global-pull-secret-syncer-v7clr\" (UID: \"631c3f7e-3c49-43fe-b4ca-610a73cd960e\") " pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:51:20.308887 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.308872    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 23 15:51:20.319513 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.319484    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cps8w\" (UniqueName: \"kubernetes.io/projected/e95b191f-0eb7-4e14-83a9-ef22527e0036-kube-api-access-cps8w\") pod \"network-check-target-fdhds\" (UID: \"e95b191f-0eb7-4e14-83a9-ef22527e0036\") " pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:51:20.396172 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.396128    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:51:20.399030 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.398985    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 23 15:51:20.408779 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.408745    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eca674e0-139e-42c0-b87a-03d0e60e43ce-metrics-certs\") pod \"network-metrics-daemon-4wml4\" (UID: \"eca674e0-139e-42c0-b87a-03d0e60e43ce\") " pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:51:20.509276 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.509241    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v7clr"
Jul 23 15:51:20.518280 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.518254    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z9k2x\""
Jul 23 15:51:20.523855 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.523827    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xglcr\""
Jul 23 15:51:20.525898 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.525877    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4wml4"
Jul 23 15:51:20.531960 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:20.531938    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:51:21.060127 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.060097    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v7clr"]
Jul 23 15:51:21.063062 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:21.063035    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod631c3f7e_3c49_43fe_b4ca_610a73cd960e.slice/crio-051d94d38d6b8c6ff9cb610d4eca863f3048e594150959b6521fe401fc64e374 WatchSource:0}: Error finding container 051d94d38d6b8c6ff9cb610d4eca863f3048e594150959b6521fe401fc64e374: Status 404 returned error can't find the container with id 051d94d38d6b8c6ff9cb610d4eca863f3048e594150959b6521fe401fc64e374
Jul 23 15:51:21.075071 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.075043    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fdhds"]
Jul 23 15:51:21.078212 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:21.078187    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode95b191f_0eb7_4e14_83a9_ef22527e0036.slice/crio-2714b8af27fe40c668ba77dcab45d96b67e4ddc7d1dc1f21c3419ed9e326e4ac WatchSource:0}: Error finding container 2714b8af27fe40c668ba77dcab45d96b67e4ddc7d1dc1f21c3419ed9e326e4ac: Status 404 returned error can't find the container with id 2714b8af27fe40c668ba77dcab45d96b67e4ddc7d1dc1f21c3419ed9e326e4ac
Jul 23 15:51:21.078442 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.078420    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4wml4"]
Jul 23 15:51:21.081394 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:21.081373    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca674e0_139e_42c0_b87a_03d0e60e43ce.slice/crio-a87539177417ea04a591731bc85c0b078d35624765ea9e6d898c61f36375f943 WatchSource:0}: Error finding container a87539177417ea04a591731bc85c0b078d35624765ea9e6d898c61f36375f943: Status 404 returned error can't find the container with id a87539177417ea04a591731bc85c0b078d35624765ea9e6d898c61f36375f943
Jul 23 15:51:21.203830 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.203734    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:51:21.206170 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.206149    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls\") pod \"image-registry-6c966b5f54-k856m\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") " pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:51:21.238717 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.238687    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-69gss\""
Jul 23 15:51:21.246752 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.246723    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:51:21.305080 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.304975    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:51:21.307494 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.307454    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3b042f20-34c4-4c4d-afd9-b3616288a7c0-metrics-tls\") pod \"dns-default-crv9s\" (UID: \"3b042f20-34c4-4c4d-afd9-b3616288a7c0\") " pod="openshift-dns/dns-default-crv9s"
Jul 23 15:51:21.378161 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.378099    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6c966b5f54-k856m"]
Jul 23 15:51:21.381139 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:21.381105    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf0e4e30_578d_479f_9f9f_d7be0848f528.slice/crio-a43cd109c912a03f1b5c831ea1931dd31faf6ee9d2d0395b92de8de65b3e94ab WatchSource:0}: Error finding container a43cd109c912a03f1b5c831ea1931dd31faf6ee9d2d0395b92de8de65b3e94ab: Status 404 returned error can't find the container with id a43cd109c912a03f1b5c831ea1931dd31faf6ee9d2d0395b92de8de65b3e94ab
Jul 23 15:51:21.565342 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.565307    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-c4nf5\""
Jul 23 15:51:21.573642 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.573607    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-crv9s"
Jul 23 15:51:21.716485 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.716451    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-crv9s"]
Jul 23 15:51:21.720802 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:21.720777    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b042f20_34c4_4c4d_afd9_b3616288a7c0.slice/crio-65aba8db9d506c5e509fc44394ff3742420b16d3a615c3dcd18f54b18c1cd086 WatchSource:0}: Error finding container 65aba8db9d506c5e509fc44394ff3742420b16d3a615c3dcd18f54b18c1cd086: Status 404 returned error can't find the container with id 65aba8db9d506c5e509fc44394ff3742420b16d3a615c3dcd18f54b18c1cd086
Jul 23 15:51:21.742649 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.742610    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:21.844196 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.844160    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:21.874901 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.874357    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c966b5f54-k856m" event={"ID":"af0e4e30-578d-479f-9f9f-d7be0848f528","Type":"ContainerStarted","Data":"e3f1a9b1498fc97e2c6baf3d45896779c1fa970e13423f209119906e86b8ee21"}
Jul 23 15:51:21.874901 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.874419    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c966b5f54-k856m" event={"ID":"af0e4e30-578d-479f-9f9f-d7be0848f528","Type":"ContainerStarted","Data":"a43cd109c912a03f1b5c831ea1931dd31faf6ee9d2d0395b92de8de65b3e94ab"}
Jul 23 15:51:21.874901 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.874486    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:51:21.875802 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.875772    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4wml4" event={"ID":"eca674e0-139e-42c0-b87a-03d0e60e43ce","Type":"ContainerStarted","Data":"a87539177417ea04a591731bc85c0b078d35624765ea9e6d898c61f36375f943"}
Jul 23 15:51:21.877193 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.877169    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fdhds" event={"ID":"e95b191f-0eb7-4e14-83a9-ef22527e0036","Type":"ContainerStarted","Data":"2714b8af27fe40c668ba77dcab45d96b67e4ddc7d1dc1f21c3419ed9e326e4ac"}
Jul 23 15:51:21.879269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.879244    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v7clr" event={"ID":"631c3f7e-3c49-43fe-b4ca-610a73cd960e","Type":"ContainerStarted","Data":"051d94d38d6b8c6ff9cb610d4eca863f3048e594150959b6521fe401fc64e374"}
Jul 23 15:51:21.880663 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.880639    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-crv9s" event={"ID":"3b042f20-34c4-4c4d-afd9-b3616288a7c0","Type":"ContainerStarted","Data":"65aba8db9d506c5e509fc44394ff3742420b16d3a615c3dcd18f54b18c1cd086"}
Jul 23 15:51:21.882330 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.882307    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7dx2" event={"ID":"cc5039e4-b159-4539-a98a-6e823a828796","Type":"ContainerStarted","Data":"fae2393a5158ea497ca0e5e7c3023a356f552b2c8c0926c7af144dc0a3d19a9f"}
Jul 23 15:51:21.896412 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.896348    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6c966b5f54-k856m" podStartSLOduration=65.89632771 podStartE2EDuration="1m5.89632771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:50:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:21.896166373 +0000 UTC m=+67.820021007" watchObservedRunningTime="2026-07-23 15:51:21.89632771 +0000 UTC m=+67.820182324"
Jul 23 15:51:21.945337 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:21.945301    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:22.367101 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:22.366990    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:22.489460 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:22.489334    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:22.845954 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:22.845900    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:22.897479 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:22.897444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:23.049217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.049184    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:23.115058 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.114941    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:23.418882 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.418783    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:23.620964 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.620928    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:23.891326 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.891276    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4wml4" event={"ID":"eca674e0-139e-42c0-b87a-03d0e60e43ce","Type":"ContainerStarted","Data":"1fefa11692ff0cf9603ee7b30f5bbd60975b279c52ff892f141144df4311c1ef"}
Jul 23 15:51:23.933324 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.933281    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd"]
Jul 23 15:51:23.943549 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.943484    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:23.989500 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.989466    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd"]
Jul 23 15:51:23.989500 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.989507    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c966b5f54-k856m"]
Jul 23 15:51:23.989733 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.989592    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd"
Jul 23 15:51:23.994981 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.994715    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 23 15:51:23.994981 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.994790    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 23 15:51:23.994981 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.994938    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 23 15:51:23.995240 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.995220    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 23 15:51:23.997400 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:23.997375    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qzxjb\""
Jul 23 15:51:24.031776 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.031744    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64c5f57566-fvgx8"]
Jul 23 15:51:24.051798 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.051760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:24.052174 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.052152    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-d49k9"]
Jul 23 15:51:24.052507 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.052487    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.064861 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.064621    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-d49k9"]
Jul 23 15:51:24.064861 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.064661    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64c5f57566-fvgx8"]
Jul 23 15:51:24.064861 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.064760    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-d49k9"
Jul 23 15:51:24.067312 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.067290    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 23 15:51:24.067715 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.067692    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-c2z7r\""
Jul 23 15:51:24.067983 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.067967    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 23 15:51:24.129498 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.129138    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-registry-certificates\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.129498 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.129201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-ca-trust-extracted\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.129498 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.129231    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-installation-pull-secrets\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.129498 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.129257    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4588j\" (UniqueName: \"kubernetes.io/projected/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-kube-api-access-4588j\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.129498 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.129290    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-registry-tls\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.129498 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.129330    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-trusted-ca\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.129498 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.129399    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-bound-sa-token\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.129498 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.129441    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhz6f\" (UniqueName: \"kubernetes.io/projected/2e6321ef-eb99-4e18-a7ab-022f83f77ecb-kube-api-access-mhz6f\") pod \"managed-serviceaccount-addon-agent-6c7466896b-fk9pd\" (UID: \"2e6321ef-eb99-4e18-a7ab-022f83f77ecb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd"
Jul 23 15:51:24.129498 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.129464    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-image-registry-private-configuration\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.130161 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.129570    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e6321ef-eb99-4e18-a7ab-022f83f77ecb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c7466896b-fk9pd\" (UID: \"2e6321ef-eb99-4e18-a7ab-022f83f77ecb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd"
Jul 23 15:51:24.146869 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.146752    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:24.230687 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.230575    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-image-registry-private-configuration\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.230687 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.230623    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e6321ef-eb99-4e18-a7ab-022f83f77ecb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c7466896b-fk9pd\" (UID: \"2e6321ef-eb99-4e18-a7ab-022f83f77ecb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd"
Jul 23 15:51:24.232544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.231051    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-registry-certificates\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.232544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.231106    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-ca-trust-extracted\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.232544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.231136    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-installation-pull-secrets\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.232544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.231163    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4588j\" (UniqueName: \"kubernetes.io/projected/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-kube-api-access-4588j\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.232544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.231191    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r299x\" (UniqueName: \"kubernetes.io/projected/69d39bb9-aa10-4399-bd69-8e60aed59cd7-kube-api-access-r299x\") pod \"downloads-5bc67dcd46-d49k9\" (UID: \"69d39bb9-aa10-4399-bd69-8e60aed59cd7\") " pod="openshift-console/downloads-5bc67dcd46-d49k9"
Jul 23 15:51:24.232544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.231224    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-registry-tls\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.232544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.231261    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-trusted-ca\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.232544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.231311    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-bound-sa-token\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.232544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.231360    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhz6f\" (UniqueName: \"kubernetes.io/projected/2e6321ef-eb99-4e18-a7ab-022f83f77ecb-kube-api-access-mhz6f\") pod \"managed-serviceaccount-addon-agent-6c7466896b-fk9pd\" (UID: \"2e6321ef-eb99-4e18-a7ab-022f83f77ecb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd"
Jul 23 15:51:24.232544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.232378    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-ca-trust-extracted\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.232544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.232477    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-trusted-ca\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.232544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.232527    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-registry-certificates\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.234676 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.234645    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-installation-pull-secrets\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.235180 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.235153    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-registry-tls\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.235544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.235507    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2e6321ef-eb99-4e18-a7ab-022f83f77ecb-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6c7466896b-fk9pd\" (UID: \"2e6321ef-eb99-4e18-a7ab-022f83f77ecb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd"
Jul 23 15:51:24.236026 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.235981    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-image-registry-private-configuration\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.242736 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.242622    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4588j\" (UniqueName: \"kubernetes.io/projected/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-kube-api-access-4588j\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.242736 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.242672    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhz6f\" (UniqueName: \"kubernetes.io/projected/2e6321ef-eb99-4e18-a7ab-022f83f77ecb-kube-api-access-mhz6f\") pod \"managed-serviceaccount-addon-agent-6c7466896b-fk9pd\" (UID: \"2e6321ef-eb99-4e18-a7ab-022f83f77ecb\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd"
Jul 23 15:51:24.244699 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.244338    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ed7cd7af-261f-4dbd-9e17-2d9c02ae6958-bound-sa-token\") pod \"image-registry-64c5f57566-fvgx8\" (UID: \"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958\") " pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.247565 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.247494    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:24.315839 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.315800    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd"
Jul 23 15:51:24.332237 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.332206    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r299x\" (UniqueName: \"kubernetes.io/projected/69d39bb9-aa10-4399-bd69-8e60aed59cd7-kube-api-access-r299x\") pod \"downloads-5bc67dcd46-d49k9\" (UID: \"69d39bb9-aa10-4399-bd69-8e60aed59cd7\") " pod="openshift-console/downloads-5bc67dcd46-d49k9"
Jul 23 15:51:24.341560 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.341528    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r299x\" (UniqueName: \"kubernetes.io/projected/69d39bb9-aa10-4399-bd69-8e60aed59cd7-kube-api-access-r299x\") pod \"downloads-5bc67dcd46-d49k9\" (UID: \"69d39bb9-aa10-4399-bd69-8e60aed59cd7\") " pod="openshift-console/downloads-5bc67dcd46-d49k9"
Jul 23 15:51:24.365696 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.365658    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:24.376614 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:24.376578    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-d49k9"
Jul 23 15:51:25.481145 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:25.481096    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:25.539658 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:25.539616    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:26.768420 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:26.768372    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:26.827918 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:26.827866    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:28.731544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.730530    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64c5f57566-fvgx8"]
Jul 23 15:51:28.740834 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:28.740788    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7cd7af_261f_4dbd_9e17_2d9c02ae6958.slice/crio-7bdbbc9ceb8a728f1f53d9b9be4403925a5535e164346633f689a34ee3e18404 WatchSource:0}: Error finding container 7bdbbc9ceb8a728f1f53d9b9be4403925a5535e164346633f689a34ee3e18404: Status 404 returned error can't find the container with id 7bdbbc9ceb8a728f1f53d9b9be4403925a5535e164346633f689a34ee3e18404
Jul 23 15:51:28.763429 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.763385    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd"]
Jul 23 15:51:28.767976 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:28.767950    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e6321ef_eb99_4e18_a7ab_022f83f77ecb.slice/crio-207b5cd67a32149d373b215a6f5d28b1d3a3269dad465c7c6bc919fa7e846345 WatchSource:0}: Error finding container 207b5cd67a32149d373b215a6f5d28b1d3a3269dad465c7c6bc919fa7e846345: Status 404 returned error can't find the container with id 207b5cd67a32149d373b215a6f5d28b1d3a3269dad465c7c6bc919fa7e846345
Jul 23 15:51:28.785960 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.785891    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-d49k9"]
Jul 23 15:51:28.794563 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:28.794527    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d39bb9_aa10_4399_bd69_8e60aed59cd7.slice/crio-eb5f279510fdcf203391351c953cfb690e2b9a45e4e09864d384cd76ddbb65ff WatchSource:0}: Error finding container eb5f279510fdcf203391351c953cfb690e2b9a45e4e09864d384cd76ddbb65ff: Status 404 returned error can't find the container with id eb5f279510fdcf203391351c953cfb690e2b9a45e4e09864d384cd76ddbb65ff
Jul 23 15:51:28.908893 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.908846    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4wml4" event={"ID":"eca674e0-139e-42c0-b87a-03d0e60e43ce","Type":"ContainerStarted","Data":"1e5e10a69bcae5c9d63f83e9ac76c31b6304ea1018391010a5e16b33527c856f"}
Jul 23 15:51:28.910572 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.910522    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fdhds" event={"ID":"e95b191f-0eb7-4e14-83a9-ef22527e0036","Type":"ContainerStarted","Data":"e7bf94bc2d568099914029e7124ccb7555c7a1f27f3580e0ef13c7777c64453a"}
Jul 23 15:51:28.910726 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.910574    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:51:28.912263 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.912238    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v7clr" event={"ID":"631c3f7e-3c49-43fe-b4ca-610a73cd960e","Type":"ContainerStarted","Data":"1faa6f3960b1555a3d52a03663bfc60d2400530e0ccfd9024ebfb59487ec01f5"}
Jul 23 15:51:28.913548 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.913525    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd" event={"ID":"2e6321ef-eb99-4e18-a7ab-022f83f77ecb","Type":"ContainerStarted","Data":"207b5cd67a32149d373b215a6f5d28b1d3a3269dad465c7c6bc919fa7e846345"}
Jul 23 15:51:28.914748 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.914725    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-d49k9" event={"ID":"69d39bb9-aa10-4399-bd69-8e60aed59cd7","Type":"ContainerStarted","Data":"eb5f279510fdcf203391351c953cfb690e2b9a45e4e09864d384cd76ddbb65ff"}
Jul 23 15:51:28.916298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.916272    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64c5f57566-fvgx8" event={"ID":"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958","Type":"ContainerStarted","Data":"cc4534367d4c322d8d76fb4c6436295f71b8c2b4f145175fb30ca05c2d42937d"}
Jul 23 15:51:28.916421 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.916317    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64c5f57566-fvgx8" event={"ID":"ed7cd7af-261f-4dbd-9e17-2d9c02ae6958","Type":"ContainerStarted","Data":"7bdbbc9ceb8a728f1f53d9b9be4403925a5535e164346633f689a34ee3e18404"}
Jul 23 15:51:28.916421 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.916361    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:28.918209 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.918187    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-crv9s" event={"ID":"3b042f20-34c4-4c4d-afd9-b3616288a7c0","Type":"ContainerStarted","Data":"ead3f9642bdec464cde0eb349bbfe17c01d2c6409b833aa752cde5c266d4e81c"}
Jul 23 15:51:28.918321 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.918226    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-crv9s" event={"ID":"3b042f20-34c4-4c4d-afd9-b3616288a7c0","Type":"ContainerStarted","Data":"fe27279e09abfe83ac5fc3d2d93bb184439cea01e0a84bfa9340ae2565b1d9c3"}
Jul 23 15:51:28.918321 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.918247    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-crv9s"
Jul 23 15:51:28.920144 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.920127    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7dx2" event={"ID":"cc5039e4-b159-4539-a98a-6e823a828796","Type":"ContainerStarted","Data":"8caf9e58388daa6e6b7d18ffd102289d502816c2cd25c7b47db46d6b2560c0ca"}
Jul 23 15:51:28.925134 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.925077    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4wml4" podStartSLOduration=72.55267504 podStartE2EDuration="1m14.925058427s" totalImagesPullingTime="2.372383387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:28.924409379 +0000 UTC m=+74.848264013" watchObservedRunningTime="2026-07-23 15:51:28.925058427 +0000 UTC m=+74.848913065"
Jul 23 15:51:28.939423 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.939359    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fdhds" podStartSLOduration=67.472793002 podStartE2EDuration="1m14.939336329s" totalImagesPullingTime="7.466543327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:28.938736157 +0000 UTC m=+74.862590805" watchObservedRunningTime="2026-07-23 15:51:28.939336329 +0000 UTC m=+74.863190965"
Jul 23 15:51:28.952330 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.952264    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v7clr" podStartSLOduration=67.471460013 podStartE2EDuration="1m14.952242015s" totalImagesPullingTime="7.480782002s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:28.952130996 +0000 UTC m=+74.875985634" watchObservedRunningTime="2026-07-23 15:51:28.952242015 +0000 UTC m=+74.876096651"
Jul 23 15:51:28.969217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.969165    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-crv9s" podStartSLOduration=33.145513049 podStartE2EDuration="39.969150919s" totalImagesPullingTime="6.82363787s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:50:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:28.968473601 +0000 UTC m=+74.892328237" watchObservedRunningTime="2026-07-23 15:51:28.969150919 +0000 UTC m=+74.893005610"
Jul 23 15:51:28.991279 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:28.991220    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64c5f57566-fvgx8" podStartSLOduration=4.991203026 podStartE2EDuration="4.991203026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:28.990328436 +0000 UTC m=+74.914183071" watchObservedRunningTime="2026-07-23 15:51:28.991203026 +0000 UTC m=+74.915057661"
Jul 23 15:51:29.021147 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:29.021120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:29.077409 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:29.077318    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:30.934794 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:30.934760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:31.014423 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.014389    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:31.100545 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.100499    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:31.103354 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.103325    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb"]
Jul 23 15:51:31.106619 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.106593    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb"
Jul 23 15:51:31.109330 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.109100    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 23 15:51:31.109330 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.109189    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-79c8t\""
Jul 23 15:51:31.114477 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.114449    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb"]
Jul 23 15:51:31.187654 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.187537    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/58215c1a-8b23-45de-b3fc-747c993f264a-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-sq5kb\" (UID: \"58215c1a-8b23-45de-b3fc-747c993f264a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb"
Jul 23 15:51:31.260344 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.260299    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:31.288313 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.288275    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/58215c1a-8b23-45de-b3fc-747c993f264a-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-sq5kb\" (UID: \"58215c1a-8b23-45de-b3fc-747c993f264a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb"
Jul 23 15:51:31.291194 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.291164    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/58215c1a-8b23-45de-b3fc-747c993f264a-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-sq5kb\" (UID: \"58215c1a-8b23-45de-b3fc-747c993f264a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb"
Jul 23 15:51:31.419635 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.419406    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb"
Jul 23 15:51:31.840324 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.840291    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:31.907680 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:31.907639    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:32.656653 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.656607    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-db7fdb888-mvk7f"]
Jul 23 15:51:32.673512 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.673478    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db7fdb888-mvk7f"]
Jul 23 15:51:32.673682 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.673599    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.677354 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.677175    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fg6wd\""
Jul 23 15:51:32.677354 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.677181    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 15:51:32.677354 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.677275    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 15:51:32.678475 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.678449    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 15:51:32.678613 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.678493    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 15:51:32.678613 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.678493    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 15:51:32.801882 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.801733    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-config\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.801882 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.801781    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-service-ca\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.801882 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.801820    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-oauth-config\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.802151 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.801922    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-oauth-serving-cert\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.802151 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.801982    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7glp\" (UniqueName: \"kubernetes.io/projected/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-kube-api-access-d7glp\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.802151 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.802051    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-serving-cert\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.842287 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.842257    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb"]
Jul 23 15:51:32.845720 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:32.845694    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58215c1a_8b23_45de_b3fc_747c993f264a.slice/crio-9db5484bbd5106b004d841f8c241dd1ab89f2189d4c2ce0666fa11f0823a4d33 WatchSource:0}: Error finding container 9db5484bbd5106b004d841f8c241dd1ab89f2189d4c2ce0666fa11f0823a4d33: Status 404 returned error can't find the container with id 9db5484bbd5106b004d841f8c241dd1ab89f2189d4c2ce0666fa11f0823a4d33
Jul 23 15:51:32.902677 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.902640    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-oauth-config\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.902867 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.902694    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-oauth-serving-cert\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.902867 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.902731    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7glp\" (UniqueName: \"kubernetes.io/projected/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-kube-api-access-d7glp\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.902867 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.902755    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-serving-cert\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.902867 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.902795    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-config\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.902867 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.902824    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-service-ca\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.903718 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.903683    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-service-ca\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.903848 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.903683    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-oauth-serving-cert\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.904174 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.904153    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-config\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.905784 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.905755    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-oauth-config\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.905872 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.905815    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-serving-cert\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.912259 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.912177    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7glp\" (UniqueName: \"kubernetes.io/projected/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-kube-api-access-d7glp\") pod \"console-db7fdb888-mvk7f\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") " pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:32.941070 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.941001    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7dx2" event={"ID":"cc5039e4-b159-4539-a98a-6e823a828796","Type":"ContainerStarted","Data":"95792fdc269094405a7e49eb3dcecb259ae506d8a1a14e18b5bfe117c21911a9"}
Jul 23 15:51:32.942351 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.942314    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb" event={"ID":"58215c1a-8b23-45de-b3fc-747c993f264a","Type":"ContainerStarted","Data":"9db5484bbd5106b004d841f8c241dd1ab89f2189d4c2ce0666fa11f0823a4d33"}
Jul 23 15:51:32.960988 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.960929    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t7dx2" podStartSLOduration=17.480588084 podStartE2EDuration="33.960907469s" totalImagesPullingTime="16.480319385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:50:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:32.959963526 +0000 UTC m=+78.883818184" watchObservedRunningTime="2026-07-23 15:51:32.960907469 +0000 UTC m=+78.884762103"
Jul 23 15:51:32.986096 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:32.986058    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:33.136425 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:33.136389    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-db7fdb888-mvk7f"]
Jul 23 15:51:33.140046 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:33.139990    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1037697_2c3a_41d5_9ca9_d4c34e400fc8.slice/crio-abedb697ff0ebf244bc0b110f25b1ab4bd01f69d1ddfb21ec4c247e3dcb19201 WatchSource:0}: Error finding container abedb697ff0ebf244bc0b110f25b1ab4bd01f69d1ddfb21ec4c247e3dcb19201: Status 404 returned error can't find the container with id abedb697ff0ebf244bc0b110f25b1ab4bd01f69d1ddfb21ec4c247e3dcb19201
Jul 23 15:51:33.952700 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:33.952596    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db7fdb888-mvk7f" event={"ID":"f1037697-2c3a-41d5-9ca9-d4c34e400fc8","Type":"ContainerStarted","Data":"abedb697ff0ebf244bc0b110f25b1ab4bd01f69d1ddfb21ec4c247e3dcb19201"}
Jul 23 15:51:34.959146 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:34.958684    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb" event={"ID":"58215c1a-8b23-45de-b3fc-747c993f264a","Type":"ContainerStarted","Data":"3d356d3682aa4915eb4ffe3d300288e658791f184138b1608298ff1bb1b2da45"}
Jul 23 15:51:34.959146 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:34.958866    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb"
Jul 23 15:51:34.965108 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:34.965077    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb"
Jul 23 15:51:34.977549 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:34.977389    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-sq5kb" podStartSLOduration=2.650536812 podStartE2EDuration="3.977367695s" totalImagesPullingTime="1.326830883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:34.975760258 +0000 UTC m=+80.899614895" watchObservedRunningTime="2026-07-23 15:51:34.977367695 +0000 UTC m=+80.901222331"
Jul 23 15:51:35.128737 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.128689    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:35.173167 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.173115    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"]
Jul 23 15:51:35.177919 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.177738    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.180447 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.180417    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 23 15:51:35.180838 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.180700    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 23 15:51:35.180838 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.180802    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 23 15:51:35.181035 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.180911    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5vp5c\""
Jul 23 15:51:35.181099 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.181072    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 23 15:51:35.181345 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.181324    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 23 15:51:35.188492 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.188315    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"]
Jul 23 15:51:35.203294 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.203228    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:35.321319 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.321277    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0ab6951-8de3-4815-9176-31991b75be4d-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-7ztlg\" (UID: \"f0ab6951-8de3-4815-9176-31991b75be4d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.321519 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.321368    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4f9b\" (UniqueName: \"kubernetes.io/projected/f0ab6951-8de3-4815-9176-31991b75be4d-kube-api-access-g4f9b\") pod \"prometheus-operator-5945b5cfd-7ztlg\" (UID: \"f0ab6951-8de3-4815-9176-31991b75be4d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.321519 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.321460    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0ab6951-8de3-4815-9176-31991b75be4d-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-7ztlg\" (UID: \"f0ab6951-8de3-4815-9176-31991b75be4d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.321519 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.321500    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0ab6951-8de3-4815-9176-31991b75be4d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-7ztlg\" (UID: \"f0ab6951-8de3-4815-9176-31991b75be4d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.422973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.422929    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4f9b\" (UniqueName: \"kubernetes.io/projected/f0ab6951-8de3-4815-9176-31991b75be4d-kube-api-access-g4f9b\") pod \"prometheus-operator-5945b5cfd-7ztlg\" (UID: \"f0ab6951-8de3-4815-9176-31991b75be4d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.423174 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.422999    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0ab6951-8de3-4815-9176-31991b75be4d-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-7ztlg\" (UID: \"f0ab6951-8de3-4815-9176-31991b75be4d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.423174 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.423058    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0ab6951-8de3-4815-9176-31991b75be4d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-7ztlg\" (UID: \"f0ab6951-8de3-4815-9176-31991b75be4d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.423174 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.423106    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0ab6951-8de3-4815-9176-31991b75be4d-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-7ztlg\" (UID: \"f0ab6951-8de3-4815-9176-31991b75be4d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.424135 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.424110    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0ab6951-8de3-4815-9176-31991b75be4d-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-7ztlg\" (UID: \"f0ab6951-8de3-4815-9176-31991b75be4d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.426316 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.426289    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f0ab6951-8de3-4815-9176-31991b75be4d-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-7ztlg\" (UID: \"f0ab6951-8de3-4815-9176-31991b75be4d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.426431 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.426287    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0ab6951-8de3-4815-9176-31991b75be4d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-7ztlg\" (UID: \"f0ab6951-8de3-4815-9176-31991b75be4d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.432276 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.432243    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4f9b\" (UniqueName: \"kubernetes.io/projected/f0ab6951-8de3-4815-9176-31991b75be4d-kube-api-access-g4f9b\") pod \"prometheus-operator-5945b5cfd-7ztlg\" (UID: \"f0ab6951-8de3-4815-9176-31991b75be4d\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:35.438737 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.438668    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:35.490514 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:35.490475    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"
Jul 23 15:51:36.652155 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:36.652116    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg"]
Jul 23 15:51:36.969123 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:36.969080    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db7fdb888-mvk7f" event={"ID":"f1037697-2c3a-41d5-9ca9-d4c34e400fc8","Type":"ContainerStarted","Data":"2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f"}
Jul 23 15:51:36.970469 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:36.970444    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg" event={"ID":"f0ab6951-8de3-4815-9176-31991b75be4d","Type":"ContainerStarted","Data":"2d86c2c3a77f4bda503b7f9f50db8bde329a7ebd3d78610c001493639df80e4e"}
Jul 23 15:51:36.988445 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:36.988125    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-db7fdb888-mvk7f" podStartSLOduration=1.5821219389999999 podStartE2EDuration="4.988106864s" totalImagesPullingTime="3.405984925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:36.986085654 +0000 UTC m=+82.909940289" watchObservedRunningTime="2026-07-23 15:51:36.988106864 +0000 UTC m=+82.911961497"
Jul 23 15:51:37.933313 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:37.933229    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:38.009191 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:38.009093    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:38.565521 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:38.565415    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:38.665684 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:38.665650    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:38.927948 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:38.927876    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-crv9s"
Jul 23 15:51:38.984526 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:38.984484    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg" event={"ID":"f0ab6951-8de3-4815-9176-31991b75be4d","Type":"ContainerStarted","Data":"01577d19d3d0b674cdf492fe30d516fd0fb449e16884733e2adb077937f8fb0b"}
Jul 23 15:51:39.125490 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:39.125457    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:39.991412 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:39.991372    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg" event={"ID":"f0ab6951-8de3-4815-9176-31991b75be4d","Type":"ContainerStarted","Data":"13d5fbe85f0ccee8e03264d2c17244a03bf13105493e6df47f3f5e25cea18305"}
Jul 23 15:51:40.011921 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:40.011858    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-7ztlg" podStartSLOduration=3.412761503 podStartE2EDuration="5.011833992s" totalImagesPullingTime="1.599072489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:40.010328846 +0000 UTC m=+85.934183495" watchObservedRunningTime="2026-07-23 15:51:40.011833992 +0000 UTC m=+85.935688616"
Jul 23 15:51:41.287358 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.287321    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:41.498042 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.497972    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:41.528960 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.528918    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"]
Jul 23 15:51:41.542295 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.542205    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:41.544278 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.544245    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"]
Jul 23 15:51:41.546181 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.545921    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 23 15:51:41.546181 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.545971    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-p8btm\""
Jul 23 15:51:41.546181 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.545971    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 23 15:51:41.559463 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.559434    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tlhdq"]
Jul 23 15:51:41.564237 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.564215    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.567054 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.566926    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 23 15:51:41.567201 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.566940    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 23 15:51:41.567201 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.567070    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 23 15:51:41.567201 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.567028    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dbzlp\""
Jul 23 15:51:41.574692 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.574666    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:41.639677 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.639639    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:41.676519 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676480    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-tls\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.676712 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676571    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:41.676712 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-textfile\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.676712 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676637    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.676712 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676657    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-root\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.676712 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676700    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf86g\" (UniqueName: \"kubernetes.io/projected/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-kube-api-access-hf86g\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:41.676942 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676734    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-metrics-client-ca\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.676942 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676810    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:41.676942 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676847    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:41.676942 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676901    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-wtmp\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.676942 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676938    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.677201 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676962    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqlt5\" (UniqueName: \"kubernetes.io/projected/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-kube-api-access-zqlt5\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.677201 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.676987    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-sys\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.778408 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778364    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:41.778590 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:41.778590 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778448    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-wtmp\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.778590 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778473    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.778590 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778496    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqlt5\" (UniqueName: \"kubernetes.io/projected/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-kube-api-access-zqlt5\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.778590 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778522    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-sys\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.778590 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778569    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-tls\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.778884 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778606    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:41.778884 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778654    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-textfile\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.778884 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.778884 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778710    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-root\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.778884 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf86g\" (UniqueName: \"kubernetes.io/projected/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-kube-api-access-hf86g\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:41.778884 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.778769    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-metrics-client-ca\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.779470 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.779442    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-metrics-client-ca\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.779944 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:41.779922    2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 23 15:51:41.780093 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:41.780029    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-tls podName:8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f nodeName:}" failed. No retries permitted until 2026-07-23 15:51:42.279991327 +0000 UTC m=+88.203845947 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-tls") pod "node-exporter-tlhdq" (UID: "8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f") : secret "node-exporter-tls" not found
Jul 23 15:51:41.780379 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.780353    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-wtmp\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.780487 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.780422    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.780487 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.780437    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-sys\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.780609 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.780491    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-root\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.780609 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:41.780533    2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 23 15:51:41.780609 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:41.780596    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-openshift-state-metrics-tls podName:8ce7bcfe-f1cf-4178-8c06-0381dbc97b17 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:42.280577148 +0000 UTC m=+88.204431778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-ln7nn" (UID: "8ce7bcfe-f1cf-4178-8c06-0381dbc97b17") : secret "openshift-state-metrics-tls" not found
Jul 23 15:51:41.781448 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.781421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-textfile\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.781621 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.781569    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:41.782360 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.782332    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:41.783055 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.783031    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:41.783808 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.783779    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.791311 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.791208    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqlt5\" (UniqueName: \"kubernetes.io/projected/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-kube-api-access-zqlt5\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:41.791311 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.791288    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf86g\" (UniqueName: \"kubernetes.io/projected/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-kube-api-access-hf86g\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:41.847777 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.847686    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85bc69594f-766j8"]
Jul 23 15:51:41.852418 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.852379    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:41.855503 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.855484    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:41.862901 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.862868    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85bc69594f-766j8"]
Jul 23 15:51:41.864134 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.864107    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 15:51:41.914540 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.914504    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:41.980156 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.980115    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-config\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:41.980342 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.980229    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-oauth-config\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:41.980342 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.980264    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbbrx\" (UniqueName: \"kubernetes.io/projected/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-kube-api-access-bbbrx\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:41.980342 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.980300    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-service-ca\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:41.980516 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.980414    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-serving-cert\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:41.980516 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.980453    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-trusted-ca-bundle\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:41.980516 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:41.980484    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-oauth-serving-cert\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.082051 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.081592    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbbrx\" (UniqueName: \"kubernetes.io/projected/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-kube-api-access-bbbrx\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.082051 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.081660    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-service-ca\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.082051 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.081721    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-serving-cert\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.082051 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.081754    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-trusted-ca-bundle\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.082051 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.081785    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-oauth-serving-cert\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.082051 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.081809    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-config\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.082051 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.081873    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-oauth-config\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.082589 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.082432    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-service-ca\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.082988 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.082936    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-config\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.083350 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.083180    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-trusted-ca-bundle\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.083648 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.083628    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-oauth-serving-cert\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.084813 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.084788    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-oauth-config\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.084890 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.084868    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-serving-cert\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.091373 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.091312    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbbrx\" (UniqueName: \"kubernetes.io/projected/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-kube-api-access-bbbrx\") pod \"console-85bc69594f-766j8\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") " pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.106584 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.106498    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:42.168210 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.168169    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:42.205671 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.205642    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:42.283641 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.283604    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-tls\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:42.283828 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.283652    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:42.286361 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.286326    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f-node-exporter-tls\") pod \"node-exporter-tlhdq\" (UID: \"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f\") " pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:42.286646 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.286622    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8ce7bcfe-f1cf-4178-8c06-0381dbc97b17-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-ln7nn\" (UID: \"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:42.310645 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.310614    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:42.459750 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.459658    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"
Jul 23 15:51:42.475246 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.475170    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tlhdq"
Jul 23 15:51:42.518508 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.518469    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:42.596715 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.596669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:42.602416 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.602390    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:51:42.624236 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.624200    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:51:42.624432 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.624343    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.629246 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.628601    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 15:51:42.629246 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.628702    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 15:51:42.629246 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.628869    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 15:51:42.629246 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.628895    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4x6xb\""
Jul 23 15:51:42.629246 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.628601    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 15:51:42.629246 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.629123    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 15:51:42.629246 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.629192    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 15:51:42.629777 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.629287    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 15:51:42.629777 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.629488    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 15:51:42.629777 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.629541    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 15:51:42.687458 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687422    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.687652 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687479    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hfrv\" (UniqueName: \"kubernetes.io/projected/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-kube-api-access-5hfrv\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.687652 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687500    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.687652 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687519    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.687652 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687542    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-config-volume\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.687652 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687567    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-web-config\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.687922 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687648    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.687922 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.687922 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687713    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.687922 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687801    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-config-out\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.687922 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687838    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.687922 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687878    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.688214 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.687927    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.789184 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.789143    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.789382 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.789207    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hfrv\" (UniqueName: \"kubernetes.io/projected/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-kube-api-access-5hfrv\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.789382 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.789235    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.789382 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.789264    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.789585 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.789556    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-config-volume\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.789753 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.789656    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.789753 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.789693    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-web-config\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.789753 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.789748    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.789910 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.789779    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.789910 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.789806    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.790032 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:42.789932    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-trusted-ca-bundle podName:8aa53e05-2a4d-41d1-b2eb-95de579d16e0 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:43.289910477 +0000 UTC m=+89.213765091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0") : configmap references non-existent config key: ca-bundle.crt
Jul 23 15:51:42.790301 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.790277    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-config-out\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.790414 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.790326    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.790414 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.790371    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.790529 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.790430    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.791606 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.791575    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.792674 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.792647    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.793032 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.792961    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-config-volume\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.793647 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.793553    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.793859 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.793838    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.794072 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.794021    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-web-config\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.794180 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.794131    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.794247 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.794191    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.794401 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.794383    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-config-out\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.795666 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.795642    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.798456 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.798431    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hfrv\" (UniqueName: \"kubernetes.io/projected/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-kube-api-access-5hfrv\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:42.837983 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.837946    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:42.986846 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.986797    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:42.987070 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.986902    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:42.992573 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:42.992542    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:43.008675 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:43.008640    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:51:43.295696 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:43.295655    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:43.296665 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:43.296643    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:43.536666 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:43.536609    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:51:43.996152 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:43.996123    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:51:44.210349 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:44.210307    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:44.373075 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:44.372958    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:44.472865 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:44.472834    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:44.574360 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:44.574320    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:44.674703 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:44.674626    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:45.041791 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:45.041746    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:45.957078 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:45.955530    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"]
Jul 23 15:51:46.034535 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.034494    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"]
Jul 23 15:51:46.034705 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.034632    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.038079 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.038040    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 23 15:51:46.039066 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.039045    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 23 15:51:46.039194 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.039101    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 23 15:51:46.039194 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.039172    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-svhxx\""
Jul 23 15:51:46.039343 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.039106    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 23 15:51:46.039452 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.039374    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-837uemrsndisl\""
Jul 23 15:51:46.117633 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.117594    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffd39c19-482d-438c-867f-c12dfe437e6d-client-ca-bundle\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.117821 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.117646    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ffd39c19-482d-438c-867f-c12dfe437e6d-metrics-server-audit-profiles\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.117821 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.117764    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jwgl\" (UniqueName: \"kubernetes.io/projected/ffd39c19-482d-438c-867f-c12dfe437e6d-kube-api-access-7jwgl\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.117821 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.117808    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ffd39c19-482d-438c-867f-c12dfe437e6d-secret-metrics-server-client-certs\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.117959 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.117906    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ffd39c19-482d-438c-867f-c12dfe437e6d-audit-log\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.117959 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.117945    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ffd39c19-482d-438c-867f-c12dfe437e6d-secret-metrics-server-tls\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.118092 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.117978    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd39c19-482d-438c-867f-c12dfe437e6d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.219450 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.219417    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jwgl\" (UniqueName: \"kubernetes.io/projected/ffd39c19-482d-438c-867f-c12dfe437e6d-kube-api-access-7jwgl\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.219637 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.219466    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ffd39c19-482d-438c-867f-c12dfe437e6d-secret-metrics-server-client-certs\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.219637 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.219519    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ffd39c19-482d-438c-867f-c12dfe437e6d-audit-log\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.219637 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.219538    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ffd39c19-482d-438c-867f-c12dfe437e6d-secret-metrics-server-tls\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.219637 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.219565    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd39c19-482d-438c-867f-c12dfe437e6d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.219637 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.219603    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffd39c19-482d-438c-867f-c12dfe437e6d-client-ca-bundle\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.219891 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.219640    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ffd39c19-482d-438c-867f-c12dfe437e6d-metrics-server-audit-profiles\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.219991 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.219959    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/ffd39c19-482d-438c-867f-c12dfe437e6d-audit-log\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.220405 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.220371    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffd39c19-482d-438c-867f-c12dfe437e6d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.220759 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.220734    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/ffd39c19-482d-438c-867f-c12dfe437e6d-metrics-server-audit-profiles\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.222353 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.222330    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/ffd39c19-482d-438c-867f-c12dfe437e6d-secret-metrics-server-client-certs\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.222576 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.222553    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ffd39c19-482d-438c-867f-c12dfe437e6d-client-ca-bundle\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.222661 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.222585    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/ffd39c19-482d-438c-867f-c12dfe437e6d-secret-metrics-server-tls\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.229140 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.229114    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jwgl\" (UniqueName: \"kubernetes.io/projected/ffd39c19-482d-438c-867f-c12dfe437e6d-kube-api-access-7jwgl\") pod \"metrics-server-65c8dd4f76-6bqcw\" (UID: \"ffd39c19-482d-438c-867f-c12dfe437e6d\") " pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.315435 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.315398    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"]
Jul 23 15:51:46.331559 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.331524    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:46.346556 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.346525    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:51:46.370901 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.370867    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"]
Jul 23 15:51:46.371118 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.370980    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"
Jul 23 15:51:46.373682 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.373652    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 23 15:51:46.373826 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.373755    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tprrk\""
Jul 23 15:51:46.393888 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.393851    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:46.421726 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.421681    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-sk7wq\" (UID: \"6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"
Jul 23 15:51:46.421903 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.421750    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbmj8\" (UniqueName: \"kubernetes.io/projected/6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9-kube-api-access-dbmj8\") pod \"monitoring-plugin-7b7b7bc8bf-sk7wq\" (UID: \"6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"
Jul 23 15:51:46.523345 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.523260    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-sk7wq\" (UID: \"6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"
Jul 23 15:51:46.523345 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.523319    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbmj8\" (UniqueName: \"kubernetes.io/projected/6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9-kube-api-access-dbmj8\") pod \"monitoring-plugin-7b7b7bc8bf-sk7wq\" (UID: \"6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"
Jul 23 15:51:46.523564 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:46.523443    2570 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 23 15:51:46.523564 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:51:46.523528    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9-monitoring-plugin-cert podName:6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9 nodeName:}" failed. No retries permitted until 2026-07-23 15:51:47.023501749 +0000 UTC m=+92.947356365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-sk7wq" (UID: "6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9") : secret "monitoring-plugin-cert" not found
Jul 23 15:51:46.532515 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.532483    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbmj8\" (UniqueName: \"kubernetes.io/projected/6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9-kube-api-access-dbmj8\") pod \"monitoring-plugin-7b7b7bc8bf-sk7wq\" (UID: \"6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"
Jul 23 15:51:46.674846 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:46.674809    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:47.028242 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:47.028207    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-sk7wq\" (UID: \"6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"
Jul 23 15:51:47.030666 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:47.030636    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-sk7wq\" (UID: \"6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"
Jul 23 15:51:47.124148 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:47.123996    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e90c3ee_dbcd_4e1c_99c0_fabaee0b9d2f.slice/crio-89dc87e79a21b3b7b99efd2ddcdb849a2bb97dd0e5ca2d8fa3468cbad356829f WatchSource:0}: Error finding container 89dc87e79a21b3b7b99efd2ddcdb849a2bb97dd0e5ca2d8fa3468cbad356829f: Status 404 returned error can't find the container with id 89dc87e79a21b3b7b99efd2ddcdb849a2bb97dd0e5ca2d8fa3468cbad356829f
Jul 23 15:51:47.283082 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:47.282777    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"
Jul 23 15:51:47.305236 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:47.305085    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn"]
Jul 23 15:51:47.310808 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:47.310775    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ce7bcfe_f1cf_4178_8c06_0381dbc97b17.slice/crio-57f0ab2fc8603708483743b2021e3cf3bca42b2d95bcde1f5b0481c8d8eb1938 WatchSource:0}: Error finding container 57f0ab2fc8603708483743b2021e3cf3bca42b2d95bcde1f5b0481c8d8eb1938: Status 404 returned error can't find the container with id 57f0ab2fc8603708483743b2021e3cf3bca42b2d95bcde1f5b0481c8d8eb1938
Jul 23 15:51:47.446099 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:47.446025    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"]
Jul 23 15:51:47.449797 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:47.449768    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afb74f3_2562_44b5_b5f5_1acb5cfe0cf9.slice/crio-4fde31ab1009882773ef951ff01cdb4b5b363444f8db83d33cae0e91e618eab8 WatchSource:0}: Error finding container 4fde31ab1009882773ef951ff01cdb4b5b363444f8db83d33cae0e91e618eab8: Status 404 returned error can't find the container with id 4fde31ab1009882773ef951ff01cdb4b5b363444f8db83d33cae0e91e618eab8
Jul 23 15:51:47.547384 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:47.547293    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85bc69594f-766j8"]
Jul 23 15:51:47.548279 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:47.548218    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"]
Jul 23 15:51:47.548794 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:47.548765    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9b919d_02dd_4f9c_8a28_b43495ae6ff9.slice/crio-ddf163e103bda8992946983d7f2d97476f18601ee9545df03092177a80626829 WatchSource:0}: Error finding container ddf163e103bda8992946983d7f2d97476f18601ee9545df03092177a80626829: Status 404 returned error can't find the container with id ddf163e103bda8992946983d7f2d97476f18601ee9545df03092177a80626829
Jul 23 15:51:47.549335 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:47.549253    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd39c19_482d_438c_867f_c12dfe437e6d.slice/crio-4216795c6a06971f65f23276c550f40895c8e9a506a681277f482050a8942d89 WatchSource:0}: Error finding container 4216795c6a06971f65f23276c550f40895c8e9a506a681277f482050a8942d89: Status 404 returned error can't find the container with id 4216795c6a06971f65f23276c550f40895c8e9a506a681277f482050a8942d89
Jul 23 15:51:47.555443 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:47.555182    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:51:47.561698 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:51:47.561662    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aa53e05_2a4d_41d1_b2eb_95de579d16e0.slice/crio-fbb50442eadacc71006f882a35f6ce4c21e49dfc5afe897249b8f3166d646041 WatchSource:0}: Error finding container fbb50442eadacc71006f882a35f6ce4c21e49dfc5afe897249b8f3166d646041: Status 404 returned error can't find the container with id fbb50442eadacc71006f882a35f6ce4c21e49dfc5afe897249b8f3166d646041
Jul 23 15:51:47.835388 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:47.835222    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:47.991149 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:47.991108    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:48.029779 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.029502    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-d49k9" event={"ID":"69d39bb9-aa10-4399-bd69-8e60aed59cd7","Type":"ContainerStarted","Data":"5f27a33114a2ae701b5b6bacee3939f5aa6c7f838e9d49d0a6dee9cba2d424dc"}
Jul 23 15:51:48.030952 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.030714    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-d49k9"
Jul 23 15:51:48.036035 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.035306    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn" event={"ID":"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17","Type":"ContainerStarted","Data":"0dc510d8eb3bc61d3993a31d8537e7c968fbd149a2995ced8520717750b6c956"}
Jul 23 15:51:48.036035 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.035424    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn" event={"ID":"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17","Type":"ContainerStarted","Data":"616021837a3e055bdaddcf7568ca1f2677c7910de62984f17c4efd2c148ad1b6"}
Jul 23 15:51:48.036035 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.035468    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn" event={"ID":"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17","Type":"ContainerStarted","Data":"57f0ab2fc8603708483743b2021e3cf3bca42b2d95bcde1f5b0481c8d8eb1938"}
Jul 23 15:51:48.039311 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.039263    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlhdq" event={"ID":"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f","Type":"ContainerStarted","Data":"89dc87e79a21b3b7b99efd2ddcdb849a2bb97dd0e5ca2d8fa3468cbad356829f"}
Jul 23 15:51:48.042376 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.042347    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85bc69594f-766j8" event={"ID":"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9","Type":"ContainerStarted","Data":"b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539"}
Jul 23 15:51:48.042941 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.042917    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85bc69594f-766j8" event={"ID":"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9","Type":"ContainerStarted","Data":"ddf163e103bda8992946983d7f2d97476f18601ee9545df03092177a80626829"}
Jul 23 15:51:48.045070 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.045044    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq" event={"ID":"6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9","Type":"ContainerStarted","Data":"4fde31ab1009882773ef951ff01cdb4b5b363444f8db83d33cae0e91e618eab8"}
Jul 23 15:51:48.047290 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.047264    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd" event={"ID":"2e6321ef-eb99-4e18-a7ab-022f83f77ecb","Type":"ContainerStarted","Data":"e58dea43a36242bc377d3d435058b083d58a77b99a97791c03b799ebe659c9bd"}
Jul 23 15:51:48.048409 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.048355    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerStarted","Data":"fbb50442eadacc71006f882a35f6ce4c21e49dfc5afe897249b8f3166d646041"}
Jul 23 15:51:48.049400 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.049378    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw" event={"ID":"ffd39c19-482d-438c-867f-c12dfe437e6d","Type":"ContainerStarted","Data":"4216795c6a06971f65f23276c550f40895c8e9a506a681277f482050a8942d89"}
Jul 23 15:51:48.049613 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.049597    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-d49k9"
Jul 23 15:51:48.052099 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.052053    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-d49k9" podStartSLOduration=5.6638795 podStartE2EDuration="24.052040071s" totalImagesPullingTime="18.388160571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:48.050805873 +0000 UTC m=+93.974660527" watchObservedRunningTime="2026-07-23 15:51:48.052040071 +0000 UTC m=+93.975894704"
Jul 23 15:51:48.068066 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.068035    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85bc69594f-766j8"]
Jul 23 15:51:48.094364 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.093825    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85bc69594f-766j8" podStartSLOduration=7.093804199 podStartE2EDuration="7.093804199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:48.092958687 +0000 UTC m=+94.016813336" watchObservedRunningTime="2026-07-23 15:51:48.093804199 +0000 UTC m=+94.017658834"
Jul 23 15:51:48.141516 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:48.141449    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6c7466896b-fk9pd" podStartSLOduration=6.790193713 podStartE2EDuration="25.141421581s" totalImagesPullingTime="18.351227868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:48.138875387 +0000 UTC m=+94.062730026" watchObservedRunningTime="2026-07-23 15:51:48.141421581 +0000 UTC m=+94.065276243"
Jul 23 15:51:49.017646 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:49.017601    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6c966b5f54-k856m" podUID="af0e4e30-578d-479f-9f9f-d7be0848f528" containerName="registry" containerID="cri-o://e3f1a9b1498fc97e2c6baf3d45896779c1fa970e13423f209119906e86b8ee21" gracePeriod=30
Jul 23 15:51:49.303651 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:49.303495    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:49.403280 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:49.403219    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:49.930512 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:49.930482    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64c5f57566-fvgx8"
Jul 23 15:51:50.062939 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.062904    2570 generic.go:356] "Generic (PLEG): container finished" podID="af0e4e30-578d-479f-9f9f-d7be0848f528" containerID="e3f1a9b1498fc97e2c6baf3d45896779c1fa970e13423f209119906e86b8ee21" exitCode=0
Jul 23 15:51:50.063600 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.063574    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c966b5f54-k856m" event={"ID":"af0e4e30-578d-479f-9f9f-d7be0848f528","Type":"ContainerDied","Data":"e3f1a9b1498fc97e2c6baf3d45896779c1fa970e13423f209119906e86b8ee21"}
Jul 23 15:51:50.078925 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.078892    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:50.181001 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.180878    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:50.932597 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.932568    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:51:50.973856 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.973824    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2qtr\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-kube-api-access-b2qtr\") pod \"af0e4e30-578d-479f-9f9f-d7be0848f528\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") "
Jul 23 15:51:50.974044 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.973877    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af0e4e30-578d-479f-9f9f-d7be0848f528-ca-trust-extracted\") pod \"af0e4e30-578d-479f-9f9f-d7be0848f528\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") "
Jul 23 15:51:50.974044 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.973922    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-certificates\") pod \"af0e4e30-578d-479f-9f9f-d7be0848f528\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") "
Jul 23 15:51:50.974044 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.973970    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af0e4e30-578d-479f-9f9f-d7be0848f528-image-registry-private-configuration\") pod \"af0e4e30-578d-479f-9f9f-d7be0848f528\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") "
Jul 23 15:51:50.974203 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.974051    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af0e4e30-578d-479f-9f9f-d7be0848f528-installation-pull-secrets\") pod \"af0e4e30-578d-479f-9f9f-d7be0848f528\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") "
Jul 23 15:51:50.974203 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.974086    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-bound-sa-token\") pod \"af0e4e30-578d-479f-9f9f-d7be0848f528\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") "
Jul 23 15:51:50.974203 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.974138    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls\") pod \"af0e4e30-578d-479f-9f9f-d7be0848f528\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") "
Jul 23 15:51:50.974203 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.974166    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af0e4e30-578d-479f-9f9f-d7be0848f528-trusted-ca\") pod \"af0e4e30-578d-479f-9f9f-d7be0848f528\" (UID: \"af0e4e30-578d-479f-9f9f-d7be0848f528\") "
Jul 23 15:51:50.974430 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.974329    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "af0e4e30-578d-479f-9f9f-d7be0848f528" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:51:50.974467 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.974456    2570 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-certificates\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:51:50.974875 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.974849    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af0e4e30-578d-479f-9f9f-d7be0848f528-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "af0e4e30-578d-479f-9f9f-d7be0848f528" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:51:50.978710 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.978664    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "af0e4e30-578d-479f-9f9f-d7be0848f528" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:51:50.979283 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.979161    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0e4e30-578d-479f-9f9f-d7be0848f528-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "af0e4e30-578d-479f-9f9f-d7be0848f528" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:51:50.980344 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.980306    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af0e4e30-578d-479f-9f9f-d7be0848f528-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "af0e4e30-578d-479f-9f9f-d7be0848f528" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:51:50.982389 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.982352    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "af0e4e30-578d-479f-9f9f-d7be0848f528" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:51:50.984894 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.984696    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-kube-api-access-b2qtr" (OuterVolumeSpecName: "kube-api-access-b2qtr") pod "af0e4e30-578d-479f-9f9f-d7be0848f528" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528"). InnerVolumeSpecName "kube-api-access-b2qtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:51:50.989071 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:50.989045    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af0e4e30-578d-479f-9f9f-d7be0848f528-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "af0e4e30-578d-479f-9f9f-d7be0848f528" (UID: "af0e4e30-578d-479f-9f9f-d7be0848f528"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:51:51.069950 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:51.069865    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6c966b5f54-k856m" event={"ID":"af0e4e30-578d-479f-9f9f-d7be0848f528","Type":"ContainerDied","Data":"a43cd109c912a03f1b5c831ea1931dd31faf6ee9d2d0395b92de8de65b3e94ab"}
Jul 23 15:51:51.069950 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:51.069909    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6c966b5f54-k856m"
Jul 23 15:51:51.069950 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:51.069937    2570 scope.go:117] "RemoveContainer" containerID="e3f1a9b1498fc97e2c6baf3d45896779c1fa970e13423f209119906e86b8ee21"
Jul 23 15:51:51.075131 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:51.075043    2570 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/af0e4e30-578d-479f-9f9f-d7be0848f528-installation-pull-secrets\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:51:51.075131 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:51.075072    2570 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-bound-sa-token\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:51:51.075131 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:51.075089    2570 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-registry-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:51:51.075131 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:51.075103    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/af0e4e30-578d-479f-9f9f-d7be0848f528-trusted-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:51:51.075131 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:51.075116    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2qtr\" (UniqueName: \"kubernetes.io/projected/af0e4e30-578d-479f-9f9f-d7be0848f528-kube-api-access-b2qtr\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:51:51.075131 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:51.075130    2570 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/af0e4e30-578d-479f-9f9f-d7be0848f528-ca-trust-extracted\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:51:51.075676 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:51.075145    2570 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/af0e4e30-578d-479f-9f9f-d7be0848f528-image-registry-private-configuration\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:51:51.101138 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:51.099982    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6c966b5f54-k856m"]
Jul 23 15:51:51.103315 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:51.103257    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6c966b5f54-k856m"]
Jul 23 15:51:52.077129 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.077004    2570 generic.go:356] "Generic (PLEG): container finished" podID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerID="c0cd57cf3a4ad3f629d4853a3360a6dc4a0d429fb8fac25c58f30a22e06e2765" exitCode=0
Jul 23 15:51:52.077129 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.077121    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerDied","Data":"c0cd57cf3a4ad3f629d4853a3360a6dc4a0d429fb8fac25c58f30a22e06e2765"}
Jul 23 15:51:52.079423 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.079384    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw" event={"ID":"ffd39c19-482d-438c-867f-c12dfe437e6d","Type":"ContainerStarted","Data":"06ce2ad8b54242a781029d421d4b16f6ba022a89978f99266fe3ae1bf63d373d"}
Jul 23 15:51:52.086528 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.086502    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn" event={"ID":"8ce7bcfe-f1cf-4178-8c06-0381dbc97b17","Type":"ContainerStarted","Data":"463dca90e3f3b5c58c553de87c3f5d7973a02db25817b0f71c22bda9c7ae347b"}
Jul 23 15:51:52.088624 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.088591    2570 generic.go:356] "Generic (PLEG): container finished" podID="8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f" containerID="2720bf66da796c8bed3ce99033f21329f305ebf765df14ac4cafefc08f338342" exitCode=0
Jul 23 15:51:52.088738 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.088673    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlhdq" event={"ID":"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f","Type":"ContainerDied","Data":"2720bf66da796c8bed3ce99033f21329f305ebf765df14ac4cafefc08f338342"}
Jul 23 15:51:52.091988 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.091958    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq" event={"ID":"6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9","Type":"ContainerStarted","Data":"f18cf39c8402a2f2a4a1da7d905cd3cb0b8becd2cba3f25dc7b9ae365d835d56"}
Jul 23 15:51:52.092249 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.092229    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"
Jul 23 15:51:52.098102 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.098082    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq"
Jul 23 15:51:52.123243 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.123181    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw" podStartSLOduration=2.910658381 podStartE2EDuration="7.123158939s" totalImagesPullingTime="4.212500558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:52.121744985 +0000 UTC m=+98.045599642" watchObservedRunningTime="2026-07-23 15:51:52.123158939 +0000 UTC m=+98.047013574"
Jul 23 15:51:52.141995 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.141941    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-ln7nn" podStartSLOduration=7.713365109 podStartE2EDuration="11.141918033s" totalImagesPullingTime="3.428552924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:52.140696175 +0000 UTC m=+98.064550813" watchObservedRunningTime="2026-07-23 15:51:52.141918033 +0000 UTC m=+98.065772668"
Jul 23 15:51:52.168939 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.168889    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:51:52.183927 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.182649    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-sk7wq" podStartSLOduration=2.69149396 podStartE2EDuration="6.182624668s" totalImagesPullingTime="3.491130708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:52.156312328 +0000 UTC m=+98.080166986" watchObservedRunningTime="2026-07-23 15:51:52.182624668 +0000 UTC m=+98.106479303"
Jul 23 15:51:52.604251 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:52.604216    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af0e4e30-578d-479f-9f9f-d7be0848f528" path="/var/lib/kubelet/pods/af0e4e30-578d-479f-9f9f-d7be0848f528/volumes"
Jul 23 15:51:53.101337 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:53.101290    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlhdq" event={"ID":"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f","Type":"ContainerStarted","Data":"33b181c30a4dc7de0f5120b3e2b7783cbbb0e852c8a59ff1bdf355fee6c8d4f8"}
Jul 23 15:51:53.101808 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:53.101353    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tlhdq" event={"ID":"8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f","Type":"ContainerStarted","Data":"9d5a10ce94548ca9e1302067f6df12b5ace187f8c2eac99b6c12a8f70ec313eb"}
Jul 23 15:51:53.128865 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:53.127496    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tlhdq" podStartSLOduration=8.585463474 podStartE2EDuration="12.127472969s" totalImagesPullingTime="3.429385632s" totalInitContainerRuntime="112.623863ms" isStatefulPod=true podCreationTimestamp="2026-07-23 15:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:53.125553927 +0000 UTC m=+99.049408587" watchObservedRunningTime="2026-07-23 15:51:53.127472969 +0000 UTC m=+99.051327603"
Jul 23 15:51:53.139635 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:53.139587    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:53.239961 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:53.239922    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:53.993624 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:53.993587    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:54.095729 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:54.095646    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:55.113332 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:55.113298    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerStarted","Data":"68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b"}
Jul 23 15:51:55.113834 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:55.113383    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerStarted","Data":"39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f"}
Jul 23 15:51:55.113834 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:55.113425    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerStarted","Data":"9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb"}
Jul 23 15:51:55.113834 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:55.113464    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerStarted","Data":"09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d"}
Jul 23 15:51:55.113834 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:55.113490    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerStarted","Data":"b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857"}
Jul 23 15:51:56.764702 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:56.764646    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:56.818097 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:56.818057    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:57.051180 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:57.051110    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:57.151968 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:57.151930    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:58.129441 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:58.129411    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerStarted","Data":"95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355"}
Jul 23 15:51:58.162878 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:58.162818    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.711851837 podStartE2EDuration="16.162802127s" totalImagesPullingTime="8.4275449s" totalInitContainerRuntime="23.40539ms" isStatefulPod=false podCreationTimestamp="2026-07-23 15:51:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:51:58.161063599 +0000 UTC m=+104.084918233" watchObservedRunningTime="2026-07-23 15:51:58.162802127 +0000 UTC m=+104.086656761"
Jul 23 15:51:58.891296 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:58.891259    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db7fdb888-mvk7f"]
Jul 23 15:51:59.008404 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:59.008368    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:59.114693 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:59.114662    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:59.216405 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:59.216350    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:51:59.927234 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:51:59.927204    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fdhds"
Jul 23 15:52:03.160138 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:03.160106    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:52:03.259890 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:03.259854    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:52:06.347221 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:06.347182    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:52:06.347639 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:06.347275    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:52:10.827510 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:10.827484    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wkrfk_b2e75568-9d55-4a31-8cfc-adf3c6879a2e/serve-healthcheck-canary/0.log"
Jul 23 15:52:11.760001 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:11.759961    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:52:11.820256 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:11.820221    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:52:15.092393 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.092331    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85bc69594f-766j8" podUID="cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" containerName="console" containerID="cri-o://b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539" gracePeriod=15
Jul 23 15:52:15.375524 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.375492    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:52:15.499970 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.499937    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-serving-cert\") pod \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") "
Jul 23 15:52:15.500162 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.500043    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bbbrx\" (UniqueName: \"kubernetes.io/projected/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-kube-api-access-bbbrx\") pod \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") "
Jul 23 15:52:15.500162 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.500103    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-oauth-config\") pod \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") "
Jul 23 15:52:15.500162 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.500126    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-oauth-serving-cert\") pod \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") "
Jul 23 15:52:15.500162 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.500148    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-config\") pod \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") "
Jul 23 15:52:15.500442 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.500174    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-service-ca\") pod \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") "
Jul 23 15:52:15.500442 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.500204    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-trusted-ca-bundle\") pod \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\" (UID: \"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9\") "
Jul 23 15:52:15.500581 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.500546    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" (UID: "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:52:15.500721 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.500687    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" (UID: "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:52:15.500835 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.500693    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-config" (OuterVolumeSpecName: "console-config") pod "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" (UID: "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:52:15.500835 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.500798    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" (UID: "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:52:15.502352 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.502328    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" (UID: "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:52:15.502453 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.502373    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" (UID: "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:52:15.502453 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.502438    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-kube-api-access-bbbrx" (OuterVolumeSpecName: "kube-api-access-bbbrx") pod "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" (UID: "cf9b919d-02dd-4f9c-8a28-b43495ae6ff9"). InnerVolumeSpecName "kube-api-access-bbbrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:52:15.600847 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.600750    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bbbrx\" (UniqueName: \"kubernetes.io/projected/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-kube-api-access-bbbrx\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:15.600847 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.600782    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-oauth-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:15.600847 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.600797    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-oauth-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:15.600847 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.600809    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:15.600847 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.600820    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:15.600847 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.600830    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-trusted-ca-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:15.600847 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:15.600842    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9-console-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:16.199349 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:16.199305    2570 generic.go:356] "Generic (PLEG): container finished" podID="cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" containerID="b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539" exitCode=0
Jul 23 15:52:16.199843 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:16.199357    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85bc69594f-766j8"
Jul 23 15:52:16.199843 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:16.199393    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85bc69594f-766j8" event={"ID":"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9","Type":"ContainerDied","Data":"b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539"}
Jul 23 15:52:16.199843 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:16.199459    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85bc69594f-766j8" event={"ID":"cf9b919d-02dd-4f9c-8a28-b43495ae6ff9","Type":"ContainerDied","Data":"ddf163e103bda8992946983d7f2d97476f18601ee9545df03092177a80626829"}
Jul 23 15:52:16.199843 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:16.199489    2570 scope.go:117] "RemoveContainer" containerID="b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539"
Jul 23 15:52:16.208127 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:16.208107    2570 scope.go:117] "RemoveContainer" containerID="b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539"
Jul 23 15:52:16.208422 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:52:16.208398    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539\": container with ID starting with b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539 not found: ID does not exist" containerID="b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539"
Jul 23 15:52:16.208530 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:16.208429    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539"} err="failed to get container status \"b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539\": rpc error: code = NotFound desc = could not find container \"b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539\": container with ID starting with b6075aae47286d10c875df7e7fce1aca6ac6120330bd6713890fae20e71b3539 not found: ID does not exist"
Jul 23 15:52:16.219961 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:16.219934    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85bc69594f-766j8"]
Jul 23 15:52:16.223758 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:16.223736    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85bc69594f-766j8"]
Jul 23 15:52:16.601641 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:16.601612    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" path="/var/lib/kubelet/pods/cf9b919d-02dd-4f9c-8a28-b43495ae6ff9/volumes"
Jul 23 15:52:19.177058 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:19.177022    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:52:19.261145 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:19.261113    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:52:23.911595 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:23.911548    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-db7fdb888-mvk7f" podUID="f1037697-2c3a-41d5-9ca9-d4c34e400fc8" containerName="console" containerID="cri-o://2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f" gracePeriod=15
Jul 23 15:52:24.217314 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.217277    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:52:24.234306 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.234271    2570 generic.go:356] "Generic (PLEG): container finished" podID="f1037697-2c3a-41d5-9ca9-d4c34e400fc8" containerID="2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f" exitCode=0
Jul 23 15:52:24.234306 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.234305    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db7fdb888-mvk7f" event={"ID":"f1037697-2c3a-41d5-9ca9-d4c34e400fc8","Type":"ContainerDied","Data":"2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f"}
Jul 23 15:52:24.234558 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.234328    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-db7fdb888-mvk7f"
Jul 23 15:52:24.234558 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.234366    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-db7fdb888-mvk7f" event={"ID":"f1037697-2c3a-41d5-9ca9-d4c34e400fc8","Type":"ContainerDied","Data":"abedb697ff0ebf244bc0b110f25b1ab4bd01f69d1ddfb21ec4c247e3dcb19201"}
Jul 23 15:52:24.234558 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.234393    2570 scope.go:117] "RemoveContainer" containerID="2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f"
Jul 23 15:52:24.245746 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.245722    2570 scope.go:117] "RemoveContainer" containerID="2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f"
Jul 23 15:52:24.246134 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:52:24.246112    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f\": container with ID starting with 2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f not found: ID does not exist" containerID="2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f"
Jul 23 15:52:24.246236 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.246149    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f"} err="failed to get container status \"2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f\": rpc error: code = NotFound desc = could not find container \"2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f\": container with ID starting with 2083919f7ed150fd7cbe0ca0cf35d1dd96c7fcc57c1a167008f534efc516548f not found: ID does not exist"
Jul 23 15:52:24.280572 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.280544    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-service-ca\") pod \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") "
Jul 23 15:52:24.280747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.280591    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-oauth-config\") pod \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") "
Jul 23 15:52:24.280747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.280624    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-oauth-serving-cert\") pod \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") "
Jul 23 15:52:24.280747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.280640    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7glp\" (UniqueName: \"kubernetes.io/projected/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-kube-api-access-d7glp\") pod \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") "
Jul 23 15:52:24.280747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.280668    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-serving-cert\") pod \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") "
Jul 23 15:52:24.280747 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.280693    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-config\") pod \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\" (UID: \"f1037697-2c3a-41d5-9ca9-d4c34e400fc8\") "
Jul 23 15:52:24.281078 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.280939    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-service-ca" (OuterVolumeSpecName: "service-ca") pod "f1037697-2c3a-41d5-9ca9-d4c34e400fc8" (UID: "f1037697-2c3a-41d5-9ca9-d4c34e400fc8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:52:24.281078 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.281057    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f1037697-2c3a-41d5-9ca9-d4c34e400fc8" (UID: "f1037697-2c3a-41d5-9ca9-d4c34e400fc8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:52:24.281235 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.281214    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-config" (OuterVolumeSpecName: "console-config") pod "f1037697-2c3a-41d5-9ca9-d4c34e400fc8" (UID: "f1037697-2c3a-41d5-9ca9-d4c34e400fc8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:52:24.282851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.282826    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f1037697-2c3a-41d5-9ca9-d4c34e400fc8" (UID: "f1037697-2c3a-41d5-9ca9-d4c34e400fc8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:52:24.283024 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.282990    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-kube-api-access-d7glp" (OuterVolumeSpecName: "kube-api-access-d7glp") pod "f1037697-2c3a-41d5-9ca9-d4c34e400fc8" (UID: "f1037697-2c3a-41d5-9ca9-d4c34e400fc8"). InnerVolumeSpecName "kube-api-access-d7glp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:52:24.283072 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.283000    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f1037697-2c3a-41d5-9ca9-d4c34e400fc8" (UID: "f1037697-2c3a-41d5-9ca9-d4c34e400fc8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:52:24.382125 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.382096    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:24.382125 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.382122    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:24.382125 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.382131    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:24.382345 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.382138    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-console-oauth-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:24.382345 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.382148    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-oauth-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:24.382345 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.382156    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7glp\" (UniqueName: \"kubernetes.io/projected/f1037697-2c3a-41d5-9ca9-d4c34e400fc8-kube-api-access-d7glp\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:52:24.556388 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.556354    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-db7fdb888-mvk7f"]
Jul 23 15:52:24.560690 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.560659    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-db7fdb888-mvk7f"]
Jul 23 15:52:24.602122 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:24.602091    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1037697-2c3a-41d5-9ca9-d4c34e400fc8" path="/var/lib/kubelet/pods/f1037697-2c3a-41d5-9ca9-d4c34e400fc8/volumes"
Jul 23 15:52:26.352349 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:26.352315    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:52:26.356233 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:26.356208    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-65c8dd4f76-6bqcw"
Jul 23 15:52:44.571593 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:52:44.571557    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:00.828375 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:00.828333    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:00.928556 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:00.928520    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:01.872129 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:01.872097    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:53:01.872550 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:01.872417    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="alertmanager" containerID="cri-o://b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857" gracePeriod=120
Jul 23 15:53:01.872550 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:01.872449    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="kube-rbac-proxy-metric" containerID="cri-o://68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b" gracePeriod=120
Jul 23 15:53:01.872550 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:01.872479    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="kube-rbac-proxy-web" containerID="cri-o://9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb" gracePeriod=120
Jul 23 15:53:01.872720 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:01.872523    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="prom-label-proxy" containerID="cri-o://95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355" gracePeriod=120
Jul 23 15:53:01.872720 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:01.872560    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="kube-rbac-proxy" containerID="cri-o://39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f" gracePeriod=120
Jul 23 15:53:01.872720 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:01.872547    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="config-reloader" containerID="cri-o://09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d" gracePeriod=120
Jul 23 15:53:02.378380 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:02.378346    2570 generic.go:356] "Generic (PLEG): container finished" podID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerID="95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355" exitCode=0
Jul 23 15:53:02.378380 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:02.378371    2570 generic.go:356] "Generic (PLEG): container finished" podID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerID="68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b" exitCode=0
Jul 23 15:53:02.378380 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:02.378378    2570 generic.go:356] "Generic (PLEG): container finished" podID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerID="39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f" exitCode=0
Jul 23 15:53:02.378380 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:02.378384    2570 generic.go:356] "Generic (PLEG): container finished" podID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerID="09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d" exitCode=0
Jul 23 15:53:02.378380 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:02.378389    2570 generic.go:356] "Generic (PLEG): container finished" podID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerID="b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857" exitCode=0
Jul 23 15:53:02.378677 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:02.378418    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerDied","Data":"95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355"}
Jul 23 15:53:02.378677 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:02.378483    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerDied","Data":"68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b"}
Jul 23 15:53:02.378677 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:02.378508    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerDied","Data":"39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f"}
Jul 23 15:53:02.378677 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:02.378532    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerDied","Data":"09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d"}
Jul 23 15:53:02.378677 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:02.378559    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerDied","Data":"b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857"}
Jul 23 15:53:03.110740 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.110705    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.191343 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191245    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-config-volume\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.191343 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191305    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-tls-assets\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.191343 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191334    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-cluster-tls-config\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.191624 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191364    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-config-out\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.191624 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191396    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hfrv\" (UniqueName: \"kubernetes.io/projected/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-kube-api-access-5hfrv\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.191624 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191439    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy-web\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.191624 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191486    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-metrics-client-ca\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.191624 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191515    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.191624 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191587    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-trusted-ca-bundle\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.191931 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191638    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.191931 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191699    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-main-tls\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.191931 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191735    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-main-db\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.191931 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.191772    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-web-config\") pod \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\" (UID: \"8aa53e05-2a4d-41d1-b2eb-95de579d16e0\") "
Jul 23 15:53:03.194650 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.194613    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:53:03.195608 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.195562    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:53:03.195608 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.195592    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:53:03.196036 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.195889    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-config-volume" (OuterVolumeSpecName: "config-volume") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:53:03.196036 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.195895    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:53:03.196036 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.195962    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-config-out" (OuterVolumeSpecName: "config-out") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:53:03.196036 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.195984    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:53:03.196297 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.196238    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:53:03.196647 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.196599    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-kube-api-access-5hfrv" (OuterVolumeSpecName: "kube-api-access-5hfrv") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "kube-api-access-5hfrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:53:03.197369 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.197340    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:53:03.197931 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.197907    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:53:03.198891 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.198857    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:53:03.206093 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.206063    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-web-config" (OuterVolumeSpecName: "web-config") pod "8aa53e05-2a4d-41d1-b2eb-95de579d16e0" (UID: "8aa53e05-2a4d-41d1-b2eb-95de579d16e0"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:53:03.292700 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292646    2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-web-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.292700 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292692    2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-config-volume\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.292700 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292706    2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-tls-assets\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.292973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292716    2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-cluster-tls-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.292973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292729    2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-config-out\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.292973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292741    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hfrv\" (UniqueName: \"kubernetes.io/projected/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-kube-api-access-5hfrv\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.292973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292757    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.292973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292769    2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-metrics-client-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.292973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292815    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.292973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292828    2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.292973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292840    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.292973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292853    2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-secret-alertmanager-main-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.292973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.292865    2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8aa53e05-2a4d-41d1-b2eb-95de579d16e0-alertmanager-main-db\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:53:03.384942 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.384909    2570 generic.go:356] "Generic (PLEG): container finished" podID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerID="9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb" exitCode=0
Jul 23 15:53:03.385119 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.384984    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.385119 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.384998    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerDied","Data":"9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb"}
Jul 23 15:53:03.385119 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.385091    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8aa53e05-2a4d-41d1-b2eb-95de579d16e0","Type":"ContainerDied","Data":"fbb50442eadacc71006f882a35f6ce4c21e49dfc5afe897249b8f3166d646041"}
Jul 23 15:53:03.385220 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.385128    2570 scope.go:117] "RemoveContainer" containerID="95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355"
Jul 23 15:53:03.393580 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.393448    2570 scope.go:117] "RemoveContainer" containerID="68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b"
Jul 23 15:53:03.400512 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.400495    2570 scope.go:117] "RemoveContainer" containerID="39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f"
Jul 23 15:53:03.407231 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.407217    2570 scope.go:117] "RemoveContainer" containerID="9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb"
Jul 23 15:53:03.415847 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.415823    2570 scope.go:117] "RemoveContainer" containerID="09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d"
Jul 23 15:53:03.417052 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.416979    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:53:03.422910 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.422885    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:53:03.423690 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.423673    2570 scope.go:117] "RemoveContainer" containerID="b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857"
Jul 23 15:53:03.430631 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.430616    2570 scope.go:117] "RemoveContainer" containerID="c0cd57cf3a4ad3f629d4853a3360a6dc4a0d429fb8fac25c58f30a22e06e2765"
Jul 23 15:53:03.437381 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.437364    2570 scope.go:117] "RemoveContainer" containerID="95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355"
Jul 23 15:53:03.437660 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:53:03.437639    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355\": container with ID starting with 95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355 not found: ID does not exist" containerID="95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355"
Jul 23 15:53:03.437704 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.437670    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355"} err="failed to get container status \"95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355\": rpc error: code = NotFound desc = could not find container \"95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355\": container with ID starting with 95576f098d314dd699a4f7e3c4c90a7433788fe5c4edcb5e6e69cc463e042355 not found: ID does not exist"
Jul 23 15:53:03.437704 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.437691    2570 scope.go:117] "RemoveContainer" containerID="68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b"
Jul 23 15:53:03.437922 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:53:03.437898    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b\": container with ID starting with 68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b not found: ID does not exist" containerID="68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b"
Jul 23 15:53:03.437965 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.437929    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b"} err="failed to get container status \"68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b\": rpc error: code = NotFound desc = could not find container \"68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b\": container with ID starting with 68a91feec4a71adf6e802ab4cceec2c1f185bae5b86de5c44cf64c91bcbb447b not found: ID does not exist"
Jul 23 15:53:03.437965 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.437945    2570 scope.go:117] "RemoveContainer" containerID="39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f"
Jul 23 15:53:03.438185 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:53:03.438170    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f\": container with ID starting with 39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f not found: ID does not exist" containerID="39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f"
Jul 23 15:53:03.438230 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.438188    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f"} err="failed to get container status \"39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f\": rpc error: code = NotFound desc = could not find container \"39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f\": container with ID starting with 39bb382d726bddf7d860709f3be5fd58b00606c153fe42eb9b9e17bd12a28c3f not found: ID does not exist"
Jul 23 15:53:03.438230 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.438203    2570 scope.go:117] "RemoveContainer" containerID="9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb"
Jul 23 15:53:03.438435 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:53:03.438410    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb\": container with ID starting with 9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb not found: ID does not exist" containerID="9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb"
Jul 23 15:53:03.438480 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.438440    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb"} err="failed to get container status \"9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb\": rpc error: code = NotFound desc = could not find container \"9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb\": container with ID starting with 9ff01a638e7254c7902fe31a41a8f70aac40e1518d316a055415cc860634eacb not found: ID does not exist"
Jul 23 15:53:03.438480 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.438453    2570 scope.go:117] "RemoveContainer" containerID="09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d"
Jul 23 15:53:03.438695 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:53:03.438681    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d\": container with ID starting with 09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d not found: ID does not exist" containerID="09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d"
Jul 23 15:53:03.438732 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.438698    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d"} err="failed to get container status \"09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d\": rpc error: code = NotFound desc = could not find container \"09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d\": container with ID starting with 09e4a12909c49d2de95c0055cc98e3f5e63a2f335acbed1f6dd070d90e787c2d not found: ID does not exist"
Jul 23 15:53:03.438732 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.438717    2570 scope.go:117] "RemoveContainer" containerID="b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857"
Jul 23 15:53:03.438926 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:53:03.438909    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857\": container with ID starting with b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857 not found: ID does not exist" containerID="b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857"
Jul 23 15:53:03.438964 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.438932    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857"} err="failed to get container status \"b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857\": rpc error: code = NotFound desc = could not find container \"b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857\": container with ID starting with b83733de57cea6d1d1683a9fad830d33ab3a9073bc8bedb235536cbf28909857 not found: ID does not exist"
Jul 23 15:53:03.438964 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.438946    2570 scope.go:117] "RemoveContainer" containerID="c0cd57cf3a4ad3f629d4853a3360a6dc4a0d429fb8fac25c58f30a22e06e2765"
Jul 23 15:53:03.439228 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:53:03.439213    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0cd57cf3a4ad3f629d4853a3360a6dc4a0d429fb8fac25c58f30a22e06e2765\": container with ID starting with c0cd57cf3a4ad3f629d4853a3360a6dc4a0d429fb8fac25c58f30a22e06e2765 not found: ID does not exist" containerID="c0cd57cf3a4ad3f629d4853a3360a6dc4a0d429fb8fac25c58f30a22e06e2765"
Jul 23 15:53:03.439267 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.439231    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0cd57cf3a4ad3f629d4853a3360a6dc4a0d429fb8fac25c58f30a22e06e2765"} err="failed to get container status \"c0cd57cf3a4ad3f629d4853a3360a6dc4a0d429fb8fac25c58f30a22e06e2765\": rpc error: code = NotFound desc = could not find container \"c0cd57cf3a4ad3f629d4853a3360a6dc4a0d429fb8fac25c58f30a22e06e2765\": container with ID starting with c0cd57cf3a4ad3f629d4853a3360a6dc4a0d429fb8fac25c58f30a22e06e2765 not found: ID does not exist"
Jul 23 15:53:03.457642 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.456991    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:53:03.458391 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458195    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1037697-2c3a-41d5-9ca9-d4c34e400fc8" containerName="console"
Jul 23 15:53:03.458391 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458366    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1037697-2c3a-41d5-9ca9-d4c34e400fc8" containerName="console"
Jul 23 15:53:03.458391 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458390    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="prom-label-proxy"
Jul 23 15:53:03.458593 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458400    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="prom-label-proxy"
Jul 23 15:53:03.458593 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458473    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af0e4e30-578d-479f-9f9f-d7be0848f528" containerName="registry"
Jul 23 15:53:03.458593 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458487    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="af0e4e30-578d-479f-9f9f-d7be0848f528" containerName="registry"
Jul 23 15:53:03.458593 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458587    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="init-config-reloader"
Jul 23 15:53:03.458780 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458601    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="init-config-reloader"
Jul 23 15:53:03.458780 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458610    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="alertmanager"
Jul 23 15:53:03.458780 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458619    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="alertmanager"
Jul 23 15:53:03.458780 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458629    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" containerName="console"
Jul 23 15:53:03.458780 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458656    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" containerName="console"
Jul 23 15:53:03.458780 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458685    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="config-reloader"
Jul 23 15:53:03.458780 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458695    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="config-reloader"
Jul 23 15:53:03.458780 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458730    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="kube-rbac-proxy"
Jul 23 15:53:03.458780 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458754    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="kube-rbac-proxy"
Jul 23 15:53:03.458780 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458773    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="kube-rbac-proxy-web"
Jul 23 15:53:03.458780 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458781    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="kube-rbac-proxy-web"
Jul 23 15:53:03.459298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458790    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="kube-rbac-proxy-metric"
Jul 23 15:53:03.459298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458799    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="kube-rbac-proxy-metric"
Jul 23 15:53:03.459298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458959    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="config-reloader"
Jul 23 15:53:03.459298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.458987    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1037697-2c3a-41d5-9ca9-d4c34e400fc8" containerName="console"
Jul 23 15:53:03.459298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.459005    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="kube-rbac-proxy-metric"
Jul 23 15:53:03.459298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.459039    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="prom-label-proxy"
Jul 23 15:53:03.459298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.459049    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf9b919d-02dd-4f9c-8a28-b43495ae6ff9" containerName="console"
Jul 23 15:53:03.459298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.459056    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="alertmanager"
Jul 23 15:53:03.459298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.459070    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="kube-rbac-proxy-web"
Jul 23 15:53:03.459298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.459083    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" containerName="kube-rbac-proxy"
Jul 23 15:53:03.459298 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.459091    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="af0e4e30-578d-479f-9f9f-d7be0848f528" containerName="registry"
Jul 23 15:53:03.465535 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.465514    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.468404 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.468384    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 23 15:53:03.468527 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.468417    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 23 15:53:03.468594 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.468578    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 23 15:53:03.468789 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.468765    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 23 15:53:03.468789 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.468779    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 23 15:53:03.468936 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.468790    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 23 15:53:03.468936 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.468824    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 23 15:53:03.468936 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.468780    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4x6xb\""
Jul 23 15:53:03.469138 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.469124    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 23 15:53:03.473652 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.473635    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 23 15:53:03.479554 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.479531    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:53:03.595337 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595295    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.595337 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595338    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-web-config\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.595565 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595361    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.595565 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595435    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a79e3db-15d0-4493-bc6a-4e1c82525773-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.595565 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595469    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a79e3db-15d0-4493-bc6a-4e1c82525773-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.595565 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595514    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.595565 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595545    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.595565 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595562    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l75nc\" (UniqueName: \"kubernetes.io/projected/9a79e3db-15d0-4493-bc6a-4e1c82525773-kube-api-access-l75nc\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.595857 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595587    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.595857 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595662    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a79e3db-15d0-4493-bc6a-4e1c82525773-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.595857 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595709    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a79e3db-15d0-4493-bc6a-4e1c82525773-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.595857 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595756    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a79e3db-15d0-4493-bc6a-4e1c82525773-config-out\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.595857 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.595786    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696378 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696324    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696378 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696382    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a79e3db-15d0-4493-bc6a-4e1c82525773-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696663 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696403    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a79e3db-15d0-4493-bc6a-4e1c82525773-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696663 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696434    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a79e3db-15d0-4493-bc6a-4e1c82525773-config-out\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696663 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696450    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696663 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696478    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696663 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696508    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-web-config\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696663 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696532    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696663 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696557    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a79e3db-15d0-4493-bc6a-4e1c82525773-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696663 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696579    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a79e3db-15d0-4493-bc6a-4e1c82525773-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696663 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696608    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696663 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696642    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.696663 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696666    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l75nc\" (UniqueName: \"kubernetes.io/projected/9a79e3db-15d0-4493-bc6a-4e1c82525773-kube-api-access-l75nc\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.697243 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.696830    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9a79e3db-15d0-4493-bc6a-4e1c82525773-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.697462 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.697435    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a79e3db-15d0-4493-bc6a-4e1c82525773-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.698404 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.698373    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a79e3db-15d0-4493-bc6a-4e1c82525773-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.699689 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.699522    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9a79e3db-15d0-4493-bc6a-4e1c82525773-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.699689 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.699623    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.699689 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.699650    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9a79e3db-15d0-4493-bc6a-4e1c82525773-config-out\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.699874 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.699746    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-config-volume\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.699874 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.699768    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.699874 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.699817    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.700177 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.700156    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.700753 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.700730    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-web-config\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.701411 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.701391    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9a79e3db-15d0-4493-bc6a-4e1c82525773-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.705339 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.705318    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l75nc\" (UniqueName: \"kubernetes.io/projected/9a79e3db-15d0-4493-bc6a-4e1c82525773-kube-api-access-l75nc\") pod \"alertmanager-main-0\" (UID: \"9a79e3db-15d0-4493-bc6a-4e1c82525773\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.775537 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.775483    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 23 15:53:03.973847 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:03.973808    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 23 15:53:03.977738 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:53:03.977711    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a79e3db_15d0_4493_bc6a_4e1c82525773.slice/crio-5a8637f3e1fca25f68ba90f8d3dc321b95f9d2c02550fa4690ad4abef1307715 WatchSource:0}: Error finding container 5a8637f3e1fca25f68ba90f8d3dc321b95f9d2c02550fa4690ad4abef1307715: Status 404 returned error can't find the container with id 5a8637f3e1fca25f68ba90f8d3dc321b95f9d2c02550fa4690ad4abef1307715
Jul 23 15:53:04.389821 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:04.389738    2570 generic.go:356] "Generic (PLEG): container finished" podID="9a79e3db-15d0-4493-bc6a-4e1c82525773" containerID="473fc95b28c08dd0ee380bff6fae943d8738abdad74cef73bf77e780c73a1c27" exitCode=0
Jul 23 15:53:04.389821 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:04.389774    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a79e3db-15d0-4493-bc6a-4e1c82525773","Type":"ContainerDied","Data":"473fc95b28c08dd0ee380bff6fae943d8738abdad74cef73bf77e780c73a1c27"}
Jul 23 15:53:04.390296 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:04.389837    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a79e3db-15d0-4493-bc6a-4e1c82525773","Type":"ContainerStarted","Data":"5a8637f3e1fca25f68ba90f8d3dc321b95f9d2c02550fa4690ad4abef1307715"}
Jul 23 15:53:04.601695 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:04.601663    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8aa53e05-2a4d-41d1-b2eb-95de579d16e0" path="/var/lib/kubelet/pods/8aa53e05-2a4d-41d1-b2eb-95de579d16e0/volumes"
Jul 23 15:53:05.398050 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.397988    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a79e3db-15d0-4493-bc6a-4e1c82525773","Type":"ContainerStarted","Data":"45f1402fb9adc5c4097606d79e8fcf2b139029ebbfb49ec8f70ac6da42b47413"}
Jul 23 15:53:05.398477 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.398119    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a79e3db-15d0-4493-bc6a-4e1c82525773","Type":"ContainerStarted","Data":"d378d3af7f150ba07c0c6906f84604eee2cee261510e9b3bdcf411adfbcceac0"}
Jul 23 15:53:05.398477 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.398148    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a79e3db-15d0-4493-bc6a-4e1c82525773","Type":"ContainerStarted","Data":"63d0aaffe3ae02bb5988b7d57e05ad9811a8e7e6c3df63d8d215cc0a4e07a806"}
Jul 23 15:53:05.398477 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.398177    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a79e3db-15d0-4493-bc6a-4e1c82525773","Type":"ContainerStarted","Data":"1a83355738c192080942ac942061d52707b10691dbc84c71dc25742245876c13"}
Jul 23 15:53:05.398477 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.398212    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a79e3db-15d0-4493-bc6a-4e1c82525773","Type":"ContainerStarted","Data":"3e49605afc56ed49a3ff7b1c2b1cf9c0fe403e6baa64f656f6cc2955a61a2c44"}
Jul 23 15:53:05.398477 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.398236    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9a79e3db-15d0-4493-bc6a-4e1c82525773","Type":"ContainerStarted","Data":"339bbc851c32920e4e3121be1bede6d38528ec0dcb41ad64e6ffac3d26b287a0"}
Jul 23 15:53:05.426176 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.425977    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.405153588 podStartE2EDuration="2.425956623s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.803035ms" isStatefulPod=false podCreationTimestamp="2026-07-23 15:53:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:53:05.424317385 +0000 UTC m=+171.348172019" watchObservedRunningTime="2026-07-23 15:53:05.425956623 +0000 UTC m=+171.349811259"
Jul 23 15:53:05.902231 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.902152    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"]
Jul 23 15:53:05.904966 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.904943    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:05.907626 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.907598    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mtl4r\""
Jul 23 15:53:05.907760 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.907633    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 23 15:53:05.907760 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.907638    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 23 15:53:05.907958 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.907940    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 23 15:53:05.908032 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.907947    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 23 15:53:05.908032 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.907985    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 23 15:53:05.913491 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.913415    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 23 15:53:05.917815 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:05.917792    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"]
Jul 23 15:53:06.019459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.019427    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e2c9552-fb54-4c92-9d4a-335c5e579349-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.019631 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.019466    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8e2c9552-fb54-4c92-9d4a-335c5e579349-secret-telemeter-client\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.019631 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.019489    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e2c9552-fb54-4c92-9d4a-335c5e579349-metrics-client-ca\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.019631 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.019595    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8e2c9552-fb54-4c92-9d4a-335c5e579349-federate-client-tls\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.019734 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.019631    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8mvj\" (UniqueName: \"kubernetes.io/projected/8e2c9552-fb54-4c92-9d4a-335c5e579349-kube-api-access-p8mvj\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.019734 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.019651    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e2c9552-fb54-4c92-9d4a-335c5e579349-serving-certs-ca-bundle\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.019734 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.019666    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8e2c9552-fb54-4c92-9d4a-335c5e579349-telemeter-client-tls\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.019734 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.019685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e2c9552-fb54-4c92-9d4a-335c5e579349-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.120987 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.120950    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e2c9552-fb54-4c92-9d4a-335c5e579349-serving-certs-ca-bundle\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.120987 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.120991    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8e2c9552-fb54-4c92-9d4a-335c5e579349-telemeter-client-tls\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.121267 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.121025    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e2c9552-fb54-4c92-9d4a-335c5e579349-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.121267 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.121053    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e2c9552-fb54-4c92-9d4a-335c5e579349-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.121267 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.121176    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8e2c9552-fb54-4c92-9d4a-335c5e579349-secret-telemeter-client\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.121267 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.121218    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e2c9552-fb54-4c92-9d4a-335c5e579349-metrics-client-ca\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.121462 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.121297    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8e2c9552-fb54-4c92-9d4a-335c5e579349-federate-client-tls\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.121462 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.121361    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8mvj\" (UniqueName: \"kubernetes.io/projected/8e2c9552-fb54-4c92-9d4a-335c5e579349-kube-api-access-p8mvj\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.121903 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.121868    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e2c9552-fb54-4c92-9d4a-335c5e579349-serving-certs-ca-bundle\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.122038 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.121917    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e2c9552-fb54-4c92-9d4a-335c5e579349-metrics-client-ca\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.122038 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.121975    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e2c9552-fb54-4c92-9d4a-335c5e579349-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.126697 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.126660    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e2c9552-fb54-4c92-9d4a-335c5e579349-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.126697 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.126660    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8e2c9552-fb54-4c92-9d4a-335c5e579349-federate-client-tls\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.126866 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.126747    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8e2c9552-fb54-4c92-9d4a-335c5e579349-telemeter-client-tls\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.126866 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.126808    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8e2c9552-fb54-4c92-9d4a-335c5e579349-secret-telemeter-client\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.129646 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.129624    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8mvj\" (UniqueName: \"kubernetes.io/projected/8e2c9552-fb54-4c92-9d4a-335c5e579349-kube-api-access-p8mvj\") pod \"telemeter-client-7cf8d76d75-8g7g9\" (UID: \"8e2c9552-fb54-4c92-9d4a-335c5e579349\") " pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.217785 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.217740    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"
Jul 23 15:53:06.372287 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.372260    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9"]
Jul 23 15:53:06.374780 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:53:06.374752    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e2c9552_fb54_4c92_9d4a_335c5e579349.slice/crio-1db264403bfcb7e1133ada2d311fd2519d3d49170c6606b4f6316e898de1888a WatchSource:0}: Error finding container 1db264403bfcb7e1133ada2d311fd2519d3d49170c6606b4f6316e898de1888a: Status 404 returned error can't find the container with id 1db264403bfcb7e1133ada2d311fd2519d3d49170c6606b4f6316e898de1888a
Jul 23 15:53:06.403217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:06.403167    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9" event={"ID":"8e2c9552-fb54-4c92-9d4a-335c5e579349","Type":"ContainerStarted","Data":"1db264403bfcb7e1133ada2d311fd2519d3d49170c6606b4f6316e898de1888a"}
Jul 23 15:53:08.415175 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:08.415130    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9" event={"ID":"8e2c9552-fb54-4c92-9d4a-335c5e579349","Type":"ContainerStarted","Data":"9130724ac27a0bda979a48b2c3c709dd4c2ece9648e019bebc66fdda9a77ca9e"}
Jul 23 15:53:08.415537 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:08.415231    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9" event={"ID":"8e2c9552-fb54-4c92-9d4a-335c5e579349","Type":"ContainerStarted","Data":"9f8bf51331600ed3aedc29e57ea77ccd9b53c5c0d830b6a2bd0039eba85c263e"}
Jul 23 15:53:08.415537 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:08.415256    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9" event={"ID":"8e2c9552-fb54-4c92-9d4a-335c5e579349","Type":"ContainerStarted","Data":"50f06ed809225712f9b7bf8a63042a1fae9b204d706f28f49cf60a54d8c34adb"}
Jul 23 15:53:08.436613 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:08.436557    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7cf8d76d75-8g7g9" podStartSLOduration=1.6166823620000002 podStartE2EDuration="3.436542647s" totalImagesPullingTime="1.819860285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:53:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:53:08.436186737 +0000 UTC m=+174.360041372" watchObservedRunningTime="2026-07-23 15:53:08.436542647 +0000 UTC m=+174.360397280"
Jul 23 15:53:09.158972 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.158934    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-644b5d9fd7-s448c"]
Jul 23 15:53:09.161348 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.161325    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.164060 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.164030    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 23 15:53:09.164199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.164030    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 23 15:53:09.164199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.164039    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 23 15:53:09.165195 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.165165    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 23 15:53:09.165318 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.165243    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-fg6wd\""
Jul 23 15:53:09.165318 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.165272    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 23 15:53:09.170430 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.170409    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 23 15:53:09.175828 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.175796    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644b5d9fd7-s448c"]
Jul 23 15:53:09.223461 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.223429    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:09.252876 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.252834    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj9d6\" (UniqueName: \"kubernetes.io/projected/33d96c48-0a4f-47de-af50-8017a3021653-kube-api-access-jj9d6\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.253167 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.253149    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-console-config\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.253396 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.253378    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-oauth-serving-cert\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.253567 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.253552    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33d96c48-0a4f-47de-af50-8017a3021653-console-oauth-config\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.253786 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.253771    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-service-ca\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.253945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.253931    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33d96c48-0a4f-47de-af50-8017a3021653-console-serving-cert\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.254098 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.254084    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-trusted-ca-bundle\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.355094 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.355057    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-console-config\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.355094 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.355105    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-oauth-serving-cert\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.355359 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.355159    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33d96c48-0a4f-47de-af50-8017a3021653-console-oauth-config\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.355359 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.355256    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-service-ca\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.355359 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.355286    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33d96c48-0a4f-47de-af50-8017a3021653-console-serving-cert\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.355359 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.355307    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-trusted-ca-bundle\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.355544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.355368    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj9d6\" (UniqueName: \"kubernetes.io/projected/33d96c48-0a4f-47de-af50-8017a3021653-kube-api-access-jj9d6\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.356033 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.355977    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-console-config\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.356137 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.355990    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-oauth-serving-cert\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.356137 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.356115    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-service-ca\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.356239 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.356222    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-trusted-ca-bundle\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.357893 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.357873    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33d96c48-0a4f-47de-af50-8017a3021653-console-serving-cert\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.358215 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.358195    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33d96c48-0a4f-47de-af50-8017a3021653-console-oauth-config\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.363536 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.363512    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj9d6\" (UniqueName: \"kubernetes.io/projected/33d96c48-0a4f-47de-af50-8017a3021653-kube-api-access-jj9d6\") pod \"console-644b5d9fd7-s448c\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") " pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.370417 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.370388    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:09.422617 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.422521    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:09.472727 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.472692    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:09.603370 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.603329    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-644b5d9fd7-s448c"]
Jul 23 15:53:09.607454 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:53:09.607428    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33d96c48_0a4f_47de_af50_8017a3021653.slice/crio-622adc6e3fcf72243970ab24474db88fea74a02f61d8fa6f375e0fe262119040 WatchSource:0}: Error finding container 622adc6e3fcf72243970ab24474db88fea74a02f61d8fa6f375e0fe262119040: Status 404 returned error can't find the container with id 622adc6e3fcf72243970ab24474db88fea74a02f61d8fa6f375e0fe262119040
Jul 23 15:53:09.966310 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:09.966273    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:10.026743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:10.026708    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:10.424985 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:10.424896    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644b5d9fd7-s448c" event={"ID":"33d96c48-0a4f-47de-af50-8017a3021653","Type":"ContainerStarted","Data":"768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60"}
Jul 23 15:53:10.424985 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:10.424943    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644b5d9fd7-s448c" event={"ID":"33d96c48-0a4f-47de-af50-8017a3021653","Type":"ContainerStarted","Data":"622adc6e3fcf72243970ab24474db88fea74a02f61d8fa6f375e0fe262119040"}
Jul 23 15:53:10.443355 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:10.443305    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-644b5d9fd7-s448c" podStartSLOduration=1.443289916 podStartE2EDuration="1.443289916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:53:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:53:10.442375284 +0000 UTC m=+176.366229919" watchObservedRunningTime="2026-07-23 15:53:10.443289916 +0000 UTC m=+176.367144550"
Jul 23 15:53:19.473306 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:19.473265    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:19.473815 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:19.473342    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:19.478003 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:19.477982    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:20.467907 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:20.467877    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:53:20.648643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:20.648600    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:20.748851 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:20.748760    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:20.813303 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:20.813269    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:40.899160 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:40.899090    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:40.999889 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:40.999859    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:53:58.267741 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:53:58.267704    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:16.117994 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:16.117961    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:16.185914 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:16.185876    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:19.833469 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.833432    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85db7d764f-d8zts"]
Jul 23 15:54:19.835730 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.835710    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.841415 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.841385    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rzdt\" (UniqueName: \"kubernetes.io/projected/69fa9bb6-2b67-4160-be57-4d4ed39a7140-kube-api-access-6rzdt\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.841578 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.841434    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-serving-cert\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.841578 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.841451    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-service-ca\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.841578 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.841552    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-config\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.841754 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.841578    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-trusted-ca-bundle\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.841754 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.841596    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-oauth-config\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.841754 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.841629    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-oauth-serving-cert\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.861292 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.861258    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85db7d764f-d8zts"]
Jul 23 15:54:19.903026 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.902981    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:19.942128 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.942094    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rzdt\" (UniqueName: \"kubernetes.io/projected/69fa9bb6-2b67-4160-be57-4d4ed39a7140-kube-api-access-6rzdt\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.942128 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.942137    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-serving-cert\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.942458 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.942155    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-service-ca\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.942458 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.942198    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-config\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.942458 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.942214    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-trusted-ca-bundle\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.942458 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.942230    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-oauth-config\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.942458 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.942246    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-oauth-serving-cert\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.943076 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.943049    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-service-ca\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.943076 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.943060    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-oauth-serving-cert\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.943217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.943171    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-config\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.943363 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.943339    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-trusted-ca-bundle\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.944874 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.944849    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-oauth-config\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.944974 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.944913    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-serving-cert\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.953394 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.953363    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rzdt\" (UniqueName: \"kubernetes.io/projected/69fa9bb6-2b67-4160-be57-4d4ed39a7140-kube-api-access-6rzdt\") pod \"console-85db7d764f-d8zts\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") " pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:19.974669 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:19.974636    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:20.144852 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:20.144763    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:20.279680 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:20.279649    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85db7d764f-d8zts"]
Jul 23 15:54:20.282624 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:54:20.282597    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fa9bb6_2b67_4160_be57_4d4ed39a7140.slice/crio-33078921e0a8c7a4ac59d96354b7377e08aea6e63947acb026d84ea83057f7f0 WatchSource:0}: Error finding container 33078921e0a8c7a4ac59d96354b7377e08aea6e63947acb026d84ea83057f7f0: Status 404 returned error can't find the container with id 33078921e0a8c7a4ac59d96354b7377e08aea6e63947acb026d84ea83057f7f0
Jul 23 15:54:20.690991 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:20.690951    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85db7d764f-d8zts" event={"ID":"69fa9bb6-2b67-4160-be57-4d4ed39a7140","Type":"ContainerStarted","Data":"d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959"}
Jul 23 15:54:20.691221 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:20.691003    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85db7d764f-d8zts" event={"ID":"69fa9bb6-2b67-4160-be57-4d4ed39a7140","Type":"ContainerStarted","Data":"33078921e0a8c7a4ac59d96354b7377e08aea6e63947acb026d84ea83057f7f0"}
Jul 23 15:54:20.712236 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:20.712184    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85db7d764f-d8zts" podStartSLOduration=1.712142873 podStartE2EDuration="1.712142873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:54:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:54:20.710853806 +0000 UTC m=+246.634708440" watchObservedRunningTime="2026-07-23 15:54:20.712142873 +0000 UTC m=+246.635997507"
Jul 23 15:54:28.130760 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:28.130727    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:28.202317 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:28.202288    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:30.145839 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:30.145788    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:30.146280 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:30.145881    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:30.150904 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:30.150884    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:30.732121 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:30.732092    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 15:54:30.787261 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:30.787230    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644b5d9fd7-s448c"]
Jul 23 15:54:30.895050 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:30.895022    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:30.995406 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:30.995323    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:31.056438 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:31.056404    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:41.774293 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:41.774208    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:41.870518 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:41.870480    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:42.233175 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:42.233141    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:54:55.814421 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:55.814382    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-644b5d9fd7-s448c" podUID="33d96c48-0a4f-47de-af50-8017a3021653" containerName="console" containerID="cri-o://768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60" gracePeriod=15
Jul 23 15:54:56.063433 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.063405    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:54:56.146619 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.146526    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-oauth-serving-cert\") pod \"33d96c48-0a4f-47de-af50-8017a3021653\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") "
Jul 23 15:54:56.146619 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.146559    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-service-ca\") pod \"33d96c48-0a4f-47de-af50-8017a3021653\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") "
Jul 23 15:54:56.146619 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.146578    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-trusted-ca-bundle\") pod \"33d96c48-0a4f-47de-af50-8017a3021653\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") "
Jul 23 15:54:56.146619 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.146620    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-console-config\") pod \"33d96c48-0a4f-47de-af50-8017a3021653\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") "
Jul 23 15:54:56.146901 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.146658    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33d96c48-0a4f-47de-af50-8017a3021653-console-oauth-config\") pod \"33d96c48-0a4f-47de-af50-8017a3021653\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") "
Jul 23 15:54:56.146901 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.146690    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jj9d6\" (UniqueName: \"kubernetes.io/projected/33d96c48-0a4f-47de-af50-8017a3021653-kube-api-access-jj9d6\") pod \"33d96c48-0a4f-47de-af50-8017a3021653\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") "
Jul 23 15:54:56.146901 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.146768    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33d96c48-0a4f-47de-af50-8017a3021653-console-serving-cert\") pod \"33d96c48-0a4f-47de-af50-8017a3021653\" (UID: \"33d96c48-0a4f-47de-af50-8017a3021653\") "
Jul 23 15:54:56.147079 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.146983    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "33d96c48-0a4f-47de-af50-8017a3021653" (UID: "33d96c48-0a4f-47de-af50-8017a3021653"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:54:56.147144 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.147101    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "33d96c48-0a4f-47de-af50-8017a3021653" (UID: "33d96c48-0a4f-47de-af50-8017a3021653"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:54:56.147237 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.147215    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-service-ca" (OuterVolumeSpecName: "service-ca") pod "33d96c48-0a4f-47de-af50-8017a3021653" (UID: "33d96c48-0a4f-47de-af50-8017a3021653"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:54:56.147397 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.147376    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-console-config" (OuterVolumeSpecName: "console-config") pod "33d96c48-0a4f-47de-af50-8017a3021653" (UID: "33d96c48-0a4f-47de-af50-8017a3021653"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:54:56.148983 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.148954    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33d96c48-0a4f-47de-af50-8017a3021653-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "33d96c48-0a4f-47de-af50-8017a3021653" (UID: "33d96c48-0a4f-47de-af50-8017a3021653"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:54:56.149116 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.148982    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/33d96c48-0a4f-47de-af50-8017a3021653-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "33d96c48-0a4f-47de-af50-8017a3021653" (UID: "33d96c48-0a4f-47de-af50-8017a3021653"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:54:56.149116 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.149086    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33d96c48-0a4f-47de-af50-8017a3021653-kube-api-access-jj9d6" (OuterVolumeSpecName: "kube-api-access-jj9d6") pod "33d96c48-0a4f-47de-af50-8017a3021653" (UID: "33d96c48-0a4f-47de-af50-8017a3021653"). InnerVolumeSpecName "kube-api-access-jj9d6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:54:56.247661 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.247618    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/33d96c48-0a4f-47de-af50-8017a3021653-console-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:54:56.247661 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.247652    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-oauth-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:54:56.247661 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.247662    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:54:56.247661 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.247673    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-trusted-ca-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:54:56.247933 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.247682    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/33d96c48-0a4f-47de-af50-8017a3021653-console-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:54:56.247933 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.247691    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/33d96c48-0a4f-47de-af50-8017a3021653-console-oauth-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:54:56.247933 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.247699    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jj9d6\" (UniqueName: \"kubernetes.io/projected/33d96c48-0a4f-47de-af50-8017a3021653-kube-api-access-jj9d6\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:54:56.826429 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.826393    2570 generic.go:356] "Generic (PLEG): container finished" podID="33d96c48-0a4f-47de-af50-8017a3021653" containerID="768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60" exitCode=0
Jul 23 15:54:56.826938 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.826444    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-644b5d9fd7-s448c"
Jul 23 15:54:56.826938 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.826457    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644b5d9fd7-s448c" event={"ID":"33d96c48-0a4f-47de-af50-8017a3021653","Type":"ContainerDied","Data":"768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60"}
Jul 23 15:54:56.826938 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.826499    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-644b5d9fd7-s448c" event={"ID":"33d96c48-0a4f-47de-af50-8017a3021653","Type":"ContainerDied","Data":"622adc6e3fcf72243970ab24474db88fea74a02f61d8fa6f375e0fe262119040"}
Jul 23 15:54:56.826938 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.826521    2570 scope.go:117] "RemoveContainer" containerID="768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60"
Jul 23 15:54:56.835063 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.835044    2570 scope.go:117] "RemoveContainer" containerID="768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60"
Jul 23 15:54:56.835401 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:54:56.835370    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60\": container with ID starting with 768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60 not found: ID does not exist" containerID="768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60"
Jul 23 15:54:56.835501 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.835406    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60"} err="failed to get container status \"768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60\": rpc error: code = NotFound desc = could not find container \"768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60\": container with ID starting with 768cf24b2ee30694e4e6b00ffda54c533715a5f8fe6f16dd9105f785f4f90c60 not found: ID does not exist"
Jul 23 15:54:56.847130 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.847097    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-644b5d9fd7-s448c"]
Jul 23 15:54:56.851935 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:56.851909    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-644b5d9fd7-s448c"]
Jul 23 15:54:58.602484 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:54:58.602447    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33d96c48-0a4f-47de-af50-8017a3021653" path="/var/lib/kubelet/pods/33d96c48-0a4f-47de-af50-8017a3021653/volumes"
Jul 23 15:55:14.456669 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:14.456639    2570 kubelet.go:1648] "Image garbage collection succeeded"
Jul 23 15:55:27.024199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.024168    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:27.859814 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.859774    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"]
Jul 23 15:55:27.860120 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.860107    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33d96c48-0a4f-47de-af50-8017a3021653" containerName="console"
Jul 23 15:55:27.860120 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.860121    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="33d96c48-0a4f-47de-af50-8017a3021653" containerName="console"
Jul 23 15:55:27.860223 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.860181    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="33d96c48-0a4f-47de-af50-8017a3021653" containerName="console"
Jul 23 15:55:27.863194 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.863175    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:27.866908 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.866888    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 15:55:27.867691 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.867676    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ljjgf\""
Jul 23 15:55:27.867784 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.867681    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 15:55:27.877695 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.877672    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"]
Jul 23 15:55:27.912611 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.912573    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf4124e-99f5-466e-a827-fb90d39c3a6e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp\" (UID: \"baf4124e-99f5-466e-a827-fb90d39c3a6e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:27.912792 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.912661    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft96r\" (UniqueName: \"kubernetes.io/projected/baf4124e-99f5-466e-a827-fb90d39c3a6e-kube-api-access-ft96r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp\" (UID: \"baf4124e-99f5-466e-a827-fb90d39c3a6e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:27.912792 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:27.912735    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf4124e-99f5-466e-a827-fb90d39c3a6e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp\" (UID: \"baf4124e-99f5-466e-a827-fb90d39c3a6e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:28.014023 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:28.013981    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft96r\" (UniqueName: \"kubernetes.io/projected/baf4124e-99f5-466e-a827-fb90d39c3a6e-kube-api-access-ft96r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp\" (UID: \"baf4124e-99f5-466e-a827-fb90d39c3a6e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:28.014215 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:28.014046    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf4124e-99f5-466e-a827-fb90d39c3a6e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp\" (UID: \"baf4124e-99f5-466e-a827-fb90d39c3a6e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:28.014215 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:28.014083    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf4124e-99f5-466e-a827-fb90d39c3a6e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp\" (UID: \"baf4124e-99f5-466e-a827-fb90d39c3a6e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:28.014423 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:28.014405    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf4124e-99f5-466e-a827-fb90d39c3a6e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp\" (UID: \"baf4124e-99f5-466e-a827-fb90d39c3a6e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:28.014524 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:28.014503    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf4124e-99f5-466e-a827-fb90d39c3a6e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp\" (UID: \"baf4124e-99f5-466e-a827-fb90d39c3a6e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:28.023528 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:28.023500    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft96r\" (UniqueName: \"kubernetes.io/projected/baf4124e-99f5-466e-a827-fb90d39c3a6e-kube-api-access-ft96r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp\" (UID: \"baf4124e-99f5-466e-a827-fb90d39c3a6e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:28.171768 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:28.171657    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:28.303416 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:28.303360    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"]
Jul 23 15:55:28.305552 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:55:28.305528    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaf4124e_99f5_466e_a827_fb90d39c3a6e.slice/crio-97c8f4747bf7b915b93be3e62ede0fec7c3fab709023cbd1356cce1a04ff8ae9 WatchSource:0}: Error finding container 97c8f4747bf7b915b93be3e62ede0fec7c3fab709023cbd1356cce1a04ff8ae9: Status 404 returned error can't find the container with id 97c8f4747bf7b915b93be3e62ede0fec7c3fab709023cbd1356cce1a04ff8ae9
Jul 23 15:55:28.307604 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:28.307584    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 15:55:28.719231 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:28.719202    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:28.952476 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:28.952435    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp" event={"ID":"baf4124e-99f5-466e-a827-fb90d39c3a6e","Type":"ContainerStarted","Data":"97c8f4747bf7b915b93be3e62ede0fec7c3fab709023cbd1356cce1a04ff8ae9"}
Jul 23 15:55:34.979514 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:34.979470    2570 generic.go:356] "Generic (PLEG): container finished" podID="baf4124e-99f5-466e-a827-fb90d39c3a6e" containerID="b77b38a2cc030d75a0cc1c13097071e70a836c98c8f6bc500d57818e9120f971" exitCode=0
Jul 23 15:55:34.979896 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:34.979550    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp" event={"ID":"baf4124e-99f5-466e-a827-fb90d39c3a6e","Type":"ContainerDied","Data":"b77b38a2cc030d75a0cc1c13097071e70a836c98c8f6bc500d57818e9120f971"}
Jul 23 15:55:37.994555 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:37.994525    2570 generic.go:356] "Generic (PLEG): container finished" podID="baf4124e-99f5-466e-a827-fb90d39c3a6e" containerID="2e0a5741a276c49f3afc2317c88d0285b67fb02cb2da72b0b2b9ea7268c19598" exitCode=0
Jul 23 15:55:37.994948 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:37.994566    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp" event={"ID":"baf4124e-99f5-466e-a827-fb90d39c3a6e","Type":"ContainerDied","Data":"2e0a5741a276c49f3afc2317c88d0285b67fb02cb2da72b0b2b9ea7268c19598"}
Jul 23 15:55:45.028171 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:45.028136    2570 generic.go:356] "Generic (PLEG): container finished" podID="baf4124e-99f5-466e-a827-fb90d39c3a6e" containerID="a5970bd59ab9546055e2d7c40121dc70e7cd519640144b5da058b1a25ebb569c" exitCode=0
Jul 23 15:55:45.028621 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:45.028186    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp" event={"ID":"baf4124e-99f5-466e-a827-fb90d39c3a6e","Type":"ContainerDied","Data":"a5970bd59ab9546055e2d7c40121dc70e7cd519640144b5da058b1a25ebb569c"}
Jul 23 15:55:46.160873 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:46.160846    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:46.279792 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:46.279751    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf4124e-99f5-466e-a827-fb90d39c3a6e-bundle\") pod \"baf4124e-99f5-466e-a827-fb90d39c3a6e\" (UID: \"baf4124e-99f5-466e-a827-fb90d39c3a6e\") "
Jul 23 15:55:46.279792 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:46.279793    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf4124e-99f5-466e-a827-fb90d39c3a6e-util\") pod \"baf4124e-99f5-466e-a827-fb90d39c3a6e\" (UID: \"baf4124e-99f5-466e-a827-fb90d39c3a6e\") "
Jul 23 15:55:46.279991 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:46.279828    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ft96r\" (UniqueName: \"kubernetes.io/projected/baf4124e-99f5-466e-a827-fb90d39c3a6e-kube-api-access-ft96r\") pod \"baf4124e-99f5-466e-a827-fb90d39c3a6e\" (UID: \"baf4124e-99f5-466e-a827-fb90d39c3a6e\") "
Jul 23 15:55:46.280490 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:46.280445    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf4124e-99f5-466e-a827-fb90d39c3a6e-bundle" (OuterVolumeSpecName: "bundle") pod "baf4124e-99f5-466e-a827-fb90d39c3a6e" (UID: "baf4124e-99f5-466e-a827-fb90d39c3a6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:55:46.282154 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:46.282099    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/baf4124e-99f5-466e-a827-fb90d39c3a6e-kube-api-access-ft96r" (OuterVolumeSpecName: "kube-api-access-ft96r") pod "baf4124e-99f5-466e-a827-fb90d39c3a6e" (UID: "baf4124e-99f5-466e-a827-fb90d39c3a6e"). InnerVolumeSpecName "kube-api-access-ft96r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:55:46.283784 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:46.283749    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/baf4124e-99f5-466e-a827-fb90d39c3a6e-util" (OuterVolumeSpecName: "util") pod "baf4124e-99f5-466e-a827-fb90d39c3a6e" (UID: "baf4124e-99f5-466e-a827-fb90d39c3a6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:55:46.380431 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:46.380387    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ft96r\" (UniqueName: \"kubernetes.io/projected/baf4124e-99f5-466e-a827-fb90d39c3a6e-kube-api-access-ft96r\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:55:46.380431 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:46.380425    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/baf4124e-99f5-466e-a827-fb90d39c3a6e-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:55:46.380431 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:46.380434    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/baf4124e-99f5-466e-a827-fb90d39c3a6e-util\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:55:47.038026 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:47.037994    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp"
Jul 23 15:55:47.038182 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:47.038033    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675402hhzp" event={"ID":"baf4124e-99f5-466e-a827-fb90d39c3a6e","Type":"ContainerDied","Data":"97c8f4747bf7b915b93be3e62ede0fec7c3fab709023cbd1356cce1a04ff8ae9"}
Jul 23 15:55:47.038182 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:47.038083    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97c8f4747bf7b915b93be3e62ede0fec7c3fab709023cbd1356cce1a04ff8ae9"
Jul 23 15:55:49.085787 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:49.085742    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:50.449236 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:50.449204    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:51.109103 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.109067    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj"]
Jul 23 15:55:51.109440 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.109423    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf4124e-99f5-466e-a827-fb90d39c3a6e" containerName="extract"
Jul 23 15:55:51.109520 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.109443    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf4124e-99f5-466e-a827-fb90d39c3a6e" containerName="extract"
Jul 23 15:55:51.109520 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.109456    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf4124e-99f5-466e-a827-fb90d39c3a6e" containerName="util"
Jul 23 15:55:51.109520 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.109465    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf4124e-99f5-466e-a827-fb90d39c3a6e" containerName="util"
Jul 23 15:55:51.109520 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.109494    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="baf4124e-99f5-466e-a827-fb90d39c3a6e" containerName="pull"
Jul 23 15:55:51.109520 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.109503    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="baf4124e-99f5-466e-a827-fb90d39c3a6e" containerName="pull"
Jul 23 15:55:51.109761 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.109575    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="baf4124e-99f5-466e-a827-fb90d39c3a6e" containerName="extract"
Jul 23 15:55:51.160586 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.160525    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj"]
Jul 23 15:55:51.160744 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.160654    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj"
Jul 23 15:55:51.165574 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.165541    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 23 15:55:51.165754 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.165541    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 23 15:55:51.165754 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.165711    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wrtmr\""
Jul 23 15:55:51.322796 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.322756    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be4f2ee5-b767-4a7f-95e1-e1e5b1315a19-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ncgzj\" (UID: \"be4f2ee5-b767-4a7f-95e1-e1e5b1315a19\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj"
Jul 23 15:55:51.322966 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.322853    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvhvg\" (UniqueName: \"kubernetes.io/projected/be4f2ee5-b767-4a7f-95e1-e1e5b1315a19-kube-api-access-kvhvg\") pod \"cert-manager-operator-controller-manager-55c444bf86-ncgzj\" (UID: \"be4f2ee5-b767-4a7f-95e1-e1e5b1315a19\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj"
Jul 23 15:55:51.423462 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.423383    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvhvg\" (UniqueName: \"kubernetes.io/projected/be4f2ee5-b767-4a7f-95e1-e1e5b1315a19-kube-api-access-kvhvg\") pod \"cert-manager-operator-controller-manager-55c444bf86-ncgzj\" (UID: \"be4f2ee5-b767-4a7f-95e1-e1e5b1315a19\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj"
Jul 23 15:55:51.423462 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.423438    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be4f2ee5-b767-4a7f-95e1-e1e5b1315a19-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ncgzj\" (UID: \"be4f2ee5-b767-4a7f-95e1-e1e5b1315a19\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj"
Jul 23 15:55:51.423774 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.423759    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/be4f2ee5-b767-4a7f-95e1-e1e5b1315a19-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-ncgzj\" (UID: \"be4f2ee5-b767-4a7f-95e1-e1e5b1315a19\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj"
Jul 23 15:55:51.432685 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.432656    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvhvg\" (UniqueName: \"kubernetes.io/projected/be4f2ee5-b767-4a7f-95e1-e1e5b1315a19-kube-api-access-kvhvg\") pod \"cert-manager-operator-controller-manager-55c444bf86-ncgzj\" (UID: \"be4f2ee5-b767-4a7f-95e1-e1e5b1315a19\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj"
Jul 23 15:55:51.469641 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.469605    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj"
Jul 23 15:55:51.611978 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:51.611934    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj"]
Jul 23 15:55:51.616259 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:55:51.616228    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4f2ee5_b767_4a7f_95e1_e1e5b1315a19.slice/crio-4b6c73524b75f228f999e396072bcc2407d0771e4b8faa49279b74a7f1f77615 WatchSource:0}: Error finding container 4b6c73524b75f228f999e396072bcc2407d0771e4b8faa49279b74a7f1f77615: Status 404 returned error can't find the container with id 4b6c73524b75f228f999e396072bcc2407d0771e4b8faa49279b74a7f1f77615
Jul 23 15:55:52.061199 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:52.061164    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj" event={"ID":"be4f2ee5-b767-4a7f-95e1-e1e5b1315a19","Type":"ContainerStarted","Data":"4b6c73524b75f228f999e396072bcc2407d0771e4b8faa49279b74a7f1f77615"}
Jul 23 15:55:52.703711 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:52.703679    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:52.802667 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:52.802633    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:55.074775 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.074739    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj" event={"ID":"be4f2ee5-b767-4a7f-95e1-e1e5b1315a19","Type":"ContainerStarted","Data":"d15f1d74497258256d3e0cf73ec96c99660f9d0ff02e25e751d335eca3c3056a"}
Jul 23 15:55:55.096876 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.096817    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-ncgzj" podStartSLOduration=0.765232659 podStartE2EDuration="4.096798785s" totalImagesPullingTime="3.331566126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:55:55.095782245 +0000 UTC m=+341.019636877" watchObservedRunningTime="2026-07-23 15:55:55.096798785 +0000 UTC m=+341.020653423"
Jul 23 15:55:55.594692 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.594660    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:55.715237 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.715189    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:55.796770 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.796737    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"]
Jul 23 15:55:55.799239 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.799219    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:55:55.802935 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.802911    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 15:55:55.803084 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.803039    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 15:55:55.804002 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.803988    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ljjgf\""
Jul 23 15:55:55.817275 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.817241    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"]
Jul 23 15:55:55.846246 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.846162    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:55.965645 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.965610    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36241c65-56a0-46de-a39d-debf62ebcce2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd\" (UID: \"36241c65-56a0-46de-a39d-debf62ebcce2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:55:55.965844 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.965672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36241c65-56a0-46de-a39d-debf62ebcce2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd\" (UID: \"36241c65-56a0-46de-a39d-debf62ebcce2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:55:55.965844 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.965704    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwb7m\" (UniqueName: \"kubernetes.io/projected/36241c65-56a0-46de-a39d-debf62ebcce2-kube-api-access-vwb7m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd\" (UID: \"36241c65-56a0-46de-a39d-debf62ebcce2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:55:55.995797 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:55.995767    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:56.067158 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.067123    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36241c65-56a0-46de-a39d-debf62ebcce2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd\" (UID: \"36241c65-56a0-46de-a39d-debf62ebcce2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:55:56.067325 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.067173    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36241c65-56a0-46de-a39d-debf62ebcce2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd\" (UID: \"36241c65-56a0-46de-a39d-debf62ebcce2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:55:56.067325 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.067203    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwb7m\" (UniqueName: \"kubernetes.io/projected/36241c65-56a0-46de-a39d-debf62ebcce2-kube-api-access-vwb7m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd\" (UID: \"36241c65-56a0-46de-a39d-debf62ebcce2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:55:56.067580 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.067560    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36241c65-56a0-46de-a39d-debf62ebcce2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd\" (UID: \"36241c65-56a0-46de-a39d-debf62ebcce2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:55:56.067616 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.067599    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36241c65-56a0-46de-a39d-debf62ebcce2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd\" (UID: \"36241c65-56a0-46de-a39d-debf62ebcce2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:55:56.080035 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.079978    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwb7m\" (UniqueName: \"kubernetes.io/projected/36241c65-56a0-46de-a39d-debf62ebcce2-kube-api-access-vwb7m\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd\" (UID: \"36241c65-56a0-46de-a39d-debf62ebcce2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:55:56.107774 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.107691    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:55:56.242699 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.242673    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"]
Jul 23 15:55:56.244875 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:55:56.244842    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36241c65_56a0_46de_a39d_debf62ebcce2.slice/crio-178e6d302bfe30b7baca0c0cec00bf034db070c1dacc46f3811e719e4058e1a3 WatchSource:0}: Error finding container 178e6d302bfe30b7baca0c0cec00bf034db070c1dacc46f3811e719e4058e1a3: Status 404 returned error can't find the container with id 178e6d302bfe30b7baca0c0cec00bf034db070c1dacc46f3811e719e4058e1a3
Jul 23 15:55:56.384320 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.384244    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-s2c4b"]
Jul 23 15:55:56.386590 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.386569    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b"
Jul 23 15:55:56.389414 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.389392    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 23 15:55:56.389532 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.389393    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 23 15:55:56.389532 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.389452    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-h6nhh\""
Jul 23 15:55:56.396634 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.396608    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-s2c4b"]
Jul 23 15:55:56.470928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.470885    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v92pw\" (UniqueName: \"kubernetes.io/projected/c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2-kube-api-access-v92pw\") pod \"cert-manager-webhook-6486ffd997-s2c4b\" (UID: \"c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b"
Jul 23 15:55:56.471135 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.470946    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-s2c4b\" (UID: \"c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b"
Jul 23 15:55:56.571827 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.571784    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-s2c4b\" (UID: \"c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b"
Jul 23 15:55:56.572000 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.571887    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v92pw\" (UniqueName: \"kubernetes.io/projected/c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2-kube-api-access-v92pw\") pod \"cert-manager-webhook-6486ffd997-s2c4b\" (UID: \"c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b"
Jul 23 15:55:56.581196 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.581167    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-s2c4b\" (UID: \"c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b"
Jul 23 15:55:56.581305 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.581218    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v92pw\" (UniqueName: \"kubernetes.io/projected/c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2-kube-api-access-v92pw\") pod \"cert-manager-webhook-6486ffd997-s2c4b\" (UID: \"c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b"
Jul 23 15:55:56.718164 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.718127    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b"
Jul 23 15:55:56.852346 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:56.852311    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-s2c4b"]
Jul 23 15:55:56.855258 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:55:56.855228    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7d5fae7_a202_44ba_b2f3_e66dfe9bfec2.slice/crio-a49ffaeed51a1e0810121843acaf15d2b452ef96332dc88c96b8080da2e5332d WatchSource:0}: Error finding container a49ffaeed51a1e0810121843acaf15d2b452ef96332dc88c96b8080da2e5332d: Status 404 returned error can't find the container with id a49ffaeed51a1e0810121843acaf15d2b452ef96332dc88c96b8080da2e5332d
Jul 23 15:55:57.085145 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:57.085037    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b" event={"ID":"c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2","Type":"ContainerStarted","Data":"a49ffaeed51a1e0810121843acaf15d2b452ef96332dc88c96b8080da2e5332d"}
Jul 23 15:55:57.086578 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:57.086553    2570 generic.go:356] "Generic (PLEG): container finished" podID="36241c65-56a0-46de-a39d-debf62ebcce2" containerID="6439f38de0a43d3fd37339270cb478eaed3b97f4a8ab5f56850fcc6aa678a31d" exitCode=0
Jul 23 15:55:57.086694 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:57.086594    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd" event={"ID":"36241c65-56a0-46de-a39d-debf62ebcce2","Type":"ContainerDied","Data":"6439f38de0a43d3fd37339270cb478eaed3b97f4a8ab5f56850fcc6aa678a31d"}
Jul 23 15:55:57.086694 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:57.086654    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd" event={"ID":"36241c65-56a0-46de-a39d-debf62ebcce2","Type":"ContainerStarted","Data":"178e6d302bfe30b7baca0c0cec00bf034db070c1dacc46f3811e719e4058e1a3"}
Jul 23 15:55:58.217327 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:58.217287    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:58.615612 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:58.615479    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:59.850284 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:59.850245    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:55:59.912104 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:55:59.912067    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:01.112190 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:01.112152    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b" event={"ID":"c7d5fae7-a202-44ba-b2f3-e66dfe9bfec2","Type":"ContainerStarted","Data":"c48aa128ddb59551372120ea5a69888cd0eb4cc360f0dfc74b23ee67e3712059"}
Jul 23 15:56:01.112647 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:01.112250    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b"
Jul 23 15:56:01.113902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:01.113873    2570 generic.go:356] "Generic (PLEG): container finished" podID="36241c65-56a0-46de-a39d-debf62ebcce2" containerID="c061a2eba5089b59d45022f600db8ee7e45710b02a288822296b73df7e00adf0" exitCode=0
Jul 23 15:56:01.114006 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:01.113935    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd" event={"ID":"36241c65-56a0-46de-a39d-debf62ebcce2","Type":"ContainerDied","Data":"c061a2eba5089b59d45022f600db8ee7e45710b02a288822296b73df7e00adf0"}
Jul 23 15:56:01.135648 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:01.135603    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b" podStartSLOduration=1.872040793 podStartE2EDuration="5.135586612s" totalImagesPullingTime="3.263545819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:56:01.135004611 +0000 UTC m=+347.058859244" watchObservedRunningTime="2026-07-23 15:56:01.135586612 +0000 UTC m=+347.059441245"
Jul 23 15:56:02.121126 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:02.121092    2570 generic.go:356] "Generic (PLEG): container finished" podID="36241c65-56a0-46de-a39d-debf62ebcce2" containerID="6cea76958390d9e64e4f2ab5e2ef2475e674178fcaccba17aaf68644f6457655" exitCode=0
Jul 23 15:56:02.121536 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:02.121182    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd" event={"ID":"36241c65-56a0-46de-a39d-debf62ebcce2","Type":"ContainerDied","Data":"6cea76958390d9e64e4f2ab5e2ef2475e674178fcaccba17aaf68644f6457655"}
Jul 23 15:56:03.257479 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:03.257453    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:56:03.437186 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:03.437092    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36241c65-56a0-46de-a39d-debf62ebcce2-bundle\") pod \"36241c65-56a0-46de-a39d-debf62ebcce2\" (UID: \"36241c65-56a0-46de-a39d-debf62ebcce2\") "
Jul 23 15:56:03.437186 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:03.437160    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36241c65-56a0-46de-a39d-debf62ebcce2-util\") pod \"36241c65-56a0-46de-a39d-debf62ebcce2\" (UID: \"36241c65-56a0-46de-a39d-debf62ebcce2\") "
Jul 23 15:56:03.437419 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:03.437190    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwb7m\" (UniqueName: \"kubernetes.io/projected/36241c65-56a0-46de-a39d-debf62ebcce2-kube-api-access-vwb7m\") pod \"36241c65-56a0-46de-a39d-debf62ebcce2\" (UID: \"36241c65-56a0-46de-a39d-debf62ebcce2\") "
Jul 23 15:56:03.437525 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:03.437501    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36241c65-56a0-46de-a39d-debf62ebcce2-bundle" (OuterVolumeSpecName: "bundle") pod "36241c65-56a0-46de-a39d-debf62ebcce2" (UID: "36241c65-56a0-46de-a39d-debf62ebcce2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:56:03.439328 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:03.439298    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36241c65-56a0-46de-a39d-debf62ebcce2-kube-api-access-vwb7m" (OuterVolumeSpecName: "kube-api-access-vwb7m") pod "36241c65-56a0-46de-a39d-debf62ebcce2" (UID: "36241c65-56a0-46de-a39d-debf62ebcce2"). InnerVolumeSpecName "kube-api-access-vwb7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:56:03.442346 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:03.442321    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36241c65-56a0-46de-a39d-debf62ebcce2-util" (OuterVolumeSpecName: "util") pod "36241c65-56a0-46de-a39d-debf62ebcce2" (UID: "36241c65-56a0-46de-a39d-debf62ebcce2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:56:03.537930 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:03.537891    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/36241c65-56a0-46de-a39d-debf62ebcce2-util\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:56:03.537930 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:03.537923    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwb7m\" (UniqueName: \"kubernetes.io/projected/36241c65-56a0-46de-a39d-debf62ebcce2-kube-api-access-vwb7m\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:56:03.537930 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:03.537937    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/36241c65-56a0-46de-a39d-debf62ebcce2-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:56:04.137816 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:04.137791    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd"
Jul 23 15:56:04.137985 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:04.137788    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fzqqmd" event={"ID":"36241c65-56a0-46de-a39d-debf62ebcce2","Type":"ContainerDied","Data":"178e6d302bfe30b7baca0c0cec00bf034db070c1dacc46f3811e719e4058e1a3"}
Jul 23 15:56:04.137985 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:04.137944    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="178e6d302bfe30b7baca0c0cec00bf034db070c1dacc46f3811e719e4058e1a3"
Jul 23 15:56:05.278004 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:05.277950    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:05.443865 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:05.443829    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:05.699080 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:05.698991    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:07.123291 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.123250    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-s2c4b"
Jul 23 15:56:07.532227 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.532196    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:07.663392 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.663362    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:07.970416 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.970381    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ggmvl"]
Jul 23 15:56:07.970708 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.970696    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36241c65-56a0-46de-a39d-debf62ebcce2" containerName="pull"
Jul 23 15:56:07.970767 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.970710    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="36241c65-56a0-46de-a39d-debf62ebcce2" containerName="pull"
Jul 23 15:56:07.970767 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.970723    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36241c65-56a0-46de-a39d-debf62ebcce2" containerName="util"
Jul 23 15:56:07.970767 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.970729    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="36241c65-56a0-46de-a39d-debf62ebcce2" containerName="util"
Jul 23 15:56:07.970767 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.970744    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36241c65-56a0-46de-a39d-debf62ebcce2" containerName="extract"
Jul 23 15:56:07.970767 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.970750    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="36241c65-56a0-46de-a39d-debf62ebcce2" containerName="extract"
Jul 23 15:56:07.970910 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.970804    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="36241c65-56a0-46de-a39d-debf62ebcce2" containerName="extract"
Jul 23 15:56:07.973862 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.973843    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ggmvl"
Jul 23 15:56:07.978428 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.978405    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nkmgg\""
Jul 23 15:56:07.994452 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:07.994410    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ggmvl"]
Jul 23 15:56:08.078749 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:08.078716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb-bound-sa-token\") pod \"cert-manager-55b4d954d5-ggmvl\" (UID: \"bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb\") " pod="cert-manager/cert-manager-55b4d954d5-ggmvl"
Jul 23 15:56:08.078928 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:08.078760    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7hn7\" (UniqueName: \"kubernetes.io/projected/bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb-kube-api-access-v7hn7\") pod \"cert-manager-55b4d954d5-ggmvl\" (UID: \"bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb\") " pod="cert-manager/cert-manager-55b4d954d5-ggmvl"
Jul 23 15:56:08.179904 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:08.179866    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb-bound-sa-token\") pod \"cert-manager-55b4d954d5-ggmvl\" (UID: \"bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb\") " pod="cert-manager/cert-manager-55b4d954d5-ggmvl"
Jul 23 15:56:08.179904 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:08.179916    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7hn7\" (UniqueName: \"kubernetes.io/projected/bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb-kube-api-access-v7hn7\") pod \"cert-manager-55b4d954d5-ggmvl\" (UID: \"bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb\") " pod="cert-manager/cert-manager-55b4d954d5-ggmvl"
Jul 23 15:56:08.207270 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:08.207244    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7hn7\" (UniqueName: \"kubernetes.io/projected/bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb-kube-api-access-v7hn7\") pod \"cert-manager-55b4d954d5-ggmvl\" (UID: \"bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb\") " pod="cert-manager/cert-manager-55b4d954d5-ggmvl"
Jul 23 15:56:08.213350 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:08.213324    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb-bound-sa-token\") pod \"cert-manager-55b4d954d5-ggmvl\" (UID: \"bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb\") " pod="cert-manager/cert-manager-55b4d954d5-ggmvl"
Jul 23 15:56:08.283081 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:08.282956    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ggmvl"
Jul 23 15:56:08.426349 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:08.426309    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ggmvl"]
Jul 23 15:56:08.432190 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:56:08.432157    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfbf4f4b_5603_49af_9c80_bdebeb5ffbcb.slice/crio-aaa4f06bc8cf3039a3aff4f8760c89e6c80ebf650df7cc13134c65405058939e WatchSource:0}: Error finding container aaa4f06bc8cf3039a3aff4f8760c89e6c80ebf650df7cc13134c65405058939e: Status 404 returned error can't find the container with id aaa4f06bc8cf3039a3aff4f8760c89e6c80ebf650df7cc13134c65405058939e
Jul 23 15:56:09.161629 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:09.161591    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ggmvl" event={"ID":"bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb","Type":"ContainerStarted","Data":"1c171cc751693a13089bd6199b77ffed79a492646de290a0e845cca84e7764f2"}
Jul 23 15:56:09.161629 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:09.161634    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ggmvl" event={"ID":"bfbf4f4b-5603-49af-9c80-bdebeb5ffbcb","Type":"ContainerStarted","Data":"aaa4f06bc8cf3039a3aff4f8760c89e6c80ebf650df7cc13134c65405058939e"}
Jul 23 15:56:09.183986 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:09.183931    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ggmvl" podStartSLOduration=2.183914092 podStartE2EDuration="2.183914092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:56:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:56:09.182850473 +0000 UTC m=+355.106705106" watchObservedRunningTime="2026-07-23 15:56:09.183914092 +0000 UTC m=+355.107768725"
Jul 23 15:56:13.553272 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:13.553235    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:13.650374 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:13.650328    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:15.193194 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.193159    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"]
Jul 23 15:56:15.196330 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.196312    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:15.199314 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.199285    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 23 15:56:15.199314 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.199300    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ljjgf\""
Jul 23 15:56:15.200425 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.200404    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 23 15:56:15.205957 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.205932    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"]
Jul 23 15:56:15.240402 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.240358    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsj6r\" (UniqueName: \"kubernetes.io/projected/988f1952-dbce-4f77-8188-bcc9c00563af-kube-api-access-hsj6r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg\" (UID: \"988f1952-dbce-4f77-8188-bcc9c00563af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:15.240402 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.240410    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/988f1952-dbce-4f77-8188-bcc9c00563af-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg\" (UID: \"988f1952-dbce-4f77-8188-bcc9c00563af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:15.240625 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.240434    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/988f1952-dbce-4f77-8188-bcc9c00563af-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg\" (UID: \"988f1952-dbce-4f77-8188-bcc9c00563af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:15.341732 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.341689    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsj6r\" (UniqueName: \"kubernetes.io/projected/988f1952-dbce-4f77-8188-bcc9c00563af-kube-api-access-hsj6r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg\" (UID: \"988f1952-dbce-4f77-8188-bcc9c00563af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:15.341911 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.341742    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/988f1952-dbce-4f77-8188-bcc9c00563af-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg\" (UID: \"988f1952-dbce-4f77-8188-bcc9c00563af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:15.341911 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.341770    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/988f1952-dbce-4f77-8188-bcc9c00563af-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg\" (UID: \"988f1952-dbce-4f77-8188-bcc9c00563af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:15.342261 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.342239    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/988f1952-dbce-4f77-8188-bcc9c00563af-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg\" (UID: \"988f1952-dbce-4f77-8188-bcc9c00563af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:15.342344 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.342287    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/988f1952-dbce-4f77-8188-bcc9c00563af-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg\" (UID: \"988f1952-dbce-4f77-8188-bcc9c00563af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:15.349799 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.349772    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsj6r\" (UniqueName: \"kubernetes.io/projected/988f1952-dbce-4f77-8188-bcc9c00563af-kube-api-access-hsj6r\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg\" (UID: \"988f1952-dbce-4f77-8188-bcc9c00563af\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:15.488835 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.488795    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:15.506159 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.506131    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:15.641971 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:15.641815    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"]
Jul 23 15:56:15.644539 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:56:15.644497    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod988f1952_dbce_4f77_8188_bcc9c00563af.slice/crio-0a4223d59bdc9ae71b3b42de55738b1c3b37d2a64c7c2e68822529dcb64c4660 WatchSource:0}: Error finding container 0a4223d59bdc9ae71b3b42de55738b1c3b37d2a64c7c2e68822529dcb64c4660: Status 404 returned error can't find the container with id 0a4223d59bdc9ae71b3b42de55738b1c3b37d2a64c7c2e68822529dcb64c4660
Jul 23 15:56:16.193118 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:16.193022    2570 generic.go:356] "Generic (PLEG): container finished" podID="988f1952-dbce-4f77-8188-bcc9c00563af" containerID="2a7d5a0d67db37857a68c5f54dd71b70cb48bd2c989e7df009c0fcb46ca679bc" exitCode=0
Jul 23 15:56:16.193118 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:16.193086    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg" event={"ID":"988f1952-dbce-4f77-8188-bcc9c00563af","Type":"ContainerDied","Data":"2a7d5a0d67db37857a68c5f54dd71b70cb48bd2c989e7df009c0fcb46ca679bc"}
Jul 23 15:56:16.193529 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:16.193123    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg" event={"ID":"988f1952-dbce-4f77-8188-bcc9c00563af","Type":"ContainerStarted","Data":"0a4223d59bdc9ae71b3b42de55738b1c3b37d2a64c7c2e68822529dcb64c4660"}
Jul 23 15:56:17.198724 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:17.198639    2570 generic.go:356] "Generic (PLEG): container finished" podID="988f1952-dbce-4f77-8188-bcc9c00563af" containerID="121789b1cd2c2386c453ba9f7f123f7a93b85aeda66433c0c139d2933cb1eaa9" exitCode=0
Jul 23 15:56:17.198724 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:17.198706    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg" event={"ID":"988f1952-dbce-4f77-8188-bcc9c00563af","Type":"ContainerDied","Data":"121789b1cd2c2386c453ba9f7f123f7a93b85aeda66433c0c139d2933cb1eaa9"}
Jul 23 15:56:18.205320 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:18.205279    2570 generic.go:356] "Generic (PLEG): container finished" podID="988f1952-dbce-4f77-8188-bcc9c00563af" containerID="a703fb98530850e03d0585494995a1d94d75fd4758bb62b3f7c613af332c591e" exitCode=0
Jul 23 15:56:18.205723 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:18.205367    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg" event={"ID":"988f1952-dbce-4f77-8188-bcc9c00563af","Type":"ContainerDied","Data":"a703fb98530850e03d0585494995a1d94d75fd4758bb62b3f7c613af332c591e"}
Jul 23 15:56:19.362277 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:19.362239    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:19.478910 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:19.478879    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/988f1952-dbce-4f77-8188-bcc9c00563af-util\") pod \"988f1952-dbce-4f77-8188-bcc9c00563af\" (UID: \"988f1952-dbce-4f77-8188-bcc9c00563af\") "
Jul 23 15:56:19.479121 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:19.478927    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/988f1952-dbce-4f77-8188-bcc9c00563af-bundle\") pod \"988f1952-dbce-4f77-8188-bcc9c00563af\" (UID: \"988f1952-dbce-4f77-8188-bcc9c00563af\") "
Jul 23 15:56:19.479121 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:19.479000    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsj6r\" (UniqueName: \"kubernetes.io/projected/988f1952-dbce-4f77-8188-bcc9c00563af-kube-api-access-hsj6r\") pod \"988f1952-dbce-4f77-8188-bcc9c00563af\" (UID: \"988f1952-dbce-4f77-8188-bcc9c00563af\") "
Jul 23 15:56:19.479720 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:19.479683    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988f1952-dbce-4f77-8188-bcc9c00563af-bundle" (OuterVolumeSpecName: "bundle") pod "988f1952-dbce-4f77-8188-bcc9c00563af" (UID: "988f1952-dbce-4f77-8188-bcc9c00563af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:56:19.481161 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:19.481136    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/988f1952-dbce-4f77-8188-bcc9c00563af-kube-api-access-hsj6r" (OuterVolumeSpecName: "kube-api-access-hsj6r") pod "988f1952-dbce-4f77-8188-bcc9c00563af" (UID: "988f1952-dbce-4f77-8188-bcc9c00563af"). InnerVolumeSpecName "kube-api-access-hsj6r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:56:19.488103 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:19.488059    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/988f1952-dbce-4f77-8188-bcc9c00563af-util" (OuterVolumeSpecName: "util") pod "988f1952-dbce-4f77-8188-bcc9c00563af" (UID: "988f1952-dbce-4f77-8188-bcc9c00563af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:56:19.580511 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:19.580475    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsj6r\" (UniqueName: \"kubernetes.io/projected/988f1952-dbce-4f77-8188-bcc9c00563af-kube-api-access-hsj6r\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:56:19.580511 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:19.580507    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/988f1952-dbce-4f77-8188-bcc9c00563af-util\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:56:19.580511 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:19.580524    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/988f1952-dbce-4f77-8188-bcc9c00563af-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:56:20.215544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:20.215514    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg"
Jul 23 15:56:20.215544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:20.215527    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af654zg" event={"ID":"988f1952-dbce-4f77-8188-bcc9c00563af","Type":"ContainerDied","Data":"0a4223d59bdc9ae71b3b42de55738b1c3b37d2a64c7c2e68822529dcb64c4660"}
Jul 23 15:56:20.215758 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:20.215575    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0a4223d59bdc9ae71b3b42de55738b1c3b37d2a64c7c2e68822529dcb64c4660"
Jul 23 15:56:31.526996 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:31.526960    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:31.614247 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:31.614213    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:32.113494 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.113443    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:32.363001 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.362972    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:32.467769 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.467733    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:32.578769 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.578739    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"]
Jul 23 15:56:32.579137 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.579078    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="988f1952-dbce-4f77-8188-bcc9c00563af" containerName="pull"
Jul 23 15:56:32.579137 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.579090    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="988f1952-dbce-4f77-8188-bcc9c00563af" containerName="pull"
Jul 23 15:56:32.579137 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.579104    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="988f1952-dbce-4f77-8188-bcc9c00563af" containerName="extract"
Jul 23 15:56:32.579137 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.579109    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="988f1952-dbce-4f77-8188-bcc9c00563af" containerName="extract"
Jul 23 15:56:32.579137 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.579117    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="988f1952-dbce-4f77-8188-bcc9c00563af" containerName="util"
Jul 23 15:56:32.579137 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.579122    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="988f1952-dbce-4f77-8188-bcc9c00563af" containerName="util"
Jul 23 15:56:32.579322 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.579175    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="988f1952-dbce-4f77-8188-bcc9c00563af" containerName="extract"
Jul 23 15:56:32.583505 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.583482    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.587074 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.587053    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 23 15:56:32.587206 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.587078    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 23 15:56:32.587699 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.587675    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 23 15:56:32.587800 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.587700    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 23 15:56:32.587878 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.587857    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vh7z7\""
Jul 23 15:56:32.669672 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.669635    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"]
Jul 23 15:56:32.697869 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.697828    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8abf694b-0dbb-472f-98ca-83e8a903abd7-tmp\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.698066 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.697873    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8abf694b-0dbb-472f-98ca-83e8a903abd7-webhook-cert\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.698066 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.697945    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8abf694b-0dbb-472f-98ca-83e8a903abd7-manifests\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.698066 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.697975    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8abf694b-0dbb-472f-98ca-83e8a903abd7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.698066 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.698055    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr27s\" (UniqueName: \"kubernetes.io/projected/8abf694b-0dbb-472f-98ca-83e8a903abd7-kube-api-access-lr27s\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.798629 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.798528    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8abf694b-0dbb-472f-98ca-83e8a903abd7-tmp\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.798629 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.798577    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8abf694b-0dbb-472f-98ca-83e8a903abd7-webhook-cert\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.798629 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.798620    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8abf694b-0dbb-472f-98ca-83e8a903abd7-manifests\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.798876 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.798641    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8abf694b-0dbb-472f-98ca-83e8a903abd7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.798876 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.798688    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr27s\" (UniqueName: \"kubernetes.io/projected/8abf694b-0dbb-472f-98ca-83e8a903abd7-kube-api-access-lr27s\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.799049 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.798999    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8abf694b-0dbb-472f-98ca-83e8a903abd7-manifests\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.800795 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.800775    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8abf694b-0dbb-472f-98ca-83e8a903abd7-tmp\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.801043 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.800994    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8abf694b-0dbb-472f-98ca-83e8a903abd7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.801117 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.801063    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8abf694b-0dbb-472f-98ca-83e8a903abd7-webhook-cert\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.807933 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.807907    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr27s\" (UniqueName: \"kubernetes.io/projected/8abf694b-0dbb-472f-98ca-83e8a903abd7-kube-api-access-lr27s\") pod \"opendatahub-operator-controller-manager-575b84b7c9-l4qgs\" (UID: \"8abf694b-0dbb-472f-98ca-83e8a903abd7\") " pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.839089 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.839057    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:32.894191 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.894157    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:32.939656 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:32.939619    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:33.036804 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:33.036779    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"]
Jul 23 15:56:33.038423 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:56:33.038396    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8abf694b_0dbb_472f_98ca_83e8a903abd7.slice/crio-8eacb3b73eddcf6bab27e617474ae37c7258cbecf508e691dacf60f9b9139110 WatchSource:0}: Error finding container 8eacb3b73eddcf6bab27e617474ae37c7258cbecf508e691dacf60f9b9139110: Status 404 returned error can't find the container with id 8eacb3b73eddcf6bab27e617474ae37c7258cbecf508e691dacf60f9b9139110
Jul 23 15:56:33.042226 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:33.042193    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:33.117689 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:33.117608    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:33.282165 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:33.282125    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs" event={"ID":"8abf694b-0dbb-472f-98ca-83e8a903abd7","Type":"ContainerStarted","Data":"8eacb3b73eddcf6bab27e617474ae37c7258cbecf508e691dacf60f9b9139110"}
Jul 23 15:56:33.923715 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:33.923677    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:36.300182 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:36.300136    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs" event={"ID":"8abf694b-0dbb-472f-98ca-83e8a903abd7","Type":"ContainerStarted","Data":"c2ea9ca7925476e3541e7ee63a660c05f052cc41ccae725f769fc480238e503e"}
Jul 23 15:56:37.306229 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:37.306140    2570 generic.go:356] "Generic (PLEG): container finished" podID="8abf694b-0dbb-472f-98ca-83e8a903abd7" containerID="c2ea9ca7925476e3541e7ee63a660c05f052cc41ccae725f769fc480238e503e" exitCode=0
Jul 23 15:56:37.306229 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:37.306181    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs" event={"ID":"8abf694b-0dbb-472f-98ca-83e8a903abd7","Type":"ContainerDied","Data":"c2ea9ca7925476e3541e7ee63a660c05f052cc41ccae725f769fc480238e503e"}
Jul 23 15:56:38.312725 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:38.312691    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs" event={"ID":"8abf694b-0dbb-472f-98ca-83e8a903abd7","Type":"ContainerStarted","Data":"cb72738a2d411f626d1ddb25ab225c861068ebd7d254c13c3aee660430833392"}
Jul 23 15:56:38.313130 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:38.312816    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:38.346138 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:38.346077    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs" podStartSLOduration=1.975962581 podStartE2EDuration="6.346056779s" totalImagesPullingTime="3.281936918s" totalInitContainerRuntime="1.08815728s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:56:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:56:38.34453913 +0000 UTC m=+384.268393764" watchObservedRunningTime="2026-07-23 15:56:38.346056779 +0000 UTC m=+384.269911414"
Jul 23 15:56:44.097414 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:44.097380    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:44.242289 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:44.242257    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:44.492723 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:44.492687    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:44.657303 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:44.657268    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:44.890692 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:44.890606    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:49.320157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:49.320120    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-575b84b7c9-l4qgs"
Jul 23 15:56:54.906231 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:54.906194    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:55.931287 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:55.931245    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:55.983944 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:55.983911    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"]
Jul 23 15:56:55.992751 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:55.992720    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"
Jul 23 15:56:55.998953 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:55.998923    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 23 15:56:55.999144 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:55.998935    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 23 15:56:55.999144 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:55.999005    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 23 15:56:55.999795 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:55.999769    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 23 15:56:56.015379 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.015341    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"]
Jul 23 15:56:56.099904 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.099867    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f07ea543-3a22-49ee-bbb7-28d45896c8bf-tmp\") pod \"kube-auth-proxy-7c56c994b9-rrkgh\" (UID: \"f07ea543-3a22-49ee-bbb7-28d45896c8bf\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"
Jul 23 15:56:56.100151 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.099926    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2d87\" (UniqueName: \"kubernetes.io/projected/f07ea543-3a22-49ee-bbb7-28d45896c8bf-kube-api-access-x2d87\") pod \"kube-auth-proxy-7c56c994b9-rrkgh\" (UID: \"f07ea543-3a22-49ee-bbb7-28d45896c8bf\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"
Jul 23 15:56:56.100151 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.100065    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07ea543-3a22-49ee-bbb7-28d45896c8bf-tls-certs\") pod \"kube-auth-proxy-7c56c994b9-rrkgh\" (UID: \"f07ea543-3a22-49ee-bbb7-28d45896c8bf\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"
Jul 23 15:56:56.201589 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.201478    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f07ea543-3a22-49ee-bbb7-28d45896c8bf-tmp\") pod \"kube-auth-proxy-7c56c994b9-rrkgh\" (UID: \"f07ea543-3a22-49ee-bbb7-28d45896c8bf\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"
Jul 23 15:56:56.201589 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.201542    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2d87\" (UniqueName: \"kubernetes.io/projected/f07ea543-3a22-49ee-bbb7-28d45896c8bf-kube-api-access-x2d87\") pod \"kube-auth-proxy-7c56c994b9-rrkgh\" (UID: \"f07ea543-3a22-49ee-bbb7-28d45896c8bf\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"
Jul 23 15:56:56.201828 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.201598    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07ea543-3a22-49ee-bbb7-28d45896c8bf-tls-certs\") pod \"kube-auth-proxy-7c56c994b9-rrkgh\" (UID: \"f07ea543-3a22-49ee-bbb7-28d45896c8bf\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"
Jul 23 15:56:56.201828 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:56:56.201736    2570 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 23 15:56:56.201828 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:56:56.201809    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f07ea543-3a22-49ee-bbb7-28d45896c8bf-tls-certs podName:f07ea543-3a22-49ee-bbb7-28d45896c8bf nodeName:}" failed. No retries permitted until 2026-07-23 15:56:56.701787242 +0000 UTC m=+402.625641853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f07ea543-3a22-49ee-bbb7-28d45896c8bf-tls-certs") pod "kube-auth-proxy-7c56c994b9-rrkgh" (UID: "f07ea543-3a22-49ee-bbb7-28d45896c8bf") : secret "kube-auth-proxy-tls" not found
Jul 23 15:56:56.203777 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.203751    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f07ea543-3a22-49ee-bbb7-28d45896c8bf-tmp\") pod \"kube-auth-proxy-7c56c994b9-rrkgh\" (UID: \"f07ea543-3a22-49ee-bbb7-28d45896c8bf\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"
Jul 23 15:56:56.226814 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.226780    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:56.235977 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.235930    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2d87\" (UniqueName: \"kubernetes.io/projected/f07ea543-3a22-49ee-bbb7-28d45896c8bf-kube-api-access-x2d87\") pod \"kube-auth-proxy-7c56c994b9-rrkgh\" (UID: \"f07ea543-3a22-49ee-bbb7-28d45896c8bf\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"
Jul 23 15:56:56.321744 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.321712    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2dj4p"]
Jul 23 15:56:56.325149 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.325132    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p"
Jul 23 15:56:56.329802 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.329776    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 23 15:56:56.330003 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.329985    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-6zd4k\""
Jul 23 15:56:56.359997 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.359958    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2dj4p"]
Jul 23 15:56:56.490250 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.490214    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:56.504394 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.504362    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6c02851-a121-4661-898e-cc71ec4dc208-cert\") pod \"odh-model-controller-7998c67dc4-2dj4p\" (UID: \"e6c02851-a121-4661-898e-cc71ec4dc208\") " pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p"
Jul 23 15:56:56.504573 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.504501    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvfrs\" (UniqueName: \"kubernetes.io/projected/e6c02851-a121-4661-898e-cc71ec4dc208-kube-api-access-gvfrs\") pod \"odh-model-controller-7998c67dc4-2dj4p\" (UID: \"e6c02851-a121-4661-898e-cc71ec4dc208\") " pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p"
Jul 23 15:56:56.604929 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.604898    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvfrs\" (UniqueName: \"kubernetes.io/projected/e6c02851-a121-4661-898e-cc71ec4dc208-kube-api-access-gvfrs\") pod \"odh-model-controller-7998c67dc4-2dj4p\" (UID: \"e6c02851-a121-4661-898e-cc71ec4dc208\") " pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p"
Jul 23 15:56:56.605138 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.604945    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6c02851-a121-4661-898e-cc71ec4dc208-cert\") pod \"odh-model-controller-7998c67dc4-2dj4p\" (UID: \"e6c02851-a121-4661-898e-cc71ec4dc208\") " pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p"
Jul 23 15:56:56.605138 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:56:56.605064    2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 23 15:56:56.605138 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:56:56.605118    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6c02851-a121-4661-898e-cc71ec4dc208-cert podName:e6c02851-a121-4661-898e-cc71ec4dc208 nodeName:}" failed. No retries permitted until 2026-07-23 15:56:57.105102902 +0000 UTC m=+403.028957513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/e6c02851-a121-4661-898e-cc71ec4dc208-cert") pod "odh-model-controller-7998c67dc4-2dj4p" (UID: "e6c02851-a121-4661-898e-cc71ec4dc208") : secret "odh-model-controller-webhook-cert" not found
Jul 23 15:56:56.643520 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.643484    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvfrs\" (UniqueName: \"kubernetes.io/projected/e6c02851-a121-4661-898e-cc71ec4dc208-kube-api-access-gvfrs\") pod \"odh-model-controller-7998c67dc4-2dj4p\" (UID: \"e6c02851-a121-4661-898e-cc71ec4dc208\") " pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p"
Jul 23 15:56:56.666889 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.666850    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:56.705651 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.705609    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07ea543-3a22-49ee-bbb7-28d45896c8bf-tls-certs\") pod \"kube-auth-proxy-7c56c994b9-rrkgh\" (UID: \"f07ea543-3a22-49ee-bbb7-28d45896c8bf\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"
Jul 23 15:56:56.708228 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.708200    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f07ea543-3a22-49ee-bbb7-28d45896c8bf-tls-certs\") pod \"kube-auth-proxy-7c56c994b9-rrkgh\" (UID: \"f07ea543-3a22-49ee-bbb7-28d45896c8bf\") " pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"
Jul 23 15:56:56.904304 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:56.904210    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"
Jul 23 15:56:57.077267 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:57.077208    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:57.091468 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:57.091309    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh"]
Jul 23 15:56:57.094415 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:56:57.094384    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf07ea543_3a22_49ee_bbb7_28d45896c8bf.slice/crio-8677e7990d530fedbc7460fe952a5bd24852622934221917168908bbc71e8771 WatchSource:0}: Error finding container 8677e7990d530fedbc7460fe952a5bd24852622934221917168908bbc71e8771: Status 404 returned error can't find the container with id 8677e7990d530fedbc7460fe952a5bd24852622934221917168908bbc71e8771
Jul 23 15:56:57.109077 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:57.109044    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6c02851-a121-4661-898e-cc71ec4dc208-cert\") pod \"odh-model-controller-7998c67dc4-2dj4p\" (UID: \"e6c02851-a121-4661-898e-cc71ec4dc208\") " pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p"
Jul 23 15:56:57.111724 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:57.111698    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e6c02851-a121-4661-898e-cc71ec4dc208-cert\") pod \"odh-model-controller-7998c67dc4-2dj4p\" (UID: \"e6c02851-a121-4661-898e-cc71ec4dc208\") " pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p"
Jul 23 15:56:57.236681 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:57.236636    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p"
Jul 23 15:56:57.403565 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:57.403530    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh" event={"ID":"f07ea543-3a22-49ee-bbb7-28d45896c8bf","Type":"ContainerStarted","Data":"8677e7990d530fedbc7460fe952a5bd24852622934221917168908bbc71e8771"}
Jul 23 15:56:57.436893 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:57.436867    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2dj4p"]
Jul 23 15:56:57.439003 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:56:57.438971    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6c02851_a121_4661_898e_cc71ec4dc208.slice/crio-a096c9b5918b0c24c58bf14d21f827afc3f45473e99fce5483de53ce79b41799 WatchSource:0}: Error finding container a096c9b5918b0c24c58bf14d21f827afc3f45473e99fce5483de53ce79b41799: Status 404 returned error can't find the container with id a096c9b5918b0c24c58bf14d21f827afc3f45473e99fce5483de53ce79b41799
Jul 23 15:56:58.412207 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:58.412003    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p" event={"ID":"e6c02851-a121-4661-898e-cc71ec4dc208","Type":"ContainerStarted","Data":"a096c9b5918b0c24c58bf14d21f827afc3f45473e99fce5483de53ce79b41799"}
Jul 23 15:56:58.548956 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:58.548922    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:56:59.695901 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:56:59.695816    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:00.422505 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:00.422467    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh" event={"ID":"f07ea543-3a22-49ee-bbb7-28d45896c8bf","Type":"ContainerStarted","Data":"8241b2c918de21fc7567d7b198ecca69337c8ffe93037d4fea35a05591971c15"}
Jul 23 15:57:01.200519 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.200452    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c56c994b9-rrkgh" podStartSLOduration=3.862898791 podStartE2EDuration="6.200431618s" totalImagesPullingTime="2.337532827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:57:00.460231639 +0000 UTC m=+406.384086275" watchObservedRunningTime="2026-07-23 15:57:01.200431618 +0000 UTC m=+407.124286305"
Jul 23 15:57:01.201503 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.201478    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"]
Jul 23 15:57:01.205084 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.205065    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.221285 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.221258    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 23 15:57:01.227065 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.227025    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 23 15:57:01.227065 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.227049    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 23 15:57:01.227308 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.227053    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 23 15:57:01.227308 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.227024    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-wfd9k\""
Jul 23 15:57:01.234458 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.234406    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:01.245775 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.245731    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"]
Jul 23 15:57:01.350023 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.349916    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-token\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.350023 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.349986    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e63c37c-155b-49d3-8d01-d5aefce695ef-local-certs\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.350347 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.350035    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.350347 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.350056    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-cacerts\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.350347 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.350085    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlwnd\" (UniqueName: \"kubernetes.io/projected/1e63c37c-155b-49d3-8d01-d5aefce695ef-kube-api-access-tlwnd\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.350347 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.350114    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.350347 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.350231    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.428931 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.428889    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p" event={"ID":"e6c02851-a121-4661-898e-cc71ec4dc208","Type":"ContainerStarted","Data":"687a607929e6c07aae1b3ba4a22e5cb030d0ff9fd7dfce242a68d69f7daec7b2"}
Jul 23 15:57:01.450820 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.450780    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.450820 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.450823    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-token\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.451154 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.450858    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e63c37c-155b-49d3-8d01-d5aefce695ef-local-certs\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.451154 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.450884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.451154 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.450910    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-cacerts\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.451154 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.450940    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlwnd\" (UniqueName: \"kubernetes.io/projected/1e63c37c-155b-49d3-8d01-d5aefce695ef-kube-api-access-tlwnd\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.451154 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.450983    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.451599 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.451547    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.453639 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.453603    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e63c37c-155b-49d3-8d01-d5aefce695ef-local-certs\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.453959 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.453936    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.454043 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.453936    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-cacerts\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.454642 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.454621    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.493138 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.493097    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:01.493323 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.493240    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p" podStartSLOduration=1.886483955 podStartE2EDuration="5.493223684s" totalImagesPullingTime="3.606739729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:57:01.49318368 +0000 UTC m=+407.417038317" watchObservedRunningTime="2026-07-23 15:57:01.493223684 +0000 UTC m=+407.417078320"
Jul 23 15:57:01.495532 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.495506    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-token\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.495760 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.495741    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlwnd\" (UniqueName: \"kubernetes.io/projected/1e63c37c-155b-49d3-8d01-d5aefce695ef-kube-api-access-tlwnd\") pod \"istiod-openshift-gateway-7574459656-g2cpj\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.514516 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.514478    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:01.684352 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:01.684313    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"]
Jul 23 15:57:01.684761 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:57:01.684737    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e63c37c_155b_49d3_8d01_d5aefce695ef.slice/crio-c96bad801a370d8b2922dff662d4c7157918586545137b72761239f348e9f69f WatchSource:0}: Error finding container c96bad801a370d8b2922dff662d4c7157918586545137b72761239f348e9f69f: Status 404 returned error can't find the container with id c96bad801a370d8b2922dff662d4c7157918586545137b72761239f348e9f69f
Jul 23 15:57:02.438292 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:02.438232    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj" event={"ID":"1e63c37c-155b-49d3-8d01-d5aefce695ef","Type":"ContainerStarted","Data":"c96bad801a370d8b2922dff662d4c7157918586545137b72761239f348e9f69f"}
Jul 23 15:57:02.438731 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:02.438444    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p"
Jul 23 15:57:04.299094 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:04.299049    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 15:57:04.299345 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:04.299127    2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 23 15:57:04.449110 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:04.449079    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj" event={"ID":"1e63c37c-155b-49d3-8d01-d5aefce695ef","Type":"ContainerStarted","Data":"035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1"}
Jul 23 15:57:04.449264 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:04.449227    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:04.541489 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:04.541422    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj" podStartSLOduration=0.929583947 podStartE2EDuration="3.541397579s" totalImagesPullingTime="2.611813632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:57:04.537855332 +0000 UTC m=+410.461709969" watchObservedRunningTime="2026-07-23 15:57:04.541397579 +0000 UTC m=+410.465252213"
Jul 23 15:57:05.023152 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:05.023116    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:05.457284 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:05.457187    2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-g2cpj container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 23 15:57:05.457284 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:05.457272    2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj" podUID="1e63c37c-155b-49d3-8d01-d5aefce695ef" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 23 15:57:05.593843 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:05.593788    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:05.837980 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:05.837946    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:08.169051 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:08.168998    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:08.456211 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:08.456134    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:08.457045 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:08.457005    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:08.649005 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:08.648965    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:13.446544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:13.446517    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2dj4p"
Jul 23 15:57:14.595985 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.595953    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:14.818279 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.818244    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"]
Jul 23 15:57:14.826909 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.826879    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-h6src"]
Jul 23 15:57:14.827084 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.827005    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"
Jul 23 15:57:14.829923 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.829900    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src"
Jul 23 15:57:14.841302 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.841280    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xw6jw\""
Jul 23 15:57:14.852075 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.851981    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 23 15:57:14.852075 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.852049    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ldb5r\""
Jul 23 15:57:14.852421 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.852405    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 23 15:57:14.854772 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.854748    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acd18520-f84a-4688-ae38-84f41f6dc943-cert\") pod \"kserve-controller-manager-d6f4b65b8-h6src\" (UID: \"acd18520-f84a-4688-ae38-84f41f6dc943\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src"
Jul 23 15:57:14.854898 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.854830    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d8c0155-0220-40da-a24b-ce28c368c185-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5pb78\" (UID: \"2d8c0155-0220-40da-a24b-ce28c368c185\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"
Jul 23 15:57:14.854898 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.854884    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gppn\" (UniqueName: \"kubernetes.io/projected/acd18520-f84a-4688-ae38-84f41f6dc943-kube-api-access-9gppn\") pod \"kserve-controller-manager-d6f4b65b8-h6src\" (UID: \"acd18520-f84a-4688-ae38-84f41f6dc943\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src"
Jul 23 15:57:14.855039 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.854926    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mg2m\" (UniqueName: \"kubernetes.io/projected/2d8c0155-0220-40da-a24b-ce28c368c185-kube-api-access-4mg2m\") pod \"llmisvc-controller-manager-777c6bd7d5-5pb78\" (UID: \"2d8c0155-0220-40da-a24b-ce28c368c185\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"
Jul 23 15:57:14.874555 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.874524    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"]
Jul 23 15:57:14.897175 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.897144    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:14.939689 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.939653    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-h6src"]
Jul 23 15:57:14.955493 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.955462    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d8c0155-0220-40da-a24b-ce28c368c185-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5pb78\" (UID: \"2d8c0155-0220-40da-a24b-ce28c368c185\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"
Jul 23 15:57:14.955662 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.955504    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gppn\" (UniqueName: \"kubernetes.io/projected/acd18520-f84a-4688-ae38-84f41f6dc943-kube-api-access-9gppn\") pod \"kserve-controller-manager-d6f4b65b8-h6src\" (UID: \"acd18520-f84a-4688-ae38-84f41f6dc943\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src"
Jul 23 15:57:14.955662 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.955537    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mg2m\" (UniqueName: \"kubernetes.io/projected/2d8c0155-0220-40da-a24b-ce28c368c185-kube-api-access-4mg2m\") pod \"llmisvc-controller-manager-777c6bd7d5-5pb78\" (UID: \"2d8c0155-0220-40da-a24b-ce28c368c185\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"
Jul 23 15:57:14.955662 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.955583    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acd18520-f84a-4688-ae38-84f41f6dc943-cert\") pod \"kserve-controller-manager-d6f4b65b8-h6src\" (UID: \"acd18520-f84a-4688-ae38-84f41f6dc943\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src"
Jul 23 15:57:14.955662 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:57:14.955643    2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 23 15:57:14.955840 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:57:14.955750    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d8c0155-0220-40da-a24b-ce28c368c185-cert podName:2d8c0155-0220-40da-a24b-ce28c368c185 nodeName:}" failed. No retries permitted until 2026-07-23 15:57:15.455727005 +0000 UTC m=+421.379581634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2d8c0155-0220-40da-a24b-ce28c368c185-cert") pod "llmisvc-controller-manager-777c6bd7d5-5pb78" (UID: "2d8c0155-0220-40da-a24b-ce28c368c185") : secret "llmisvc-webhook-server-cert" not found
Jul 23 15:57:14.958171 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:14.958149    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acd18520-f84a-4688-ae38-84f41f6dc943-cert\") pod \"kserve-controller-manager-d6f4b65b8-h6src\" (UID: \"acd18520-f84a-4688-ae38-84f41f6dc943\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src"
Jul 23 15:57:15.015659 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.015632    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mg2m\" (UniqueName: \"kubernetes.io/projected/2d8c0155-0220-40da-a24b-ce28c368c185-kube-api-access-4mg2m\") pod \"llmisvc-controller-manager-777c6bd7d5-5pb78\" (UID: \"2d8c0155-0220-40da-a24b-ce28c368c185\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"
Jul 23 15:57:15.017134 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.017108    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gppn\" (UniqueName: \"kubernetes.io/projected/acd18520-f84a-4688-ae38-84f41f6dc943-kube-api-access-9gppn\") pod \"kserve-controller-manager-d6f4b65b8-h6src\" (UID: \"acd18520-f84a-4688-ae38-84f41f6dc943\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src"
Jul 23 15:57:15.144243 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.144146    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src"
Jul 23 15:57:15.217115 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.217084    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:15.356771 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.356746    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-h6src"]
Jul 23 15:57:15.359439 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:57:15.359412    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacd18520_f84a_4688_ae38_84f41f6dc943.slice/crio-660226c75ccfbcb70ac848061ffb268126b5df6221d47d23bc31aeb1db5ff6d7 WatchSource:0}: Error finding container 660226c75ccfbcb70ac848061ffb268126b5df6221d47d23bc31aeb1db5ff6d7: Status 404 returned error can't find the container with id 660226c75ccfbcb70ac848061ffb268126b5df6221d47d23bc31aeb1db5ff6d7
Jul 23 15:57:15.460081 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.459951    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d8c0155-0220-40da-a24b-ce28c368c185-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5pb78\" (UID: \"2d8c0155-0220-40da-a24b-ce28c368c185\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"
Jul 23 15:57:15.462416 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.462397    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d8c0155-0220-40da-a24b-ce28c368c185-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-5pb78\" (UID: \"2d8c0155-0220-40da-a24b-ce28c368c185\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"
Jul 23 15:57:15.499450 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.499420    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src" event={"ID":"acd18520-f84a-4688-ae38-84f41f6dc943","Type":"ContainerStarted","Data":"660226c75ccfbcb70ac848061ffb268126b5df6221d47d23bc31aeb1db5ff6d7"}
Jul 23 15:57:15.536653 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.536614    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"]
Jul 23 15:57:15.536849 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.536820    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj" podUID="1e63c37c-155b-49d3-8d01-d5aefce695ef" containerName="discovery" containerID="cri-o://035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1" gracePeriod=30
Jul 23 15:57:15.593229 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.593190    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:15.738413 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.738382    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"
Jul 23 15:57:15.779119 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.779091    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:15.862640 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.862610    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-cacerts\") pod \"1e63c37c-155b-49d3-8d01-d5aefce695ef\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") "
Jul 23 15:57:15.862808 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.862645    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-kubeconfig\") pod \"1e63c37c-155b-49d3-8d01-d5aefce695ef\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") "
Jul 23 15:57:15.862808 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.862681    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e63c37c-155b-49d3-8d01-d5aefce695ef-local-certs\") pod \"1e63c37c-155b-49d3-8d01-d5aefce695ef\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") "
Jul 23 15:57:15.862808 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.862706    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-csr-dns-cert\") pod \"1e63c37c-155b-49d3-8d01-d5aefce695ef\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") "
Jul 23 15:57:15.862808 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.862749    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-csr-ca-configmap\") pod \"1e63c37c-155b-49d3-8d01-d5aefce695ef\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") "
Jul 23 15:57:15.862808 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.862787    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-token\") pod \"1e63c37c-155b-49d3-8d01-d5aefce695ef\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") "
Jul 23 15:57:15.863078 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.862903    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlwnd\" (UniqueName: \"kubernetes.io/projected/1e63c37c-155b-49d3-8d01-d5aefce695ef-kube-api-access-tlwnd\") pod \"1e63c37c-155b-49d3-8d01-d5aefce695ef\" (UID: \"1e63c37c-155b-49d3-8d01-d5aefce695ef\") "
Jul 23 15:57:15.863231 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.863199    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1e63c37c-155b-49d3-8d01-d5aefce695ef" (UID: "1e63c37c-155b-49d3-8d01-d5aefce695ef"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:57:15.864979 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.864951    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-cacerts" (OuterVolumeSpecName: "cacerts") pod "1e63c37c-155b-49d3-8d01-d5aefce695ef" (UID: "1e63c37c-155b-49d3-8d01-d5aefce695ef"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:57:15.865264 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.865098    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e63c37c-155b-49d3-8d01-d5aefce695ef-kube-api-access-tlwnd" (OuterVolumeSpecName: "kube-api-access-tlwnd") pod "1e63c37c-155b-49d3-8d01-d5aefce695ef" (UID: "1e63c37c-155b-49d3-8d01-d5aefce695ef"). InnerVolumeSpecName "kube-api-access-tlwnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:57:15.865362 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.865340    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e63c37c-155b-49d3-8d01-d5aefce695ef-local-certs" (OuterVolumeSpecName: "local-certs") pod "1e63c37c-155b-49d3-8d01-d5aefce695ef" (UID: "1e63c37c-155b-49d3-8d01-d5aefce695ef"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:57:15.865414 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.865342    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e63c37c-155b-49d3-8d01-d5aefce695ef" (UID: "1e63c37c-155b-49d3-8d01-d5aefce695ef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:57:15.865414 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.865381    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1e63c37c-155b-49d3-8d01-d5aefce695ef" (UID: "1e63c37c-155b-49d3-8d01-d5aefce695ef"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:57:15.865479 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.865458    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1e63c37c-155b-49d3-8d01-d5aefce695ef" (UID: "1e63c37c-155b-49d3-8d01-d5aefce695ef"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 15:57:15.951141 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.951111    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"]
Jul 23 15:57:15.958435 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:57:15.958408    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2d8c0155_0220_40da_a24b_ce28c368c185.slice/crio-5d5657920e22b133fd86fca283ed1ecf39793b007f1d01fcb05da13af571c333 WatchSource:0}: Error finding container 5d5657920e22b133fd86fca283ed1ecf39793b007f1d01fcb05da13af571c333: Status 404 returned error can't find the container with id 5d5657920e22b133fd86fca283ed1ecf39793b007f1d01fcb05da13af571c333
Jul 23 15:57:15.963701 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.963674    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlwnd\" (UniqueName: \"kubernetes.io/projected/1e63c37c-155b-49d3-8d01-d5aefce695ef-kube-api-access-tlwnd\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:57:15.963701 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.963699    2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-cacerts\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:57:15.963835 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.963709    2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-kubeconfig\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:57:15.963835 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.963719    2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e63c37c-155b-49d3-8d01-d5aefce695ef-local-certs\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:57:15.963835 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.963729    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-csr-dns-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:57:15.963835 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.963737    2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-csr-ca-configmap\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:57:15.963835 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:15.963745    2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e63c37c-155b-49d3-8d01-d5aefce695ef-istio-token\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:57:16.294459 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.294423    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:16.493504 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.493452    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:16.507209 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.507175    2570 generic.go:356] "Generic (PLEG): container finished" podID="1e63c37c-155b-49d3-8d01-d5aefce695ef" containerID="035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1" exitCode=0
Jul 23 15:57:16.507209 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.507219    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"
Jul 23 15:57:16.507441 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.507256    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj" event={"ID":"1e63c37c-155b-49d3-8d01-d5aefce695ef","Type":"ContainerDied","Data":"035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1"}
Jul 23 15:57:16.507441 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.507316    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj" event={"ID":"1e63c37c-155b-49d3-8d01-d5aefce695ef","Type":"ContainerDied","Data":"c96bad801a370d8b2922dff662d4c7157918586545137b72761239f348e9f69f"}
Jul 23 15:57:16.507441 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.507345    2570 scope.go:117] "RemoveContainer" containerID="035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1"
Jul 23 15:57:16.508937 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.508683    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78" event={"ID":"2d8c0155-0220-40da-a24b-ce28c368c185","Type":"ContainerStarted","Data":"5d5657920e22b133fd86fca283ed1ecf39793b007f1d01fcb05da13af571c333"}
Jul 23 15:57:16.517979 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.517960    2570 scope.go:117] "RemoveContainer" containerID="035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1"
Jul 23 15:57:16.518303 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:57:16.518279    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1\": container with ID starting with 035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1 not found: ID does not exist" containerID="035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1"
Jul 23 15:57:16.518387 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.518314    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1"} err="failed to get container status \"035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1\": rpc error: code = NotFound desc = could not find container \"035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1\": container with ID starting with 035e7a69367d78ac6f71ea3a045f0990453f889e67606915909beac8d990dcc1 not found: ID does not exist"
Jul 23 15:57:16.542751 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.542720    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"]
Jul 23 15:57:16.548217 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.548138    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-g2cpj"]
Jul 23 15:57:16.605711 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:16.605673    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e63c37c-155b-49d3-8d01-d5aefce695ef" path="/var/lib/kubelet/pods/1e63c37c-155b-49d3-8d01-d5aefce695ef/volumes"
Jul 23 15:57:18.524904 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:18.524836    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src" event={"ID":"acd18520-f84a-4688-ae38-84f41f6dc943","Type":"ContainerStarted","Data":"dd4342be9076fc6af3b279741aee0baa9804287a484e77e212c2eb7f315e82ac"}
Jul 23 15:57:18.525405 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:18.525028    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src"
Jul 23 15:57:19.531489 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:19.531450    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78" event={"ID":"2d8c0155-0220-40da-a24b-ce28c368c185","Type":"ContainerStarted","Data":"3e2aa41315a6873bd8dade5a45b5fef2603fc3a167635f81db95ee2148fb4a60"}
Jul 23 15:57:19.531897 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:19.531617    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"
Jul 23 15:57:19.635443 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:19.635386    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src" podStartSLOduration=3.081612601 podStartE2EDuration="5.635366513s" totalImagesPullingTime="2.553753912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:57:18.569893111 +0000 UTC m=+424.493747747" watchObservedRunningTime="2026-07-23 15:57:19.635366513 +0000 UTC m=+425.559221146"
Jul 23 15:57:19.636893 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:19.636857    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78" podStartSLOduration=2.918230302 podStartE2EDuration="5.636846935s" totalImagesPullingTime="2.718616633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:57:19.626084652 +0000 UTC m=+425.549939285" watchObservedRunningTime="2026-07-23 15:57:19.636846935 +0000 UTC m=+425.560701568"
Jul 23 15:57:49.537372 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:49.537338    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-h6src"
Jul 23 15:57:50.538987 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:50.538951    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-5pb78"
Jul 23 15:57:56.811741 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:56.811703    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgvvt"]
Jul 23 15:57:56.812218 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:56.812077    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e63c37c-155b-49d3-8d01-d5aefce695ef" containerName="discovery"
Jul 23 15:57:56.812218 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:56.812088    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e63c37c-155b-49d3-8d01-d5aefce695ef" containerName="discovery"
Jul 23 15:57:56.812218 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:56.812164    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e63c37c-155b-49d3-8d01-d5aefce695ef" containerName="discovery"
Jul 23 15:57:56.819781 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:56.819755    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jgvvt"
Jul 23 15:57:56.822546 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:56.822522    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 23 15:57:56.823558 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:56.823529    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 23 15:57:56.823676 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:56.823559    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6zdt4\""
Jul 23 15:57:56.831238 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:56.831212    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgvvt"]
Jul 23 15:57:56.928156 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:56.928123    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl46g\" (UniqueName: \"kubernetes.io/projected/7a5d2600-0327-452b-9910-83b1a599eef4-kube-api-access-xl46g\") pod \"kuadrant-operator-catalog-jgvvt\" (UID: \"7a5d2600-0327-452b-9910-83b1a599eef4\") " pod="kuadrant-system/kuadrant-operator-catalog-jgvvt"
Jul 23 15:57:57.029629 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.029594    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl46g\" (UniqueName: \"kubernetes.io/projected/7a5d2600-0327-452b-9910-83b1a599eef4-kube-api-access-xl46g\") pod \"kuadrant-operator-catalog-jgvvt\" (UID: \"7a5d2600-0327-452b-9910-83b1a599eef4\") " pod="kuadrant-system/kuadrant-operator-catalog-jgvvt"
Jul 23 15:57:57.038118 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.038086    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl46g\" (UniqueName: \"kubernetes.io/projected/7a5d2600-0327-452b-9910-83b1a599eef4-kube-api-access-xl46g\") pod \"kuadrant-operator-catalog-jgvvt\" (UID: \"7a5d2600-0327-452b-9910-83b1a599eef4\") " pod="kuadrant-system/kuadrant-operator-catalog-jgvvt"
Jul 23 15:57:57.132267 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.132182    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jgvvt"
Jul 23 15:57:57.188638 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.188604    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgvvt"]
Jul 23 15:57:57.280993 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.280965    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgvvt"]
Jul 23 15:57:57.282994 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:57:57.282958    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5d2600_0327_452b_9910_83b1a599eef4.slice/crio-d46b640d042ca19830756b92fe77a00a8f47a9dc0d4d48481c8deb2f945d885b WatchSource:0}: Error finding container d46b640d042ca19830756b92fe77a00a8f47a9dc0d4d48481c8deb2f945d885b: Status 404 returned error can't find the container with id d46b640d042ca19830756b92fe77a00a8f47a9dc0d4d48481c8deb2f945d885b
Jul 23 15:57:57.396408 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.396324    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lkkgl"]
Jul 23 15:57:57.399269 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.399252    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lkkgl"
Jul 23 15:57:57.409783 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.409757    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lkkgl"]
Jul 23 15:57:57.534759 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.534705    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5cq8\" (UniqueName: \"kubernetes.io/projected/ba85d7cc-d09f-4070-88c9-9b022b66a3b1-kube-api-access-v5cq8\") pod \"kuadrant-operator-catalog-lkkgl\" (UID: \"ba85d7cc-d09f-4070-88c9-9b022b66a3b1\") " pod="kuadrant-system/kuadrant-operator-catalog-lkkgl"
Jul 23 15:57:57.636243 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.636197    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5cq8\" (UniqueName: \"kubernetes.io/projected/ba85d7cc-d09f-4070-88c9-9b022b66a3b1-kube-api-access-v5cq8\") pod \"kuadrant-operator-catalog-lkkgl\" (UID: \"ba85d7cc-d09f-4070-88c9-9b022b66a3b1\") " pod="kuadrant-system/kuadrant-operator-catalog-lkkgl"
Jul 23 15:57:57.648100 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.648037    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5cq8\" (UniqueName: \"kubernetes.io/projected/ba85d7cc-d09f-4070-88c9-9b022b66a3b1-kube-api-access-v5cq8\") pod \"kuadrant-operator-catalog-lkkgl\" (UID: \"ba85d7cc-d09f-4070-88c9-9b022b66a3b1\") " pod="kuadrant-system/kuadrant-operator-catalog-lkkgl"
Jul 23 15:57:57.650201 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.650175    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:57.710280 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.710243    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lkkgl"
Jul 23 15:57:57.719542 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.719508    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jgvvt" event={"ID":"7a5d2600-0327-452b-9910-83b1a599eef4","Type":"ContainerStarted","Data":"d46b640d042ca19830756b92fe77a00a8f47a9dc0d4d48481c8deb2f945d885b"}
Jul 23 15:57:57.743040 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.742990    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:57:57.895026 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:57.894975    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lkkgl"]
Jul 23 15:57:57.962971 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:57:57.962887    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba85d7cc_d09f_4070_88c9_9b022b66a3b1.slice/crio-a2e8e55e752a217ff6aa47382efc55fdf5f596a163b738c12ab01c78829026e6 WatchSource:0}: Error finding container a2e8e55e752a217ff6aa47382efc55fdf5f596a163b738c12ab01c78829026e6: Status 404 returned error can't find the container with id a2e8e55e752a217ff6aa47382efc55fdf5f596a163b738c12ab01c78829026e6
Jul 23 15:57:58.726635 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:58.726598    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lkkgl" event={"ID":"ba85d7cc-d09f-4070-88c9-9b022b66a3b1","Type":"ContainerStarted","Data":"a2e8e55e752a217ff6aa47382efc55fdf5f596a163b738c12ab01c78829026e6"}
Jul 23 15:57:59.733022 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:59.732961    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lkkgl" event={"ID":"ba85d7cc-d09f-4070-88c9-9b022b66a3b1","Type":"ContainerStarted","Data":"7aab6812ab97881e97b62022fc03b296784f67a4a7d78816f6ad82a562a8ec87"}
Jul 23 15:57:59.734588 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:59.734555    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jgvvt" event={"ID":"7a5d2600-0327-452b-9910-83b1a599eef4","Type":"ContainerStarted","Data":"66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3"}
Jul 23 15:57:59.734709 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:59.734645    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-jgvvt" podUID="7a5d2600-0327-452b-9910-83b1a599eef4" containerName="registry-server" containerID="cri-o://66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3" gracePeriod=2
Jul 23 15:57:59.754228 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:59.754184    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lkkgl" podStartSLOduration=1.42667558 podStartE2EDuration="2.754170214s" totalImagesPullingTime="1.327494634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:57:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:57:59.752543204 +0000 UTC m=+465.676397830" watchObservedRunningTime="2026-07-23 15:57:59.754170214 +0000 UTC m=+465.678024847"
Jul 23 15:57:59.770418 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:59.770371    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-jgvvt" podStartSLOduration=1.766690828 podStartE2EDuration="3.770350281s" totalImagesPullingTime="2.003659453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:57:59.770188776 +0000 UTC m=+465.694043411" watchObservedRunningTime="2026-07-23 15:57:59.770350281 +0000 UTC m=+465.694204915"
Jul 23 15:57:59.984137 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:57:59.984075    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jgvvt"
Jul 23 15:58:00.162415 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:00.162381    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xl46g\" (UniqueName: \"kubernetes.io/projected/7a5d2600-0327-452b-9910-83b1a599eef4-kube-api-access-xl46g\") pod \"7a5d2600-0327-452b-9910-83b1a599eef4\" (UID: \"7a5d2600-0327-452b-9910-83b1a599eef4\") "
Jul 23 15:58:00.164619 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:00.164585    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a5d2600-0327-452b-9910-83b1a599eef4-kube-api-access-xl46g" (OuterVolumeSpecName: "kube-api-access-xl46g") pod "7a5d2600-0327-452b-9910-83b1a599eef4" (UID: "7a5d2600-0327-452b-9910-83b1a599eef4"). InnerVolumeSpecName "kube-api-access-xl46g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:58:00.263991 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:00.263903    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xl46g\" (UniqueName: \"kubernetes.io/projected/7a5d2600-0327-452b-9910-83b1a599eef4-kube-api-access-xl46g\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:00.740975 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:00.740936    2570 generic.go:356] "Generic (PLEG): container finished" podID="7a5d2600-0327-452b-9910-83b1a599eef4" containerID="66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3" exitCode=0
Jul 23 15:58:00.741411 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:00.740975    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jgvvt" event={"ID":"7a5d2600-0327-452b-9910-83b1a599eef4","Type":"ContainerDied","Data":"66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3"}
Jul 23 15:58:00.741411 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:00.741038    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-jgvvt" event={"ID":"7a5d2600-0327-452b-9910-83b1a599eef4","Type":"ContainerDied","Data":"d46b640d042ca19830756b92fe77a00a8f47a9dc0d4d48481c8deb2f945d885b"}
Jul 23 15:58:00.741411 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:00.740983    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-jgvvt"
Jul 23 15:58:00.741411 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:00.741059    2570 scope.go:117] "RemoveContainer" containerID="66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3"
Jul 23 15:58:00.750307 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:00.750291    2570 scope.go:117] "RemoveContainer" containerID="66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3"
Jul 23 15:58:00.750588 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:58:00.750570    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3\": container with ID starting with 66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3 not found: ID does not exist" containerID="66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3"
Jul 23 15:58:00.750629 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:00.750597    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3"} err="failed to get container status \"66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3\": rpc error: code = NotFound desc = could not find container \"66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3\": container with ID starting with 66285b1cdd4ec45bf41273869a16ffe0a98f70eb9abf07f2f7e8a4f2c439dcf3 not found: ID does not exist"
Jul 23 15:58:00.758710 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:00.758685    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgvvt"]
Jul 23 15:58:00.765126 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:00.765102    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-jgvvt"]
Jul 23 15:58:02.602592 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:02.602558    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a5d2600-0327-452b-9910-83b1a599eef4" path="/var/lib/kubelet/pods/7a5d2600-0327-452b-9910-83b1a599eef4/volumes"
Jul 23 15:58:07.711262 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:07.711221    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lkkgl"
Jul 23 15:58:07.711727 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:07.711275    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lkkgl"
Jul 23 15:58:07.733667 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:07.733636    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lkkgl"
Jul 23 15:58:07.799594 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:07.799566    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lkkgl"
Jul 23 15:58:12.229061 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.229026    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"]
Jul 23 15:58:12.229457 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.229367    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a5d2600-0327-452b-9910-83b1a599eef4" containerName="registry-server"
Jul 23 15:58:12.229457 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.229378    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a5d2600-0327-452b-9910-83b1a599eef4" containerName="registry-server"
Jul 23 15:58:12.229457 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.229443    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a5d2600-0327-452b-9910-83b1a599eef4" containerName="registry-server"
Jul 23 15:58:12.231623 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.231604    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:12.234310 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.234291    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7zdfd\""
Jul 23 15:58:12.241461 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.241436    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"]
Jul 23 15:58:12.259062 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.259033    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw8mf\" (UniqueName: \"kubernetes.io/projected/87d529f4-7acb-4f12-8720-045526ac68af-kube-api-access-gw8mf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll\" (UID: \"87d529f4-7acb-4f12-8720-045526ac68af\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:12.259231 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.259093    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d529f4-7acb-4f12-8720-045526ac68af-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll\" (UID: \"87d529f4-7acb-4f12-8720-045526ac68af\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:12.259231 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.259177    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d529f4-7acb-4f12-8720-045526ac68af-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll\" (UID: \"87d529f4-7acb-4f12-8720-045526ac68af\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:12.360034 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.359976    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d529f4-7acb-4f12-8720-045526ac68af-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll\" (UID: \"87d529f4-7acb-4f12-8720-045526ac68af\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:12.360198 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.360071    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d529f4-7acb-4f12-8720-045526ac68af-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll\" (UID: \"87d529f4-7acb-4f12-8720-045526ac68af\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:12.360198 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.360108    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw8mf\" (UniqueName: \"kubernetes.io/projected/87d529f4-7acb-4f12-8720-045526ac68af-kube-api-access-gw8mf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll\" (UID: \"87d529f4-7acb-4f12-8720-045526ac68af\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:12.360393 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.360373    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d529f4-7acb-4f12-8720-045526ac68af-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll\" (UID: \"87d529f4-7acb-4f12-8720-045526ac68af\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:12.360472 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.360449    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d529f4-7acb-4f12-8720-045526ac68af-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll\" (UID: \"87d529f4-7acb-4f12-8720-045526ac68af\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:12.369779 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.369747    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw8mf\" (UniqueName: \"kubernetes.io/projected/87d529f4-7acb-4f12-8720-045526ac68af-kube-api-access-gw8mf\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll\" (UID: \"87d529f4-7acb-4f12-8720-045526ac68af\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:12.541598 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.541506    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:12.627806 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.627773    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"]
Jul 23 15:58:12.631587 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.631564    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:12.649133 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.649100    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"]
Jul 23 15:58:12.662742 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.662711    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4d742ef-2cdb-4eca-81a1-5655fb86b884-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv\" (UID: \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:12.662742 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.662747    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4d742ef-2cdb-4eca-81a1-5655fb86b884-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv\" (UID: \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:12.662973 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.662774    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkhkx\" (UniqueName: \"kubernetes.io/projected/e4d742ef-2cdb-4eca-81a1-5655fb86b884-kube-api-access-pkhkx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv\" (UID: \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:12.677398 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.677374    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:12.683258 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.683235    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"]
Jul 23 15:58:12.685170 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:58:12.685145    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87d529f4_7acb_4f12_8720_045526ac68af.slice/crio-b644f6c3d9da344e41aaefb993a779dadf98199a6eebc5f92505d9aca812a350 WatchSource:0}: Error finding container b644f6c3d9da344e41aaefb993a779dadf98199a6eebc5f92505d9aca812a350: Status 404 returned error can't find the container with id b644f6c3d9da344e41aaefb993a779dadf98199a6eebc5f92505d9aca812a350
Jul 23 15:58:12.763492 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.763458    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4d742ef-2cdb-4eca-81a1-5655fb86b884-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv\" (UID: \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:12.763646 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.763497    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4d742ef-2cdb-4eca-81a1-5655fb86b884-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv\" (UID: \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:12.763646 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.763534    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkhkx\" (UniqueName: \"kubernetes.io/projected/e4d742ef-2cdb-4eca-81a1-5655fb86b884-kube-api-access-pkhkx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv\" (UID: \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:12.763945 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.763914    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4d742ef-2cdb-4eca-81a1-5655fb86b884-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv\" (UID: \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:12.764043 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.763981    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4d742ef-2cdb-4eca-81a1-5655fb86b884-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv\" (UID: \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:12.773563 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.773535    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkhkx\" (UniqueName: \"kubernetes.io/projected/e4d742ef-2cdb-4eca-81a1-5655fb86b884-kube-api-access-pkhkx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv\" (UID: \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:12.807356 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.807320    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll" event={"ID":"87d529f4-7acb-4f12-8720-045526ac68af","Type":"ContainerStarted","Data":"f396917250ea148d9c85821e5cb6b1f8cc1cab0c9cc9e9a36ff0f66a9a5f2b99"}
Jul 23 15:58:12.807488 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.807380    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll" event={"ID":"87d529f4-7acb-4f12-8720-045526ac68af","Type":"ContainerStarted","Data":"b644f6c3d9da344e41aaefb993a779dadf98199a6eebc5f92505d9aca812a350"}
Jul 23 15:58:12.942673 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:12.942634    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:13.056446 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.056351    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"]
Jul 23 15:58:13.060351 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.060327    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:13.066997 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.066795    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/819fb198-6452-4eb2-aa02-ac5b9912e165-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9\" (UID: \"819fb198-6452-4eb2-aa02-ac5b9912e165\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:13.066997 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.066839    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctvdh\" (UniqueName: \"kubernetes.io/projected/819fb198-6452-4eb2-aa02-ac5b9912e165-kube-api-access-ctvdh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9\" (UID: \"819fb198-6452-4eb2-aa02-ac5b9912e165\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:13.067574 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.067545    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/819fb198-6452-4eb2-aa02-ac5b9912e165-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9\" (UID: \"819fb198-6452-4eb2-aa02-ac5b9912e165\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:13.069976 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.069954    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"]
Jul 23 15:58:13.090863 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.090840    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"]
Jul 23 15:58:13.092400 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:58:13.092376    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d742ef_2cdb_4eca_81a1_5655fb86b884.slice/crio-26a685648f3fd0d5883416045c42ace3c7e8fff51cca0f2cd016869384d4ec37 WatchSource:0}: Error finding container 26a685648f3fd0d5883416045c42ace3c7e8fff51cca0f2cd016869384d4ec37: Status 404 returned error can't find the container with id 26a685648f3fd0d5883416045c42ace3c7e8fff51cca0f2cd016869384d4ec37
Jul 23 15:58:13.168363 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.168331    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/819fb198-6452-4eb2-aa02-ac5b9912e165-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9\" (UID: \"819fb198-6452-4eb2-aa02-ac5b9912e165\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:13.168539 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.168379    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/819fb198-6452-4eb2-aa02-ac5b9912e165-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9\" (UID: \"819fb198-6452-4eb2-aa02-ac5b9912e165\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:13.168539 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.168406    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctvdh\" (UniqueName: \"kubernetes.io/projected/819fb198-6452-4eb2-aa02-ac5b9912e165-kube-api-access-ctvdh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9\" (UID: \"819fb198-6452-4eb2-aa02-ac5b9912e165\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:13.168751 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.168724    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/819fb198-6452-4eb2-aa02-ac5b9912e165-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9\" (UID: \"819fb198-6452-4eb2-aa02-ac5b9912e165\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:13.168879 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.168807    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/819fb198-6452-4eb2-aa02-ac5b9912e165-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9\" (UID: \"819fb198-6452-4eb2-aa02-ac5b9912e165\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:13.178525 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.178502    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctvdh\" (UniqueName: \"kubernetes.io/projected/819fb198-6452-4eb2-aa02-ac5b9912e165-kube-api-access-ctvdh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9\" (UID: \"819fb198-6452-4eb2-aa02-ac5b9912e165\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:13.372941 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.372866    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:13.517846 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.517820    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"]
Jul 23 15:58:13.520231 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:58:13.520194    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod819fb198_6452_4eb2_aa02_ac5b9912e165.slice/crio-0ad564fe99f974f948c920cee948de33ff562a3244a3d164ae57f7d6bea4e450 WatchSource:0}: Error finding container 0ad564fe99f974f948c920cee948de33ff562a3244a3d164ae57f7d6bea4e450: Status 404 returned error can't find the container with id 0ad564fe99f974f948c920cee948de33ff562a3244a3d164ae57f7d6bea4e450
Jul 23 15:58:13.616081 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.616052    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"]
Jul 23 15:58:13.621137 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.621119    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:13.631350 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.631323    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"]
Jul 23 15:58:13.673688 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.673649    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4wss\" (UniqueName: \"kubernetes.io/projected/bb9d77a7-363b-48f6-826e-b2348d4630f7-kube-api-access-t4wss\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b\" (UID: \"bb9d77a7-363b-48f6-826e-b2348d4630f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:13.673816 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.673763    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb9d77a7-363b-48f6-826e-b2348d4630f7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b\" (UID: \"bb9d77a7-363b-48f6-826e-b2348d4630f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:13.673816 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.673808    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb9d77a7-363b-48f6-826e-b2348d4630f7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b\" (UID: \"bb9d77a7-363b-48f6-826e-b2348d4630f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:13.775073 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.775030    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4wss\" (UniqueName: \"kubernetes.io/projected/bb9d77a7-363b-48f6-826e-b2348d4630f7-kube-api-access-t4wss\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b\" (UID: \"bb9d77a7-363b-48f6-826e-b2348d4630f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:13.775293 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.775098    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb9d77a7-363b-48f6-826e-b2348d4630f7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b\" (UID: \"bb9d77a7-363b-48f6-826e-b2348d4630f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:13.775293 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.775126    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb9d77a7-363b-48f6-826e-b2348d4630f7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b\" (UID: \"bb9d77a7-363b-48f6-826e-b2348d4630f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:13.775528 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.775502    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb9d77a7-363b-48f6-826e-b2348d4630f7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b\" (UID: \"bb9d77a7-363b-48f6-826e-b2348d4630f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:13.775596 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.775508    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb9d77a7-363b-48f6-826e-b2348d4630f7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b\" (UID: \"bb9d77a7-363b-48f6-826e-b2348d4630f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:13.784874 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.784840    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4wss\" (UniqueName: \"kubernetes.io/projected/bb9d77a7-363b-48f6-826e-b2348d4630f7-kube-api-access-t4wss\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b\" (UID: \"bb9d77a7-363b-48f6-826e-b2348d4630f7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:13.813554 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.813521    2570 generic.go:356] "Generic (PLEG): container finished" podID="819fb198-6452-4eb2-aa02-ac5b9912e165" containerID="eb590412ed89e4602259abe848ae35d5d5a0a6a1c1d0f293a3e2a62c2921c0db" exitCode=0
Jul 23 15:58:13.813734 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.813606    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9" event={"ID":"819fb198-6452-4eb2-aa02-ac5b9912e165","Type":"ContainerDied","Data":"eb590412ed89e4602259abe848ae35d5d5a0a6a1c1d0f293a3e2a62c2921c0db"}
Jul 23 15:58:13.813734 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.813683    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9" event={"ID":"819fb198-6452-4eb2-aa02-ac5b9912e165","Type":"ContainerStarted","Data":"0ad564fe99f974f948c920cee948de33ff562a3244a3d164ae57f7d6bea4e450"}
Jul 23 15:58:13.815300 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.815268    2570 generic.go:356] "Generic (PLEG): container finished" podID="e4d742ef-2cdb-4eca-81a1-5655fb86b884" containerID="ba84ba405afea1a6a29f8013d5c1a41e3374934a355448f8dcedeaa720fcf85b" exitCode=0
Jul 23 15:58:13.815470 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.815353    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv" event={"ID":"e4d742ef-2cdb-4eca-81a1-5655fb86b884","Type":"ContainerDied","Data":"ba84ba405afea1a6a29f8013d5c1a41e3374934a355448f8dcedeaa720fcf85b"}
Jul 23 15:58:13.815470 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.815404    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv" event={"ID":"e4d742ef-2cdb-4eca-81a1-5655fb86b884","Type":"ContainerStarted","Data":"26a685648f3fd0d5883416045c42ace3c7e8fff51cca0f2cd016869384d4ec37"}
Jul 23 15:58:13.817417 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.817357    2570 generic.go:356] "Generic (PLEG): container finished" podID="87d529f4-7acb-4f12-8720-045526ac68af" containerID="f396917250ea148d9c85821e5cb6b1f8cc1cab0c9cc9e9a36ff0f66a9a5f2b99" exitCode=0
Jul 23 15:58:13.817417 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.817371    2570 generic.go:356] "Generic (PLEG): container finished" podID="87d529f4-7acb-4f12-8720-045526ac68af" containerID="ce260f7d959e4006132d3301b51ff06573791d26f254b9db15ee4c7829bfcae6" exitCode=0
Jul 23 15:58:13.817574 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.817437    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll" event={"ID":"87d529f4-7acb-4f12-8720-045526ac68af","Type":"ContainerDied","Data":"f396917250ea148d9c85821e5cb6b1f8cc1cab0c9cc9e9a36ff0f66a9a5f2b99"}
Jul 23 15:58:13.817574 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.817477    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll" event={"ID":"87d529f4-7acb-4f12-8720-045526ac68af","Type":"ContainerDied","Data":"ce260f7d959e4006132d3301b51ff06573791d26f254b9db15ee4c7829bfcae6"}
Jul 23 15:58:13.932117 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:13.932085    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:14.071546 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:14.071519    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"]
Jul 23 15:58:14.073510 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:58:14.073480    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9d77a7_363b_48f6_826e_b2348d4630f7.slice/crio-6cfda69ac8d2ce0a98f898f4a1727b8d93f9a8722d643d5151f847cf5796ded3 WatchSource:0}: Error finding container 6cfda69ac8d2ce0a98f898f4a1727b8d93f9a8722d643d5151f847cf5796ded3: Status 404 returned error can't find the container with id 6cfda69ac8d2ce0a98f898f4a1727b8d93f9a8722d643d5151f847cf5796ded3
Jul 23 15:58:14.824902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:14.824869    2570 generic.go:356] "Generic (PLEG): container finished" podID="819fb198-6452-4eb2-aa02-ac5b9912e165" containerID="1d57a8fda997c1b1e9be574c2057914b1ebdf7353873540b96b9f5f6b52b5920" exitCode=0
Jul 23 15:58:14.825346 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:14.824953    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9" event={"ID":"819fb198-6452-4eb2-aa02-ac5b9912e165","Type":"ContainerDied","Data":"1d57a8fda997c1b1e9be574c2057914b1ebdf7353873540b96b9f5f6b52b5920"}
Jul 23 15:58:14.826674 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:14.826648    2570 generic.go:356] "Generic (PLEG): container finished" podID="bb9d77a7-363b-48f6-826e-b2348d4630f7" containerID="f856aef686f7cdf8e70603e3bff59b1c7cd9b36c64b3f18c6c42a1c90bd59c0a" exitCode=0
Jul 23 15:58:14.826758 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:14.826732    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b" event={"ID":"bb9d77a7-363b-48f6-826e-b2348d4630f7","Type":"ContainerDied","Data":"f856aef686f7cdf8e70603e3bff59b1c7cd9b36c64b3f18c6c42a1c90bd59c0a"}
Jul 23 15:58:14.826890 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:14.826786    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b" event={"ID":"bb9d77a7-363b-48f6-826e-b2348d4630f7","Type":"ContainerStarted","Data":"6cfda69ac8d2ce0a98f898f4a1727b8d93f9a8722d643d5151f847cf5796ded3"}
Jul 23 15:58:14.828836 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:14.828812    2570 generic.go:356] "Generic (PLEG): container finished" podID="e4d742ef-2cdb-4eca-81a1-5655fb86b884" containerID="4162d0f50981a4d531b9d7211cdce1ec52b19cd032c295ff8a91b05b1b8ef3de" exitCode=0
Jul 23 15:58:14.828948 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:14.828901    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv" event={"ID":"e4d742ef-2cdb-4eca-81a1-5655fb86b884","Type":"ContainerDied","Data":"4162d0f50981a4d531b9d7211cdce1ec52b19cd032c295ff8a91b05b1b8ef3de"}
Jul 23 15:58:14.831422 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:14.831394    2570 generic.go:356] "Generic (PLEG): container finished" podID="87d529f4-7acb-4f12-8720-045526ac68af" containerID="c74fc0ca027fb3111dab41e730948d12f93d1a3ea378defa0d1b46be8bda2d97" exitCode=0
Jul 23 15:58:14.831529 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:14.831470    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll" event={"ID":"87d529f4-7acb-4f12-8720-045526ac68af","Type":"ContainerDied","Data":"c74fc0ca027fb3111dab41e730948d12f93d1a3ea378defa0d1b46be8bda2d97"}
Jul 23 15:58:15.838212 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.838121    2570 generic.go:356] "Generic (PLEG): container finished" podID="819fb198-6452-4eb2-aa02-ac5b9912e165" containerID="63bad58a14799bcaebda2235a0c28237ab19895d2bc991c7b86b3e8c07d9bbdd" exitCode=0
Jul 23 15:58:15.838212 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.838179    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9" event={"ID":"819fb198-6452-4eb2-aa02-ac5b9912e165","Type":"ContainerDied","Data":"63bad58a14799bcaebda2235a0c28237ab19895d2bc991c7b86b3e8c07d9bbdd"}
Jul 23 15:58:15.840084 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.840057    2570 generic.go:356] "Generic (PLEG): container finished" podID="bb9d77a7-363b-48f6-826e-b2348d4630f7" containerID="984949dfffcf582d1cc10f433d31b62ad683ab59588d5619836c58529c3962b9" exitCode=0
Jul 23 15:58:15.840226 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.840150    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b" event={"ID":"bb9d77a7-363b-48f6-826e-b2348d4630f7","Type":"ContainerDied","Data":"984949dfffcf582d1cc10f433d31b62ad683ab59588d5619836c58529c3962b9"}
Jul 23 15:58:15.842342 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.842320    2570 generic.go:356] "Generic (PLEG): container finished" podID="e4d742ef-2cdb-4eca-81a1-5655fb86b884" containerID="c7d69ac570deef88127b447310d011812816c0b5fa7a28179a3c1eb9abb8d6c2" exitCode=0
Jul 23 15:58:15.842449 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.842411    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv" event={"ID":"e4d742ef-2cdb-4eca-81a1-5655fb86b884","Type":"ContainerDied","Data":"c7d69ac570deef88127b447310d011812816c0b5fa7a28179a3c1eb9abb8d6c2"}
Jul 23 15:58:15.980825 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.980799    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:15.993351 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.993326    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d529f4-7acb-4f12-8720-045526ac68af-bundle\") pod \"87d529f4-7acb-4f12-8720-045526ac68af\" (UID: \"87d529f4-7acb-4f12-8720-045526ac68af\") "
Jul 23 15:58:15.993493 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.993390    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d529f4-7acb-4f12-8720-045526ac68af-util\") pod \"87d529f4-7acb-4f12-8720-045526ac68af\" (UID: \"87d529f4-7acb-4f12-8720-045526ac68af\") "
Jul 23 15:58:15.993493 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.993430    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gw8mf\" (UniqueName: \"kubernetes.io/projected/87d529f4-7acb-4f12-8720-045526ac68af-kube-api-access-gw8mf\") pod \"87d529f4-7acb-4f12-8720-045526ac68af\" (UID: \"87d529f4-7acb-4f12-8720-045526ac68af\") "
Jul 23 15:58:15.993915 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.993889    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d529f4-7acb-4f12-8720-045526ac68af-bundle" (OuterVolumeSpecName: "bundle") pod "87d529f4-7acb-4f12-8720-045526ac68af" (UID: "87d529f4-7acb-4f12-8720-045526ac68af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:58:15.995505 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.995478    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87d529f4-7acb-4f12-8720-045526ac68af-kube-api-access-gw8mf" (OuterVolumeSpecName: "kube-api-access-gw8mf") pod "87d529f4-7acb-4f12-8720-045526ac68af" (UID: "87d529f4-7acb-4f12-8720-045526ac68af"). InnerVolumeSpecName "kube-api-access-gw8mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:58:15.999067 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:15.999033    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87d529f4-7acb-4f12-8720-045526ac68af-util" (OuterVolumeSpecName: "util") pod "87d529f4-7acb-4f12-8720-045526ac68af" (UID: "87d529f4-7acb-4f12-8720-045526ac68af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:58:16.095097 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:16.094989    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/87d529f4-7acb-4f12-8720-045526ac68af-util\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:16.095097 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:16.095048    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gw8mf\" (UniqueName: \"kubernetes.io/projected/87d529f4-7acb-4f12-8720-045526ac68af-kube-api-access-gw8mf\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:16.095097 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:16.095058    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/87d529f4-7acb-4f12-8720-045526ac68af-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:16.849519 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:16.849489    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll"
Jul 23 15:58:16.849944 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:16.849524    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll" event={"ID":"87d529f4-7acb-4f12-8720-045526ac68af","Type":"ContainerDied","Data":"b644f6c3d9da344e41aaefb993a779dadf98199a6eebc5f92505d9aca812a350"}
Jul 23 15:58:16.849944 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:16.849568    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b644f6c3d9da344e41aaefb993a779dadf98199a6eebc5f92505d9aca812a350"
Jul 23 15:58:16.851824 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:16.851801    2570 generic.go:356] "Generic (PLEG): container finished" podID="bb9d77a7-363b-48f6-826e-b2348d4630f7" containerID="4eb96bafd2983ffe34b45dc4ce269ccd1805deee7d465564f763a59721a06605" exitCode=0
Jul 23 15:58:16.851963 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:16.851927    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b" event={"ID":"bb9d77a7-363b-48f6-826e-b2348d4630f7","Type":"ContainerDied","Data":"4eb96bafd2983ffe34b45dc4ce269ccd1805deee7d465564f763a59721a06605"}
Jul 23 15:58:17.008532 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.008504    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:17.012174 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.012153    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:17.103538 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.103454    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/819fb198-6452-4eb2-aa02-ac5b9912e165-bundle\") pod \"819fb198-6452-4eb2-aa02-ac5b9912e165\" (UID: \"819fb198-6452-4eb2-aa02-ac5b9912e165\") "
Jul 23 15:58:17.103701 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.103564    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/819fb198-6452-4eb2-aa02-ac5b9912e165-util\") pod \"819fb198-6452-4eb2-aa02-ac5b9912e165\" (UID: \"819fb198-6452-4eb2-aa02-ac5b9912e165\") "
Jul 23 15:58:17.103701 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.103604    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4d742ef-2cdb-4eca-81a1-5655fb86b884-util\") pod \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\" (UID: \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\") "
Jul 23 15:58:17.103701 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.103639    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkhkx\" (UniqueName: \"kubernetes.io/projected/e4d742ef-2cdb-4eca-81a1-5655fb86b884-kube-api-access-pkhkx\") pod \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\" (UID: \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\") "
Jul 23 15:58:17.103880 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.103701    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4d742ef-2cdb-4eca-81a1-5655fb86b884-bundle\") pod \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\" (UID: \"e4d742ef-2cdb-4eca-81a1-5655fb86b884\") "
Jul 23 15:58:17.103880 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.103731    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctvdh\" (UniqueName: \"kubernetes.io/projected/819fb198-6452-4eb2-aa02-ac5b9912e165-kube-api-access-ctvdh\") pod \"819fb198-6452-4eb2-aa02-ac5b9912e165\" (UID: \"819fb198-6452-4eb2-aa02-ac5b9912e165\") "
Jul 23 15:58:17.104176 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.104150    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819fb198-6452-4eb2-aa02-ac5b9912e165-bundle" (OuterVolumeSpecName: "bundle") pod "819fb198-6452-4eb2-aa02-ac5b9912e165" (UID: "819fb198-6452-4eb2-aa02-ac5b9912e165"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:58:17.104288 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.104175    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4d742ef-2cdb-4eca-81a1-5655fb86b884-bundle" (OuterVolumeSpecName: "bundle") pod "e4d742ef-2cdb-4eca-81a1-5655fb86b884" (UID: "e4d742ef-2cdb-4eca-81a1-5655fb86b884"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:58:17.106353 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.106320    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4d742ef-2cdb-4eca-81a1-5655fb86b884-kube-api-access-pkhkx" (OuterVolumeSpecName: "kube-api-access-pkhkx") pod "e4d742ef-2cdb-4eca-81a1-5655fb86b884" (UID: "e4d742ef-2cdb-4eca-81a1-5655fb86b884"). InnerVolumeSpecName "kube-api-access-pkhkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:58:17.106353 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.106324    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/819fb198-6452-4eb2-aa02-ac5b9912e165-kube-api-access-ctvdh" (OuterVolumeSpecName: "kube-api-access-ctvdh") pod "819fb198-6452-4eb2-aa02-ac5b9912e165" (UID: "819fb198-6452-4eb2-aa02-ac5b9912e165"). InnerVolumeSpecName "kube-api-access-ctvdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:58:17.110325 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.110300    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/819fb198-6452-4eb2-aa02-ac5b9912e165-util" (OuterVolumeSpecName: "util") pod "819fb198-6452-4eb2-aa02-ac5b9912e165" (UID: "819fb198-6452-4eb2-aa02-ac5b9912e165"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:58:17.110414 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.110313    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4d742ef-2cdb-4eca-81a1-5655fb86b884-util" (OuterVolumeSpecName: "util") pod "e4d742ef-2cdb-4eca-81a1-5655fb86b884" (UID: "e4d742ef-2cdb-4eca-81a1-5655fb86b884"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:58:17.205143 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.205094    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctvdh\" (UniqueName: \"kubernetes.io/projected/819fb198-6452-4eb2-aa02-ac5b9912e165-kube-api-access-ctvdh\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:17.205143 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.205138    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/819fb198-6452-4eb2-aa02-ac5b9912e165-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:17.205143 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.205148    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/819fb198-6452-4eb2-aa02-ac5b9912e165-util\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:17.205143 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.205156    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e4d742ef-2cdb-4eca-81a1-5655fb86b884-util\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:17.205143 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.205163    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkhkx\" (UniqueName: \"kubernetes.io/projected/e4d742ef-2cdb-4eca-81a1-5655fb86b884-kube-api-access-pkhkx\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:17.205451 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.205173    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e4d742ef-2cdb-4eca-81a1-5655fb86b884-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:17.858398 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.858367    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv"
Jul 23 15:58:17.858865 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.858402    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv" event={"ID":"e4d742ef-2cdb-4eca-81a1-5655fb86b884","Type":"ContainerDied","Data":"26a685648f3fd0d5883416045c42ace3c7e8fff51cca0f2cd016869384d4ec37"}
Jul 23 15:58:17.858865 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.858451    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26a685648f3fd0d5883416045c42ace3c7e8fff51cca0f2cd016869384d4ec37"
Jul 23 15:58:17.860304 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.860280    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9" event={"ID":"819fb198-6452-4eb2-aa02-ac5b9912e165","Type":"ContainerDied","Data":"0ad564fe99f974f948c920cee948de33ff562a3244a3d164ae57f7d6bea4e450"}
Jul 23 15:58:17.860436 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.860323    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ad564fe99f974f948c920cee948de33ff562a3244a3d164ae57f7d6bea4e450"
Jul 23 15:58:17.860436 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.860286    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9"
Jul 23 15:58:17.993052 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:17.993025    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:18.013843 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:18.013811    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4wss\" (UniqueName: \"kubernetes.io/projected/bb9d77a7-363b-48f6-826e-b2348d4630f7-kube-api-access-t4wss\") pod \"bb9d77a7-363b-48f6-826e-b2348d4630f7\" (UID: \"bb9d77a7-363b-48f6-826e-b2348d4630f7\") "
Jul 23 15:58:18.014049 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:18.013885    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb9d77a7-363b-48f6-826e-b2348d4630f7-bundle\") pod \"bb9d77a7-363b-48f6-826e-b2348d4630f7\" (UID: \"bb9d77a7-363b-48f6-826e-b2348d4630f7\") "
Jul 23 15:58:18.014049 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:18.013917    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb9d77a7-363b-48f6-826e-b2348d4630f7-util\") pod \"bb9d77a7-363b-48f6-826e-b2348d4630f7\" (UID: \"bb9d77a7-363b-48f6-826e-b2348d4630f7\") "
Jul 23 15:58:18.014860 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:18.014824    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb9d77a7-363b-48f6-826e-b2348d4630f7-bundle" (OuterVolumeSpecName: "bundle") pod "bb9d77a7-363b-48f6-826e-b2348d4630f7" (UID: "bb9d77a7-363b-48f6-826e-b2348d4630f7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:58:18.016154 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:18.016127    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb9d77a7-363b-48f6-826e-b2348d4630f7-kube-api-access-t4wss" (OuterVolumeSpecName: "kube-api-access-t4wss") pod "bb9d77a7-363b-48f6-826e-b2348d4630f7" (UID: "bb9d77a7-363b-48f6-826e-b2348d4630f7"). InnerVolumeSpecName "kube-api-access-t4wss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:58:18.020224 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:18.020200    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bb9d77a7-363b-48f6-826e-b2348d4630f7-util" (OuterVolumeSpecName: "util") pod "bb9d77a7-363b-48f6-826e-b2348d4630f7" (UID: "bb9d77a7-363b-48f6-826e-b2348d4630f7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:58:18.115404 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:18.115311    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4wss\" (UniqueName: \"kubernetes.io/projected/bb9d77a7-363b-48f6-826e-b2348d4630f7-kube-api-access-t4wss\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:18.115404 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:18.115347    2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bb9d77a7-363b-48f6-826e-b2348d4630f7-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:18.115404 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:18.115357    2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bb9d77a7-363b-48f6-826e-b2348d4630f7-util\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:58:18.873504 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:18.873425    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b"
Jul 23 15:58:18.873504 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:18.873453    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b" event={"ID":"bb9d77a7-363b-48f6-826e-b2348d4630f7","Type":"ContainerDied","Data":"6cfda69ac8d2ce0a98f898f4a1727b8d93f9a8722d643d5151f847cf5796ded3"}
Jul 23 15:58:18.873906 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:18.873519    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6cfda69ac8d2ce0a98f898f4a1727b8d93f9a8722d643d5151f847cf5796ded3"
Jul 23 15:58:25.662295 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:25.662242    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:28.293175 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293136    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g"]
Jul 23 15:58:28.293544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293487    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d529f4-7acb-4f12-8720-045526ac68af" containerName="util"
Jul 23 15:58:28.293544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293498    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d529f4-7acb-4f12-8720-045526ac68af" containerName="util"
Jul 23 15:58:28.293544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293508    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4d742ef-2cdb-4eca-81a1-5655fb86b884" containerName="util"
Jul 23 15:58:28.293544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293514    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d742ef-2cdb-4eca-81a1-5655fb86b884" containerName="util"
Jul 23 15:58:28.293544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293521    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d529f4-7acb-4f12-8720-045526ac68af" containerName="pull"
Jul 23 15:58:28.293544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293527    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d529f4-7acb-4f12-8720-045526ac68af" containerName="pull"
Jul 23 15:58:28.293544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293535    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819fb198-6452-4eb2-aa02-ac5b9912e165" containerName="pull"
Jul 23 15:58:28.293544 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293542    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="819fb198-6452-4eb2-aa02-ac5b9912e165" containerName="pull"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293553    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4d742ef-2cdb-4eca-81a1-5655fb86b884" containerName="pull"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293560    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d742ef-2cdb-4eca-81a1-5655fb86b884" containerName="pull"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293568    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4d742ef-2cdb-4eca-81a1-5655fb86b884" containerName="extract"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293574    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d742ef-2cdb-4eca-81a1-5655fb86b884" containerName="extract"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293583    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb9d77a7-363b-48f6-826e-b2348d4630f7" containerName="util"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293589    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb9d77a7-363b-48f6-826e-b2348d4630f7" containerName="util"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293601    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb9d77a7-363b-48f6-826e-b2348d4630f7" containerName="pull"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293608    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb9d77a7-363b-48f6-826e-b2348d4630f7" containerName="pull"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293617    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819fb198-6452-4eb2-aa02-ac5b9912e165" containerName="util"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293622    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="819fb198-6452-4eb2-aa02-ac5b9912e165" containerName="util"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293628    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87d529f4-7acb-4f12-8720-045526ac68af" containerName="extract"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293633    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="87d529f4-7acb-4f12-8720-045526ac68af" containerName="extract"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293638    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="819fb198-6452-4eb2-aa02-ac5b9912e165" containerName="extract"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293643    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="819fb198-6452-4eb2-aa02-ac5b9912e165" containerName="extract"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293653    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb9d77a7-363b-48f6-826e-b2348d4630f7" containerName="extract"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293658    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb9d77a7-363b-48f6-826e-b2348d4630f7" containerName="extract"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293721    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb9d77a7-363b-48f6-826e-b2348d4630f7" containerName="extract"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293729    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4d742ef-2cdb-4eca-81a1-5655fb86b884" containerName="extract"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293742    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="819fb198-6452-4eb2-aa02-ac5b9912e165" containerName="extract"
Jul 23 15:58:28.293902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.293752    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="87d529f4-7acb-4f12-8720-045526ac68af" containerName="extract"
Jul 23 15:58:28.300128 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.300106    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g"
Jul 23 15:58:28.303440 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.303417    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tl996\""
Jul 23 15:58:28.304755 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.304734    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 23 15:58:28.311609 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.311583    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g"]
Jul 23 15:58:28.406296 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.406256    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttwm4\" (UniqueName: \"kubernetes.io/projected/e2f0d511-f920-44d6-9bd0-b2ae3701fbbb-kube-api-access-ttwm4\") pod \"dns-operator-controller-manager-864dd78c4c-jf87g\" (UID: \"e2f0d511-f920-44d6-9bd0-b2ae3701fbbb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g"
Jul 23 15:58:28.507489 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.507449    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttwm4\" (UniqueName: \"kubernetes.io/projected/e2f0d511-f920-44d6-9bd0-b2ae3701fbbb-kube-api-access-ttwm4\") pod \"dns-operator-controller-manager-864dd78c4c-jf87g\" (UID: \"e2f0d511-f920-44d6-9bd0-b2ae3701fbbb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g"
Jul 23 15:58:28.520377 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.520346    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttwm4\" (UniqueName: \"kubernetes.io/projected/e2f0d511-f920-44d6-9bd0-b2ae3701fbbb-kube-api-access-ttwm4\") pod \"dns-operator-controller-manager-864dd78c4c-jf87g\" (UID: \"e2f0d511-f920-44d6-9bd0-b2ae3701fbbb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g"
Jul 23 15:58:28.610647 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.610559    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g"
Jul 23 15:58:28.751417 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.751392    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g"]
Jul 23 15:58:28.753482 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:58:28.753456    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f0d511_f920_44d6_9bd0_b2ae3701fbbb.slice/crio-f0ae421fb9e1a61451fea58000bc14d415b6cc06c828172504c0d314daba8b05 WatchSource:0}: Error finding container f0ae421fb9e1a61451fea58000bc14d415b6cc06c828172504c0d314daba8b05: Status 404 returned error can't find the container with id f0ae421fb9e1a61451fea58000bc14d415b6cc06c828172504c0d314daba8b05
Jul 23 15:58:28.925527 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:28.925440    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g" event={"ID":"e2f0d511-f920-44d6-9bd0-b2ae3701fbbb","Type":"ContainerStarted","Data":"f0ae421fb9e1a61451fea58000bc14d415b6cc06c828172504c0d314daba8b05"}
Jul 23 15:58:29.052152 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:29.052120    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:29.859748 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:29.859707    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:30.937157 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:30.937057    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g" event={"ID":"e2f0d511-f920-44d6-9bd0-b2ae3701fbbb","Type":"ContainerStarted","Data":"76e52398e4b09196cff068fa6d6310d15f5bda87a79a015857a1b34fe1351c5c"}
Jul 23 15:58:30.937554 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:30.937167    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g"
Jul 23 15:58:30.966090 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:30.966037    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g" podStartSLOduration=1.048992816 podStartE2EDuration="2.966005801s" totalImagesPullingTime="1.917012985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:58:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:58:30.963098815 +0000 UTC m=+496.886953448" watchObservedRunningTime="2026-07-23 15:58:30.966005801 +0000 UTC m=+496.889860435"
Jul 23 15:58:32.448321 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:32.448280    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7866q"]
Jul 23 15:58:32.451905 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:32.451879    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7866q"
Jul 23 15:58:32.455337 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:32.455316    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-znknz\""
Jul 23 15:58:32.475634 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:32.475600    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7866q"]
Jul 23 15:58:32.545241 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:32.545201    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzww6\" (UniqueName: \"kubernetes.io/projected/2fd00603-22cc-4c32-b471-1af7a8fd5864-kube-api-access-tzww6\") pod \"authorino-operator-75cc8d5cb7-7866q\" (UID: \"2fd00603-22cc-4c32-b471-1af7a8fd5864\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7866q"
Jul 23 15:58:32.646585 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:32.646548    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzww6\" (UniqueName: \"kubernetes.io/projected/2fd00603-22cc-4c32-b471-1af7a8fd5864-kube-api-access-tzww6\") pod \"authorino-operator-75cc8d5cb7-7866q\" (UID: \"2fd00603-22cc-4c32-b471-1af7a8fd5864\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7866q"
Jul 23 15:58:32.656371 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:32.656339    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzww6\" (UniqueName: \"kubernetes.io/projected/2fd00603-22cc-4c32-b471-1af7a8fd5864-kube-api-access-tzww6\") pod \"authorino-operator-75cc8d5cb7-7866q\" (UID: \"2fd00603-22cc-4c32-b471-1af7a8fd5864\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-7866q"
Jul 23 15:58:32.762755 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:32.762718    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7866q"
Jul 23 15:58:32.926186 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:32.926156    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-7866q"]
Jul 23 15:58:32.930971 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:58:32.930941    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fd00603_22cc_4c32_b471_1af7a8fd5864.slice/crio-6b94f5bf2d8217e11a5c92da84fa9b771a8123e96fc7bf0d959adc0071dda2e6 WatchSource:0}: Error finding container 6b94f5bf2d8217e11a5c92da84fa9b771a8123e96fc7bf0d959adc0071dda2e6: Status 404 returned error can't find the container with id 6b94f5bf2d8217e11a5c92da84fa9b771a8123e96fc7bf0d959adc0071dda2e6
Jul 23 15:58:32.949080 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:32.949047    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7866q" event={"ID":"2fd00603-22cc-4c32-b471-1af7a8fd5864","Type":"ContainerStarted","Data":"6b94f5bf2d8217e11a5c92da84fa9b771a8123e96fc7bf0d959adc0071dda2e6"}
Jul 23 15:58:33.123941 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:33.123855    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:33.645880 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:33.645834    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:35.349030 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:35.348972    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:35.967556 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:35.967520    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7866q" event={"ID":"2fd00603-22cc-4c32-b471-1af7a8fd5864","Type":"ContainerStarted","Data":"617a68a454c65a9c10e7a867c88169993ba327c589e2727d9322833a28d8f50d"}
Jul 23 15:58:35.967758 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:35.967662    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7866q"
Jul 23 15:58:35.992263 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:35.992210    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7866q" podStartSLOduration=1.137439673 podStartE2EDuration="3.992193039s" totalImagesPullingTime="2.854753366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:58:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:58:35.990109071 +0000 UTC m=+501.913963705" watchObservedRunningTime="2026-07-23 15:58:35.992193039 +0000 UTC m=+501.916047737"
Jul 23 15:58:36.584905 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:36.584875    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:37.839904 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:37.839867    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"]
Jul 23 15:58:37.843275 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:37.843254    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:37.846465 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:37.846439    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rjnxw\""
Jul 23 15:58:37.869482 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:37.869450    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"]
Jul 23 15:58:37.897317 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:37.897284    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6j78\" (UniqueName: \"kubernetes.io/projected/dbfddd98-517e-460b-992c-169db982a719-kube-api-access-b6j78\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" (UID: \"dbfddd98-517e-460b-992c-169db982a719\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:37.897537 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:37.897412    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbfddd98-517e-460b-992c-169db982a719-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" (UID: \"dbfddd98-517e-460b-992c-169db982a719\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:37.998723 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:37.998684    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbfddd98-517e-460b-992c-169db982a719-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" (UID: \"dbfddd98-517e-460b-992c-169db982a719\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:37.998942 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:37.998767    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6j78\" (UniqueName: \"kubernetes.io/projected/dbfddd98-517e-460b-992c-169db982a719-kube-api-access-b6j78\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" (UID: \"dbfddd98-517e-460b-992c-169db982a719\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:37.999214 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:37.999190    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbfddd98-517e-460b-992c-169db982a719-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" (UID: \"dbfddd98-517e-460b-992c-169db982a719\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:38.012227 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:38.012190    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6j78\" (UniqueName: \"kubernetes.io/projected/dbfddd98-517e-460b-992c-169db982a719-kube-api-access-b6j78\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" (UID: \"dbfddd98-517e-460b-992c-169db982a719\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:38.153884 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:38.153788    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:38.300666 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:38.300633    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"]
Jul 23 15:58:38.303374 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:58:38.303338    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbfddd98_517e_460b_992c_169db982a719.slice/crio-74757594ff16d10029d590c06ad8f65c154b063e2953073da651c8633c91bcf4 WatchSource:0}: Error finding container 74757594ff16d10029d590c06ad8f65c154b063e2953073da651c8633c91bcf4: Status 404 returned error can't find the container with id 74757594ff16d10029d590c06ad8f65c154b063e2953073da651c8633c91bcf4
Jul 23 15:58:38.699691 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:38.699659    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:38.829597 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:38.829557    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:38.985604 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:38.985562    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z" event={"ID":"dbfddd98-517e-460b-992c-169db982a719","Type":"ContainerStarted","Data":"74757594ff16d10029d590c06ad8f65c154b063e2953073da651c8633c91bcf4"}
Jul 23 15:58:40.395449 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:40.395411    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"]
Jul 23 15:58:40.398760 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:40.398743    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:58:40.402495 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:40.402475    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-nphkx\""
Jul 23 15:58:40.413395 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:40.413368    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"]
Jul 23 15:58:40.524097 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:40.524063    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cgh6\" (UniqueName: \"kubernetes.io/projected/e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58-kube-api-access-6cgh6\") pod \"limitador-operator-controller-manager-859d7b78bd-f2bj8\" (UID: \"e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:58:40.625647 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:40.625599    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cgh6\" (UniqueName: \"kubernetes.io/projected/e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58-kube-api-access-6cgh6\") pod \"limitador-operator-controller-manager-859d7b78bd-f2bj8\" (UID: \"e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:58:40.637207 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:40.637167    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cgh6\" (UniqueName: \"kubernetes.io/projected/e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58-kube-api-access-6cgh6\") pod \"limitador-operator-controller-manager-859d7b78bd-f2bj8\" (UID: \"e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:58:40.710135 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:40.710042    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:58:40.875658 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:40.875626    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"]
Jul 23 15:58:40.876477 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:58:40.876448    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9c9698b_8c5d_4e37_a0b4_3e0796d1ae58.slice/crio-9402a2b895efde45121313f7a3576823fae10ca4b8be56f75c494d142de29253 WatchSource:0}: Error finding container 9402a2b895efde45121313f7a3576823fae10ca4b8be56f75c494d142de29253: Status 404 returned error can't find the container with id 9402a2b895efde45121313f7a3576823fae10ca4b8be56f75c494d142de29253
Jul 23 15:58:40.998886 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:40.998845    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8" event={"ID":"e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58","Type":"ContainerStarted","Data":"9402a2b895efde45121313f7a3576823fae10ca4b8be56f75c494d142de29253"}
Jul 23 15:58:41.536186 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:41.536145    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:41.662761 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:41.662715    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:41.945727 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:41.945634    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jf87g"
Jul 23 15:58:42.672402 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:42.672202    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:42.771644 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:42.771605    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:43.014368 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:43.014330    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z" event={"ID":"dbfddd98-517e-460b-992c-169db982a719","Type":"ContainerStarted","Data":"be38ca86b310b3536d4d85fff04832e73ac74ff8531780f0a6aea783bdd25f25"}
Jul 23 15:58:43.014556 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:43.014393    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:43.039811 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:43.039745    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z" podStartSLOduration=1.6649938180000001 podStartE2EDuration="6.03972753s" totalImagesPullingTime="4.374733712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:58:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:58:43.036846742 +0000 UTC m=+508.960701378" watchObservedRunningTime="2026-07-23 15:58:43.03972753 +0000 UTC m=+508.963582164"
Jul 23 15:58:44.021871 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:44.021828    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8" event={"ID":"e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58","Type":"ContainerStarted","Data":"dd2c882e825446b615c69c4958fe869af0214c8440bcb27e0c5c64e4f40a5631"}
Jul 23 15:58:44.022297 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:44.022042    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:58:44.053914 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:44.053862    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8" podStartSLOduration=1.472058822 podStartE2EDuration="4.053845684s" totalImagesPullingTime="2.581786862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:58:44.051207893 +0000 UTC m=+509.975062527" watchObservedRunningTime="2026-07-23 15:58:44.053845684 +0000 UTC m=+509.977700318"
Jul 23 15:58:44.265499 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:44.265471    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:45.815944 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:45.815904    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"]
Jul 23 15:58:45.820608 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:45.820583    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"
Jul 23 15:58:45.823004 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:45.822981    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7zdfd\""
Jul 23 15:58:45.823908 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:45.823893    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 23 15:58:45.823968 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:45.823916    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 23 15:58:45.829778 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:45.829744    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:45.832479 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:45.832455    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"]
Jul 23 15:58:45.941386 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:45.941355    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:45.978418 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:45.978383    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/91906f93-a708-4b4f-8134-c5fe83a5beb7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ffzkp\" (UID: \"91906f93-a708-4b4f-8134-c5fe83a5beb7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"
Jul 23 15:58:45.978622 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:45.978442    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/91906f93-a708-4b4f-8134-c5fe83a5beb7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ffzkp\" (UID: \"91906f93-a708-4b4f-8134-c5fe83a5beb7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"
Jul 23 15:58:45.978622 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:45.978569    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnlr2\" (UniqueName: \"kubernetes.io/projected/91906f93-a708-4b4f-8134-c5fe83a5beb7-kube-api-access-nnlr2\") pod \"kuadrant-console-plugin-66b5774985-ffzkp\" (UID: \"91906f93-a708-4b4f-8134-c5fe83a5beb7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"
Jul 23 15:58:46.079897 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:46.079793    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/91906f93-a708-4b4f-8134-c5fe83a5beb7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ffzkp\" (UID: \"91906f93-a708-4b4f-8134-c5fe83a5beb7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"
Jul 23 15:58:46.079897 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:46.079852    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/91906f93-a708-4b4f-8134-c5fe83a5beb7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ffzkp\" (UID: \"91906f93-a708-4b4f-8134-c5fe83a5beb7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"
Jul 23 15:58:46.080175 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:46.079903    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnlr2\" (UniqueName: \"kubernetes.io/projected/91906f93-a708-4b4f-8134-c5fe83a5beb7-kube-api-access-nnlr2\") pod \"kuadrant-console-plugin-66b5774985-ffzkp\" (UID: \"91906f93-a708-4b4f-8134-c5fe83a5beb7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"
Jul 23 15:58:46.080677 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:46.080655    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/91906f93-a708-4b4f-8134-c5fe83a5beb7-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-ffzkp\" (UID: \"91906f93-a708-4b4f-8134-c5fe83a5beb7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"
Jul 23 15:58:46.082456 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:46.082429    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/91906f93-a708-4b4f-8134-c5fe83a5beb7-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-ffzkp\" (UID: \"91906f93-a708-4b4f-8134-c5fe83a5beb7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"
Jul 23 15:58:46.089804 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:46.089769    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnlr2\" (UniqueName: \"kubernetes.io/projected/91906f93-a708-4b4f-8134-c5fe83a5beb7-kube-api-access-nnlr2\") pod \"kuadrant-console-plugin-66b5774985-ffzkp\" (UID: \"91906f93-a708-4b4f-8134-c5fe83a5beb7\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"
Jul 23 15:58:46.130447 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:46.130411    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"
Jul 23 15:58:46.281245 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:46.281217    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp"]
Jul 23 15:58:46.282209 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:58:46.282181    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod91906f93_a708_4b4f_8134_c5fe83a5beb7.slice/crio-dd92eae0d54c45e245cde0e17fe6747cfe2690741fb1b40e239c86c915829292 WatchSource:0}: Error finding container dd92eae0d54c45e245cde0e17fe6747cfe2690741fb1b40e239c86c915829292: Status 404 returned error can't find the container with id dd92eae0d54c45e245cde0e17fe6747cfe2690741fb1b40e239c86c915829292
Jul 23 15:58:46.873120 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:46.873084    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:46.970643 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:46.970607    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:46.976842 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:46.976812    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-7866q"
Jul 23 15:58:47.042354 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:47.042316    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp" event={"ID":"91906f93-a708-4b4f-8134-c5fe83a5beb7","Type":"ContainerStarted","Data":"dd92eae0d54c45e245cde0e17fe6747cfe2690741fb1b40e239c86c915829292"}
Jul 23 15:58:47.321995 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:47.321951    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:47.411620 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:47.411582    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:50.866739 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:50.866693    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:50.968284 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:50.968247    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:54.024352 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:54.024314    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:55.030608 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:55.030576    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:58:55.962901 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:55.962150    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"]
Jul 23 15:58:55.962901 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:55.962493    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z" podUID="dbfddd98-517e-460b-992c-169db982a719" containerName="manager" containerID="cri-o://be38ca86b310b3536d4d85fff04832e73ac74ff8531780f0a6aea783bdd25f25" gracePeriod=2
Jul 23 15:58:55.982533 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:55.982500    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"]
Jul 23 15:58:55.990378 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:58:55.990334    2570 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"dbfddd98-517e-460b-992c-169db982a719\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\": pods \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:56.024913 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.024873    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"]
Jul 23 15:58:56.025984 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.025704    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8" podUID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" containerName="manager" containerID="cri-o://dd2c882e825446b615c69c4958fe869af0214c8440bcb27e0c5c64e4f40a5631" gracePeriod=2
Jul 23 15:58:56.044328 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.044272    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"]
Jul 23 15:58:56.044770 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:58:56.044583    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="dbfddd98-517e-460b-992c-169db982a719" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:56.047584 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.047264    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"]
Jul 23 15:58:56.047723 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.047663    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" containerName="manager"
Jul 23 15:58:56.047723 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.047675    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" containerName="manager"
Jul 23 15:58:56.047723 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.047688    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbfddd98-517e-460b-992c-169db982a719" containerName="manager"
Jul 23 15:58:56.047723 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.047694    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbfddd98-517e-460b-992c-169db982a719" containerName="manager"
Jul 23 15:58:56.047942 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.047760    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" containerName="manager"
Jul 23 15:58:56.047942 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.047767    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbfddd98-517e-460b-992c-169db982a719" containerName="manager"
Jul 23 15:58:56.051237 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.051214    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"
Jul 23 15:58:56.054805 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:58:56.054758    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2bj8\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:58:56.057402 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:58:56.057359    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="dbfddd98-517e-460b-992c-169db982a719" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:56.072209 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.072173    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"]
Jul 23 15:58:56.104107 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.104084    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz"]
Jul 23 15:58:56.109396 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.109371    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz"
Jul 23 15:58:56.113515 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:58:56.113380    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2bj8\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:58:56.117111 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:58:56.117065    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="dbfddd98-517e-460b-992c-169db982a719" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:58:56.157152 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.157068    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz"]
Jul 23 15:58:56.182998 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.182960    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h85xs\" (UniqueName: \"kubernetes.io/projected/ee3501db-f6fb-4cb2-b39d-30084789d29c-kube-api-access-h85xs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2wsfh\" (UID: \"ee3501db-f6fb-4cb2-b39d-30084789d29c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"
Jul 23 15:58:56.183190 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.183058    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee3501db-f6fb-4cb2-b39d-30084789d29c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2wsfh\" (UID: \"ee3501db-f6fb-4cb2-b39d-30084789d29c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"
Jul 23 15:58:56.283965 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.283925    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee3501db-f6fb-4cb2-b39d-30084789d29c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2wsfh\" (UID: \"ee3501db-f6fb-4cb2-b39d-30084789d29c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"
Jul 23 15:58:56.284173 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.284101    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h85xs\" (UniqueName: \"kubernetes.io/projected/ee3501db-f6fb-4cb2-b39d-30084789d29c-kube-api-access-h85xs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2wsfh\" (UID: \"ee3501db-f6fb-4cb2-b39d-30084789d29c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"
Jul 23 15:58:56.284173 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.284134    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9wt5\" (UniqueName: \"kubernetes.io/projected/b311cc2e-2285-4625-8df7-13b6160e5a3d-kube-api-access-t9wt5\") pod \"limitador-operator-controller-manager-859d7b78bd-j7jbz\" (UID: \"b311cc2e-2285-4625-8df7-13b6160e5a3d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz"
Jul 23 15:58:56.284422 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.284398    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee3501db-f6fb-4cb2-b39d-30084789d29c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2wsfh\" (UID: \"ee3501db-f6fb-4cb2-b39d-30084789d29c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"
Jul 23 15:58:56.299482 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.299447    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h85xs\" (UniqueName: \"kubernetes.io/projected/ee3501db-f6fb-4cb2-b39d-30084789d29c-kube-api-access-h85xs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2wsfh\" (UID: \"ee3501db-f6fb-4cb2-b39d-30084789d29c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"
Jul 23 15:58:56.385194 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.385151    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9wt5\" (UniqueName: \"kubernetes.io/projected/b311cc2e-2285-4625-8df7-13b6160e5a3d-kube-api-access-t9wt5\") pod \"limitador-operator-controller-manager-859d7b78bd-j7jbz\" (UID: \"b311cc2e-2285-4625-8df7-13b6160e5a3d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz"
Jul 23 15:58:56.395543 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.395506    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9wt5\" (UniqueName: \"kubernetes.io/projected/b311cc2e-2285-4625-8df7-13b6160e5a3d-kube-api-access-t9wt5\") pod \"limitador-operator-controller-manager-859d7b78bd-j7jbz\" (UID: \"b311cc2e-2285-4625-8df7-13b6160e5a3d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz"
Jul 23 15:58:56.408398 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.408370    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"
Jul 23 15:58:56.424235 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:56.424204    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz"
Jul 23 15:58:57.062636 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:57.062595    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"]
Jul 23 15:58:57.087696 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:57.087664    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"]
Jul 23 15:58:57.087907 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:57.087763    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"
Jul 23 15:58:57.091708 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:57.091666    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3df21c6c-b408-446d-90cb-932b04113898-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k4922\" (UID: \"3df21c6c-b408-446d-90cb-932b04113898\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"
Jul 23 15:58:57.091876 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:57.091713    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns4sd\" (UniqueName: \"kubernetes.io/projected/3df21c6c-b408-446d-90cb-932b04113898-kube-api-access-ns4sd\") pod \"kuadrant-operator-controller-manager-86878c769f-k4922\" (UID: \"3df21c6c-b408-446d-90cb-932b04113898\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"
Jul 23 15:58:57.193104 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:57.193065    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3df21c6c-b408-446d-90cb-932b04113898-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k4922\" (UID: \"3df21c6c-b408-446d-90cb-932b04113898\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"
Jul 23 15:58:57.193295 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:57.193119    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns4sd\" (UniqueName: \"kubernetes.io/projected/3df21c6c-b408-446d-90cb-932b04113898-kube-api-access-ns4sd\") pod \"kuadrant-operator-controller-manager-86878c769f-k4922\" (UID: \"3df21c6c-b408-446d-90cb-932b04113898\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"
Jul 23 15:58:57.193477 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:57.193453    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3df21c6c-b408-446d-90cb-932b04113898-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-k4922\" (UID: \"3df21c6c-b408-446d-90cb-932b04113898\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"
Jul 23 15:58:57.205560 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:57.205527    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns4sd\" (UniqueName: \"kubernetes.io/projected/3df21c6c-b408-446d-90cb-932b04113898-kube-api-access-ns4sd\") pod \"kuadrant-operator-controller-manager-86878c769f-k4922\" (UID: \"3df21c6c-b408-446d-90cb-932b04113898\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"
Jul 23 15:58:57.360241 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:57.360157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:57.402163 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:57.402123    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"
Jul 23 15:58:57.460778 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:57.460739    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:58:59.924599 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:58:59.924559    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:00.020828 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:00.020787    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:05.352859 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:05.352827    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:05.463332 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:05.463295    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:06.013696 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:06.013603    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:06.113328 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:06.113280    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:07.955363 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:07.954937    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:59:07.958311 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:07.957452    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2bj8\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:59:07.961348 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:07.961320    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:59:07.963936 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:07.963778    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2bj8\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:59:07.968240 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:07.968200    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="dbfddd98-517e-460b-992c-169db982a719" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:59:07.989197 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:07.989165    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz"]
Jul 23 15:59:07.991257 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:59:07.991221    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb311cc2e_2285_4625_8df7_13b6160e5a3d.slice/crio-d9a797e39378d170744a3edd0cc2e757c271dda0723fdddc229fd1fc17f80294 WatchSource:0}: Error finding container d9a797e39378d170744a3edd0cc2e757c271dda0723fdddc229fd1fc17f80294: Status 404 returned error can't find the container with id d9a797e39378d170744a3edd0cc2e757c271dda0723fdddc229fd1fc17f80294
Jul 23 15:59:07.996005 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:07.995977    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbfddd98-517e-460b-992c-169db982a719-extensions-socket-volume\") pod \"dbfddd98-517e-460b-992c-169db982a719\" (UID: \"dbfddd98-517e-460b-992c-169db982a719\") "
Jul 23 15:59:07.996219 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:07.996203    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cgh6\" (UniqueName: \"kubernetes.io/projected/e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58-kube-api-access-6cgh6\") pod \"e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58\" (UID: \"e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58\") "
Jul 23 15:59:07.996308 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:07.996294    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6j78\" (UniqueName: \"kubernetes.io/projected/dbfddd98-517e-460b-992c-169db982a719-kube-api-access-b6j78\") pod \"dbfddd98-517e-460b-992c-169db982a719\" (UID: \"dbfddd98-517e-460b-992c-169db982a719\") "
Jul 23 15:59:07.996469 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:07.996445    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbfddd98-517e-460b-992c-169db982a719-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dbfddd98-517e-460b-992c-169db982a719" (UID: "dbfddd98-517e-460b-992c-169db982a719"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:59:07.996633 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:07.996615    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbfddd98-517e-460b-992c-169db982a719-extensions-socket-volume\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:59:07.998724 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:07.998697    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbfddd98-517e-460b-992c-169db982a719-kube-api-access-b6j78" (OuterVolumeSpecName: "kube-api-access-b6j78") pod "dbfddd98-517e-460b-992c-169db982a719" (UID: "dbfddd98-517e-460b-992c-169db982a719"). InnerVolumeSpecName "kube-api-access-b6j78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:59:07.998817 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:07.998764    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58-kube-api-access-6cgh6" (OuterVolumeSpecName: "kube-api-access-6cgh6") pod "e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" (UID: "e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58"). InnerVolumeSpecName "kube-api-access-6cgh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:59:08.097770 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.097729    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cgh6\" (UniqueName: \"kubernetes.io/projected/e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58-kube-api-access-6cgh6\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:59:08.097770 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.097763    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6j78\" (UniqueName: \"kubernetes.io/projected/dbfddd98-517e-460b-992c-169db982a719-kube-api-access-b6j78\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:59:08.194384 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.194351    2570 generic.go:356] "Generic (PLEG): container finished" podID="dbfddd98-517e-460b-992c-169db982a719" containerID="be38ca86b310b3536d4d85fff04832e73ac74ff8531780f0a6aea783bdd25f25" exitCode=0
Jul 23 15:59:08.194563 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.194403    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:59:08.194563 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.194435    2570 scope.go:117] "RemoveContainer" containerID="be38ca86b310b3536d4d85fff04832e73ac74ff8531780f0a6aea783bdd25f25"
Jul 23 15:59:08.196276 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.196248    2570 generic.go:356] "Generic (PLEG): container finished" podID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" containerID="dd2c882e825446b615c69c4958fe869af0214c8440bcb27e0c5c64e4f40a5631" exitCode=0
Jul 23 15:59:08.196415 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.196401    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:59:08.197165 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:08.197124    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2bj8\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:59:08.199602 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.199194    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp" event={"ID":"91906f93-a708-4b4f-8134-c5fe83a5beb7","Type":"ContainerStarted","Data":"be87292f6ec60ca7fd10290e956943f1705e120c1cd7d900d8cf85131cdd15cc"}
Jul 23 15:59:08.199602 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:08.199216    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="dbfddd98-517e-460b-992c-169db982a719" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:59:08.201587 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.201560    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz" event={"ID":"b311cc2e-2285-4625-8df7-13b6160e5a3d","Type":"ContainerStarted","Data":"8ce3e485747ad883d1dc194d2c87d6a8b2ba8a3b7db6c20e5bf01644bcfde302"}
Jul 23 15:59:08.201688 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.201610    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz" event={"ID":"b311cc2e-2285-4625-8df7-13b6160e5a3d","Type":"ContainerStarted","Data":"d9a797e39378d170744a3edd0cc2e757c271dda0723fdddc229fd1fc17f80294"}
Jul 23 15:59:08.201688 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.201656    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz"
Jul 23 15:59:08.206231 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.206208    2570 scope.go:117] "RemoveContainer" containerID="be38ca86b310b3536d4d85fff04832e73ac74ff8531780f0a6aea783bdd25f25"
Jul 23 15:59:08.206544 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:08.206521    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be38ca86b310b3536d4d85fff04832e73ac74ff8531780f0a6aea783bdd25f25\": container with ID starting with be38ca86b310b3536d4d85fff04832e73ac74ff8531780f0a6aea783bdd25f25 not found: ID does not exist" containerID="be38ca86b310b3536d4d85fff04832e73ac74ff8531780f0a6aea783bdd25f25"
Jul 23 15:59:08.206633 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.206555    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be38ca86b310b3536d4d85fff04832e73ac74ff8531780f0a6aea783bdd25f25"} err="failed to get container status \"be38ca86b310b3536d4d85fff04832e73ac74ff8531780f0a6aea783bdd25f25\": rpc error: code = NotFound desc = could not find container \"be38ca86b310b3536d4d85fff04832e73ac74ff8531780f0a6aea783bdd25f25\": container with ID starting with be38ca86b310b3536d4d85fff04832e73ac74ff8531780f0a6aea783bdd25f25 not found: ID does not exist"
Jul 23 15:59:08.206633 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.206572    2570 scope.go:117] "RemoveContainer" containerID="dd2c882e825446b615c69c4958fe869af0214c8440bcb27e0c5c64e4f40a5631"
Jul 23 15:59:08.215170 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.215151    2570 scope.go:117] "RemoveContainer" containerID="dd2c882e825446b615c69c4958fe869af0214c8440bcb27e0c5c64e4f40a5631"
Jul 23 15:59:08.215504 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:08.215484    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd2c882e825446b615c69c4958fe869af0214c8440bcb27e0c5c64e4f40a5631\": container with ID starting with dd2c882e825446b615c69c4958fe869af0214c8440bcb27e0c5c64e4f40a5631 not found: ID does not exist" containerID="dd2c882e825446b615c69c4958fe869af0214c8440bcb27e0c5c64e4f40a5631"
Jul 23 15:59:08.215560 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.215513    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd2c882e825446b615c69c4958fe869af0214c8440bcb27e0c5c64e4f40a5631"} err="failed to get container status \"dd2c882e825446b615c69c4958fe869af0214c8440bcb27e0c5c64e4f40a5631\": rpc error: code = NotFound desc = could not find container \"dd2c882e825446b615c69c4958fe869af0214c8440bcb27e0c5c64e4f40a5631\": container with ID starting with dd2c882e825446b615c69c4958fe869af0214c8440bcb27e0c5c64e4f40a5631 not found: ID does not exist"
Jul 23 15:59:08.222468 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.222440    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"]
Jul 23 15:59:08.223731 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:59:08.223700    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3df21c6c_b408_446d_90cb_932b04113898.slice/crio-d594c4a8503862950217915024a707687d0a4bbc3d07e90817ff2cac25d7562d WatchSource:0}: Error finding container d594c4a8503862950217915024a707687d0a4bbc3d07e90817ff2cac25d7562d: Status 404 returned error can't find the container with id d594c4a8503862950217915024a707687d0a4bbc3d07e90817ff2cac25d7562d
Jul 23 15:59:08.223882 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.223835    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-ffzkp" podStartSLOduration=1.6671747670000001 podStartE2EDuration="23.223818619s" totalImagesPullingTime="21.556643852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:58:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:59:08.223098091 +0000 UTC m=+534.146952727" watchObservedRunningTime="2026-07-23 15:59:08.223818619 +0000 UTC m=+534.147673254"
Jul 23 15:59:08.226468 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:08.226443    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2bj8\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:59:08.228677 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.228652    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"]
Jul 23 15:59:08.229200 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:59:08.229175    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3501db_f6fb_4cb2_b39d_30084789d29c.slice/crio-9eae8fe1d22007e4bc6c60b8d94b0755b744414ba6d980f6d52d2ac4882e31a3 WatchSource:0}: Error finding container 9eae8fe1d22007e4bc6c60b8d94b0755b744414ba6d980f6d52d2ac4882e31a3: Status 404 returned error can't find the container with id 9eae8fe1d22007e4bc6c60b8d94b0755b744414ba6d980f6d52d2ac4882e31a3
Jul 23 15:59:08.229963 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:08.229929    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="dbfddd98-517e-460b-992c-169db982a719" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:59:08.233940 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:08.233911    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-f2bj8\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f2bj8"
Jul 23 15:59:08.236492 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:08.236464    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xlk9z\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="dbfddd98-517e-460b-992c-169db982a719" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xlk9z"
Jul 23 15:59:08.259988 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.259927    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz" podStartSLOduration=12.259904428 podStartE2EDuration="12.259904428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:59:08.25612591 +0000 UTC m=+534.179980543" watchObservedRunningTime="2026-07-23 15:59:08.259904428 +0000 UTC m=+534.183759065"
Jul 23 15:59:08.604140 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.604051    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbfddd98-517e-460b-992c-169db982a719" path="/var/lib/kubelet/pods/dbfddd98-517e-460b-992c-169db982a719/volumes"
Jul 23 15:59:08.604390 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.604376    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58" path="/var/lib/kubelet/pods/e9c9698b-8c5d-4e37-a0b4-3e0796d1ae58/volumes"
Jul 23 15:59:08.678207 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:08.678174    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:09.211175 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:09.211133    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922" event={"ID":"3df21c6c-b408-446d-90cb-932b04113898","Type":"ContainerStarted","Data":"16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05"}
Jul 23 15:59:09.211618 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:09.211195    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922" event={"ID":"3df21c6c-b408-446d-90cb-932b04113898","Type":"ContainerStarted","Data":"d594c4a8503862950217915024a707687d0a4bbc3d07e90817ff2cac25d7562d"}
Jul 23 15:59:09.211618 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:09.211273    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"
Jul 23 15:59:09.212781 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:09.212752    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh" event={"ID":"ee3501db-f6fb-4cb2-b39d-30084789d29c","Type":"ContainerStarted","Data":"b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0"}
Jul 23 15:59:09.212902 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:09.212799    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh" event={"ID":"ee3501db-f6fb-4cb2-b39d-30084789d29c","Type":"ContainerStarted","Data":"9eae8fe1d22007e4bc6c60b8d94b0755b744414ba6d980f6d52d2ac4882e31a3"}
Jul 23 15:59:09.213060 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:09.213038    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"
Jul 23 15:59:09.243348 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:09.243290    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922" podStartSLOduration=12.243272476 podStartE2EDuration="12.243272476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:58:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:59:09.241641318 +0000 UTC m=+535.165495952" watchObservedRunningTime="2026-07-23 15:59:09.243272476 +0000 UTC m=+535.167127109"
Jul 23 15:59:09.272235 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:09.272180    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh" podStartSLOduration=13.272164464 podStartE2EDuration="13.272164464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:58:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:59:09.270317387 +0000 UTC m=+535.194172021" watchObservedRunningTime="2026-07-23 15:59:09.272164464 +0000 UTC m=+535.196019097"
Jul 23 15:59:09.535245 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:09.535210    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:10.649270 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:10.649237    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:16.369263 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:16.369224    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:16.428094 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:16.428060    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:17.330294 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:17.330257    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:17.420842 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:17.420811    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:19.214827 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:19.214795    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-j7jbz"
Jul 23 15:59:20.221171 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:20.221142    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"
Jul 23 15:59:20.221703 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:20.221351    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"
Jul 23 15:59:20.331376 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:20.331343    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"]
Jul 23 15:59:20.331626 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:20.331543    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh" podUID="ee3501db-f6fb-4cb2-b39d-30084789d29c" containerName="manager" containerID="cri-o://b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0" gracePeriod=10
Jul 23 15:59:20.613246 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:20.613216    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"
Jul 23 15:59:20.710676 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:20.710644    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee3501db-f6fb-4cb2-b39d-30084789d29c-extensions-socket-volume\") pod \"ee3501db-f6fb-4cb2-b39d-30084789d29c\" (UID: \"ee3501db-f6fb-4cb2-b39d-30084789d29c\") "
Jul 23 15:59:20.710852 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:20.710790    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h85xs\" (UniqueName: \"kubernetes.io/projected/ee3501db-f6fb-4cb2-b39d-30084789d29c-kube-api-access-h85xs\") pod \"ee3501db-f6fb-4cb2-b39d-30084789d29c\" (UID: \"ee3501db-f6fb-4cb2-b39d-30084789d29c\") "
Jul 23 15:59:20.711154 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:20.711117    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee3501db-f6fb-4cb2-b39d-30084789d29c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "ee3501db-f6fb-4cb2-b39d-30084789d29c" (UID: "ee3501db-f6fb-4cb2-b39d-30084789d29c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 15:59:20.712960 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:20.712937    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee3501db-f6fb-4cb2-b39d-30084789d29c-kube-api-access-h85xs" (OuterVolumeSpecName: "kube-api-access-h85xs") pod "ee3501db-f6fb-4cb2-b39d-30084789d29c" (UID: "ee3501db-f6fb-4cb2-b39d-30084789d29c"). InnerVolumeSpecName "kube-api-access-h85xs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:59:20.811555 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:20.811462    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ee3501db-f6fb-4cb2-b39d-30084789d29c-extensions-socket-volume\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:59:20.811555 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:20.811488    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h85xs\" (UniqueName: \"kubernetes.io/projected/ee3501db-f6fb-4cb2-b39d-30084789d29c-kube-api-access-h85xs\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:59:21.279690 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:21.279646    2570 generic.go:356] "Generic (PLEG): container finished" podID="ee3501db-f6fb-4cb2-b39d-30084789d29c" containerID="b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0" exitCode=0
Jul 23 15:59:21.280074 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:21.279701    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh" event={"ID":"ee3501db-f6fb-4cb2-b39d-30084789d29c","Type":"ContainerDied","Data":"b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0"}
Jul 23 15:59:21.280074 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:21.279714    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"
Jul 23 15:59:21.280074 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:21.279784    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh" event={"ID":"ee3501db-f6fb-4cb2-b39d-30084789d29c","Type":"ContainerDied","Data":"9eae8fe1d22007e4bc6c60b8d94b0755b744414ba6d980f6d52d2ac4882e31a3"}
Jul 23 15:59:21.280074 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:21.279816    2570 scope.go:117] "RemoveContainer" containerID="b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0"
Jul 23 15:59:21.289196 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:21.289179    2570 scope.go:117] "RemoveContainer" containerID="b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0"
Jul 23 15:59:21.289518 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:21.289498    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0\": container with ID starting with b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0 not found: ID does not exist" containerID="b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0"
Jul 23 15:59:21.289571 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:21.289527    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0"} err="failed to get container status \"b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0\": rpc error: code = NotFound desc = could not find container \"b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0\": container with ID starting with b86af56ae6932289d12f9d9ee0c7eb4dba49a18e8255cfb8da4507132a64ddf0 not found: ID does not exist"
Jul 23 15:59:21.305173 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:21.305140    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"]
Jul 23 15:59:21.316440 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:21.316414    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2wsfh"]
Jul 23 15:59:21.747670 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:21.747634    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:21.847583 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:21.847545    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:22.605003 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:22.604968    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee3501db-f6fb-4cb2-b39d-30084789d29c" path="/var/lib/kubelet/pods/ee3501db-f6fb-4cb2-b39d-30084789d29c/volumes"
Jul 23 15:59:36.835886 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:36.835852    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:37.057501 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:37.057462    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:38.957921 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:38.957880    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:38.973564 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:38.973519    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"]
Jul 23 15:59:38.973994 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:38.973976    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee3501db-f6fb-4cb2-b39d-30084789d29c" containerName="manager"
Jul 23 15:59:38.974113 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:38.973996    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee3501db-f6fb-4cb2-b39d-30084789d29c" containerName="manager"
Jul 23 15:59:38.974113 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:38.974098    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee3501db-f6fb-4cb2-b39d-30084789d29c" containerName="manager"
Jul 23 15:59:39.063300 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.063259    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"]
Jul 23 15:59:39.063491 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.063320    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"
Jul 23 15:59:39.063491 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.063325    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"]
Jul 23 15:59:39.064182 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.064153    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:39.066443 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.066419    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 23 15:59:39.176271 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.176214    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mltlj\" (UniqueName: \"kubernetes.io/projected/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204-kube-api-access-mltlj\") pod \"limitador-limitador-64c94fd64f-lx8w5\" (UID: \"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"
Jul 23 15:59:39.176442 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.176282    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204-config-file\") pod \"limitador-limitador-64c94fd64f-lx8w5\" (UID: \"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"
Jul 23 15:59:39.277000 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.276967    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204-config-file\") pod \"limitador-limitador-64c94fd64f-lx8w5\" (UID: \"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"
Jul 23 15:59:39.277191 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.277123    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mltlj\" (UniqueName: \"kubernetes.io/projected/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204-kube-api-access-mltlj\") pod \"limitador-limitador-64c94fd64f-lx8w5\" (UID: \"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"
Jul 23 15:59:39.277689 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.277671    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204-config-file\") pod \"limitador-limitador-64c94fd64f-lx8w5\" (UID: \"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"
Jul 23 15:59:39.286285 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.286259    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mltlj\" (UniqueName: \"kubernetes.io/projected/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204-kube-api-access-mltlj\") pod \"limitador-limitador-64c94fd64f-lx8w5\" (UID: \"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"
Jul 23 15:59:39.376525 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.376474    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"
Jul 23 15:59:39.522501 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.522467    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:39.588445 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.588417    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"]
Jul 23 15:59:39.590139 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:59:39.590111    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b43cbf2_8b10_49d8_b433_0fdcd2cb1204.slice/crio-d77221e071ac08e153d42a4f9969bca384d956179aae0c92290da8bd68212dd8 WatchSource:0}: Error finding container d77221e071ac08e153d42a4f9969bca384d956179aae0c92290da8bd68212dd8: Status 404 returned error can't find the container with id d77221e071ac08e153d42a4f9969bca384d956179aae0c92290da8bd68212dd8
Jul 23 15:59:39.774632 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.774599    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jgtnc"]
Jul 23 15:59:39.777890 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.777829    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jgtnc"
Jul 23 15:59:39.781378 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.781356    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kr7p9\""
Jul 23 15:59:39.789202 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.789178    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jgtnc"]
Jul 23 15:59:39.818429 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.818390    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:39.882796 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.882756    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kprhp\" (UniqueName: \"kubernetes.io/projected/19b8c6e2-9940-4c7a-9806-23bf7c143c5d-kube-api-access-kprhp\") pod \"authorino-58cd955675-jgtnc\" (UID: \"19b8c6e2-9940-4c7a-9806-23bf7c143c5d\") " pod="kuadrant-system/authorino-58cd955675-jgtnc"
Jul 23 15:59:39.899701 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.899668    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:39.984271 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.984235    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kprhp\" (UniqueName: \"kubernetes.io/projected/19b8c6e2-9940-4c7a-9806-23bf7c143c5d-kube-api-access-kprhp\") pod \"authorino-58cd955675-jgtnc\" (UID: \"19b8c6e2-9940-4c7a-9806-23bf7c143c5d\") " pod="kuadrant-system/authorino-58cd955675-jgtnc"
Jul 23 15:59:39.996311 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:39.996278    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kprhp\" (UniqueName: \"kubernetes.io/projected/19b8c6e2-9940-4c7a-9806-23bf7c143c5d-kube-api-access-kprhp\") pod \"authorino-58cd955675-jgtnc\" (UID: \"19b8c6e2-9940-4c7a-9806-23bf7c143c5d\") " pod="kuadrant-system/authorino-58cd955675-jgtnc"
Jul 23 15:59:40.087966 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:40.087890    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jgtnc"
Jul 23 15:59:40.260582 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:40.260511    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jgtnc"]
Jul 23 15:59:40.264084 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:59:40.264050    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19b8c6e2_9940_4c7a_9806_23bf7c143c5d.slice/crio-f2228d9fc1df55307e8cb3d5ec026a91a30ae82f3d2293ed16ec57fd017c38b1 WatchSource:0}: Error finding container f2228d9fc1df55307e8cb3d5ec026a91a30ae82f3d2293ed16ec57fd017c38b1: Status 404 returned error can't find the container with id f2228d9fc1df55307e8cb3d5ec026a91a30ae82f3d2293ed16ec57fd017c38b1
Jul 23 15:59:40.407203 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:40.407108    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jgtnc" event={"ID":"19b8c6e2-9940-4c7a-9806-23bf7c143c5d","Type":"ContainerStarted","Data":"f2228d9fc1df55307e8cb3d5ec026a91a30ae82f3d2293ed16ec57fd017c38b1"}
Jul 23 15:59:40.408919 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:40.408875    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5" event={"ID":"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204","Type":"ContainerStarted","Data":"d77221e071ac08e153d42a4f9969bca384d956179aae0c92290da8bd68212dd8"}
Jul 23 15:59:42.425505 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:42.424862    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5" event={"ID":"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204","Type":"ContainerStarted","Data":"2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7"}
Jul 23 15:59:42.425505 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:42.425163    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"
Jul 23 15:59:42.446029 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:42.445954    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5" podStartSLOduration=1.733931459 podStartE2EDuration="4.44593405s" totalImagesPullingTime="2.712002591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:59:42.442787066 +0000 UTC m=+568.366641703" watchObservedRunningTime="2026-07-23 15:59:42.44593405 +0000 UTC m=+568.369788709"
Jul 23 15:59:45.447187 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:45.447146    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jgtnc" event={"ID":"19b8c6e2-9940-4c7a-9806-23bf7c143c5d","Type":"ContainerStarted","Data":"ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a"}
Jul 23 15:59:45.467167 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:45.467107    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jgtnc" podStartSLOduration=2.013853944 podStartE2EDuration="6.467091809s" totalImagesPullingTime="4.453237865s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:59:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:59:45.466083456 +0000 UTC m=+571.389938090" watchObservedRunningTime="2026-07-23 15:59:45.467091809 +0000 UTC m=+571.390946443"
Jul 23 15:59:45.571060 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:45.571006    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jgtnc"]
Jul 23 15:59:46.935993 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:46.935965    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:47.457952 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:47.457901    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jgtnc" podUID="19b8c6e2-9940-4c7a-9806-23bf7c143c5d" containerName="authorino" containerID="cri-o://ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a" gracePeriod=30
Jul 23 15:59:47.723941 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:47.723913    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jgtnc"
Jul 23 15:59:47.861722 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:47.861679    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kprhp\" (UniqueName: \"kubernetes.io/projected/19b8c6e2-9940-4c7a-9806-23bf7c143c5d-kube-api-access-kprhp\") pod \"19b8c6e2-9940-4c7a-9806-23bf7c143c5d\" (UID: \"19b8c6e2-9940-4c7a-9806-23bf7c143c5d\") "
Jul 23 15:59:47.863713 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:47.863689    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b8c6e2-9940-4c7a-9806-23bf7c143c5d-kube-api-access-kprhp" (OuterVolumeSpecName: "kube-api-access-kprhp") pod "19b8c6e2-9940-4c7a-9806-23bf7c143c5d" (UID: "19b8c6e2-9940-4c7a-9806-23bf7c143c5d"). InnerVolumeSpecName "kube-api-access-kprhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:59:47.962865 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:47.962828    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kprhp\" (UniqueName: \"kubernetes.io/projected/19b8c6e2-9940-4c7a-9806-23bf7c143c5d-kube-api-access-kprhp\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:59:48.464138 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:48.464100    2570 generic.go:356] "Generic (PLEG): container finished" podID="19b8c6e2-9940-4c7a-9806-23bf7c143c5d" containerID="ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a" exitCode=0
Jul 23 15:59:48.464319 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:48.464152    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jgtnc"
Jul 23 15:59:48.464319 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:48.464181    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jgtnc" event={"ID":"19b8c6e2-9940-4c7a-9806-23bf7c143c5d","Type":"ContainerDied","Data":"ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a"}
Jul 23 15:59:48.464319 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:48.464234    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jgtnc" event={"ID":"19b8c6e2-9940-4c7a-9806-23bf7c143c5d","Type":"ContainerDied","Data":"f2228d9fc1df55307e8cb3d5ec026a91a30ae82f3d2293ed16ec57fd017c38b1"}
Jul 23 15:59:48.464319 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:48.464259    2570 scope.go:117] "RemoveContainer" containerID="ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a"
Jul 23 15:59:48.495118 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:48.495075    2570 scope.go:117] "RemoveContainer" containerID="ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a"
Jul 23 15:59:48.495525 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:48.495498    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a\": container with ID starting with ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a not found: ID does not exist" containerID="ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a"
Jul 23 15:59:48.495660 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:48.495531    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a"} err="failed to get container status \"ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a\": rpc error: code = NotFound desc = could not find container \"ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a\": container with ID starting with ddab9e07bfb35beb5d59519893cc875d193df3ae5c334927ac0d9a68d0f85b6a not found: ID does not exist"
Jul 23 15:59:48.506262 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:48.506231    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jgtnc"]
Jul 23 15:59:48.511711 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:48.511682    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jgtnc"]
Jul 23 15:59:48.604407 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:48.604372    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19b8c6e2-9940-4c7a-9806-23bf7c143c5d" path="/var/lib/kubelet/pods/19b8c6e2-9940-4c7a-9806-23bf7c143c5d/volumes"
Jul 23 15:59:53.434623 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:53.434594    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"
Jul 23 15:59:53.567230 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:53.567165    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"]
Jul 23 15:59:53.567542 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:53.567496    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5" podUID="4b43cbf2-8b10-49d8-b433-0fdcd2cb1204" containerName="limitador" containerID="cri-o://2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7" gracePeriod=30
Jul 23 15:59:54.125743 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.125709    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"
Jul 23 15:59:54.223197 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.223162    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204-config-file\") pod \"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204\" (UID: \"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204\") "
Jul 23 15:59:54.223376 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.223290    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mltlj\" (UniqueName: \"kubernetes.io/projected/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204-kube-api-access-mltlj\") pod \"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204\" (UID: \"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204\") "
Jul 23 15:59:54.223523 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.223499    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204-config-file" (OuterVolumeSpecName: "config-file") pod "4b43cbf2-8b10-49d8-b433-0fdcd2cb1204" (UID: "4b43cbf2-8b10-49d8-b433-0fdcd2cb1204"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 15:59:54.225369 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.225344    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204-kube-api-access-mltlj" (OuterVolumeSpecName: "kube-api-access-mltlj") pod "4b43cbf2-8b10-49d8-b433-0fdcd2cb1204" (UID: "4b43cbf2-8b10-49d8-b433-0fdcd2cb1204"). InnerVolumeSpecName "kube-api-access-mltlj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 15:59:54.324360 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.324313    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mltlj\" (UniqueName: \"kubernetes.io/projected/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204-kube-api-access-mltlj\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:59:54.324360 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.324354    2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204-config-file\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 15:59:54.499494 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.499455    2570 generic.go:356] "Generic (PLEG): container finished" podID="4b43cbf2-8b10-49d8-b433-0fdcd2cb1204" containerID="2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7" exitCode=0
Jul 23 15:59:54.499959 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.499503    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"
Jul 23 15:59:54.499959 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.499506    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5" event={"ID":"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204","Type":"ContainerDied","Data":"2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7"}
Jul 23 15:59:54.499959 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.499636    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lx8w5" event={"ID":"4b43cbf2-8b10-49d8-b433-0fdcd2cb1204","Type":"ContainerDied","Data":"d77221e071ac08e153d42a4f9969bca384d956179aae0c92290da8bd68212dd8"}
Jul 23 15:59:54.499959 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.499668    2570 scope.go:117] "RemoveContainer" containerID="2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7"
Jul 23 15:59:54.509064 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.509038    2570 scope.go:117] "RemoveContainer" containerID="2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7"
Jul 23 15:59:54.509364 ip-10-0-135-218 kubenswrapper[2570]: E0723 15:59:54.509344    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7\": container with ID starting with 2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7 not found: ID does not exist" containerID="2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7"
Jul 23 15:59:54.509429 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.509373    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7"} err="failed to get container status \"2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7\": rpc error: code = NotFound desc = could not find container \"2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7\": container with ID starting with 2323e4ee708f4b45db562ab3e1634c40232b00d98c0a62b93d60906d29e8fde7 not found: ID does not exist"
Jul 23 15:59:54.533461 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.533427    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"]
Jul 23 15:59:54.537136 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.537108    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lx8w5"]
Jul 23 15:59:54.603004 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:54.602972    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b43cbf2-8b10-49d8-b433-0fdcd2cb1204" path="/var/lib/kubelet/pods/4b43cbf2-8b10-49d8-b433-0fdcd2cb1204/volumes"
Jul 23 15:59:55.081361 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.081327    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:55.163593 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.163560    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:55.571983 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.571944    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"]
Jul 23 15:59:55.572428 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.572330    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b8c6e2-9940-4c7a-9806-23bf7c143c5d" containerName="authorino"
Jul 23 15:59:55.572428 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.572342    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b8c6e2-9940-4c7a-9806-23bf7c143c5d" containerName="authorino"
Jul 23 15:59:55.572428 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.572354    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b43cbf2-8b10-49d8-b433-0fdcd2cb1204" containerName="limitador"
Jul 23 15:59:55.572428 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.572359    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b43cbf2-8b10-49d8-b433-0fdcd2cb1204" containerName="limitador"
Jul 23 15:59:55.572582 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.572432    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b43cbf2-8b10-49d8-b433-0fdcd2cb1204" containerName="limitador"
Jul 23 15:59:55.572582 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.572442    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b8c6e2-9940-4c7a-9806-23bf7c143c5d" containerName="authorino"
Jul 23 15:59:55.576887 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.576867    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"
Jul 23 15:59:55.580944 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.580921    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 23 15:59:55.581253 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.581229    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 23 15:59:55.581462 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.581448    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 23 15:59:55.582341 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.582323    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-zkzht\""
Jul 23 15:59:55.590242 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.590213    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"]
Jul 23 15:59:55.631437 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.631395    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 15:59:55.738780 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.738742    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e3fbe4cb-0bb4-4276-ad86-e1dbf325043f-data\") pod \"postgres-69fb4594cf-h6mnl\" (UID: \"e3fbe4cb-0bb4-4276-ad86-e1dbf325043f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"
Jul 23 15:59:55.738992 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.738800    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz4kc\" (UniqueName: \"kubernetes.io/projected/e3fbe4cb-0bb4-4276-ad86-e1dbf325043f-kube-api-access-jz4kc\") pod \"postgres-69fb4594cf-h6mnl\" (UID: \"e3fbe4cb-0bb4-4276-ad86-e1dbf325043f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"
Jul 23 15:59:55.840119 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.840004    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e3fbe4cb-0bb4-4276-ad86-e1dbf325043f-data\") pod \"postgres-69fb4594cf-h6mnl\" (UID: \"e3fbe4cb-0bb4-4276-ad86-e1dbf325043f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"
Jul 23 15:59:55.840119 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.840095    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz4kc\" (UniqueName: \"kubernetes.io/projected/e3fbe4cb-0bb4-4276-ad86-e1dbf325043f-kube-api-access-jz4kc\") pod \"postgres-69fb4594cf-h6mnl\" (UID: \"e3fbe4cb-0bb4-4276-ad86-e1dbf325043f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"
Jul 23 15:59:55.840376 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.840355    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e3fbe4cb-0bb4-4276-ad86-e1dbf325043f-data\") pod \"postgres-69fb4594cf-h6mnl\" (UID: \"e3fbe4cb-0bb4-4276-ad86-e1dbf325043f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"
Jul 23 15:59:55.850573 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.850532    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz4kc\" (UniqueName: \"kubernetes.io/projected/e3fbe4cb-0bb4-4276-ad86-e1dbf325043f-kube-api-access-jz4kc\") pod \"postgres-69fb4594cf-h6mnl\" (UID: \"e3fbe4cb-0bb4-4276-ad86-e1dbf325043f\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"
Jul 23 15:59:55.887545 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:55.887496    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"
Jul 23 15:59:56.056135 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:56.056107    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"]
Jul 23 15:59:56.057961 ip-10-0-135-218 kubenswrapper[2570]: W0723 15:59:56.057934    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3fbe4cb_0bb4_4276_ad86_e1dbf325043f.slice/crio-97c418636c9e9d5443a6c6912031b918712a4aa391aa4f5bd7db091d0a7de41c WatchSource:0}: Error finding container 97c418636c9e9d5443a6c6912031b918712a4aa391aa4f5bd7db091d0a7de41c: Status 404 returned error can't find the container with id 97c418636c9e9d5443a6c6912031b918712a4aa391aa4f5bd7db091d0a7de41c
Jul 23 15:59:56.512836 ip-10-0-135-218 kubenswrapper[2570]: I0723 15:59:56.512805    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl" event={"ID":"e3fbe4cb-0bb4-4276-ad86-e1dbf325043f","Type":"ContainerStarted","Data":"97c418636c9e9d5443a6c6912031b918712a4aa391aa4f5bd7db091d0a7de41c"}
Jul 23 16:00:12.610538 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:12.610498    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl" event={"ID":"e3fbe4cb-0bb4-4276-ad86-e1dbf325043f","Type":"ContainerStarted","Data":"7806ca57d687e9f57d9b1a7600d0f9c2b908a2ee074a5b73a5959f08430c3e7a"}
Jul 23 16:00:12.611030 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:12.610631    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"
Jul 23 16:00:12.627781 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:12.627722    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl" podStartSLOduration=2.107632495 podStartE2EDuration="17.62770279s" totalImagesPullingTime="15.520070295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:00:12.626494045 +0000 UTC m=+598.550348682" watchObservedRunningTime="2026-07-23 16:00:12.62770279 +0000 UTC m=+598.551557423"
Jul 23 16:00:18.645407 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:18.645378    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-h6mnl"
Jul 23 16:00:18.954993 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:18.954905    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:00:19.102141 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.102102    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:00:19.183567 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.183500    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28hzb"]
Jul 23 16:00:19.190836 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.190810    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28hzb"
Jul 23 16:00:19.194628 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.194605    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-kr7p9\""
Jul 23 16:00:19.199121 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.199097    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28hzb"]
Jul 23 16:00:19.252752 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.252716    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk8qg\" (UniqueName: \"kubernetes.io/projected/04a82cde-8340-40ca-af3f-71e9d80c2c7e-kube-api-access-mk8qg\") pod \"authorino-5d4b67c446-28hzb\" (UID: \"04a82cde-8340-40ca-af3f-71e9d80c2c7e\") " pod="kuadrant-system/authorino-5d4b67c446-28hzb"
Jul 23 16:00:19.354187 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.354150    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk8qg\" (UniqueName: \"kubernetes.io/projected/04a82cde-8340-40ca-af3f-71e9d80c2c7e-kube-api-access-mk8qg\") pod \"authorino-5d4b67c446-28hzb\" (UID: \"04a82cde-8340-40ca-af3f-71e9d80c2c7e\") " pod="kuadrant-system/authorino-5d4b67c446-28hzb"
Jul 23 16:00:19.362357 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.362323    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk8qg\" (UniqueName: \"kubernetes.io/projected/04a82cde-8340-40ca-af3f-71e9d80c2c7e-kube-api-access-mk8qg\") pod \"authorino-5d4b67c446-28hzb\" (UID: \"04a82cde-8340-40ca-af3f-71e9d80c2c7e\") " pod="kuadrant-system/authorino-5d4b67c446-28hzb"
Jul 23 16:00:19.442384 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.442344    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28hzb"]
Jul 23 16:00:19.442631 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.442617    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28hzb"
Jul 23 16:00:19.474419 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.474379    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dd589c9c6-km4kd"]
Jul 23 16:00:19.478077 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.478052    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd589c9c6-km4kd"
Jul 23 16:00:19.485513 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.485484    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dd589c9c6-km4kd"]
Jul 23 16:00:19.556079 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.556047    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lkq8\" (UniqueName: \"kubernetes.io/projected/6c30f8d4-c09e-4cef-8520-08c5399f94d2-kube-api-access-4lkq8\") pod \"authorino-5dd589c9c6-km4kd\" (UID: \"6c30f8d4-c09e-4cef-8520-08c5399f94d2\") " pod="kuadrant-system/authorino-5dd589c9c6-km4kd"
Jul 23 16:00:19.568270 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.568237    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dd589c9c6-km4kd"]
Jul 23 16:00:19.568576 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:00:19.568547    2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-4lkq8], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dd589c9c6-km4kd" podUID="6c30f8d4-c09e-4cef-8520-08c5399f94d2"
Jul 23 16:00:19.589054 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.589022    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28hzb"]
Jul 23 16:00:19.590790 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:00:19.590760    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04a82cde_8340_40ca_af3f_71e9d80c2c7e.slice/crio-cd82fc1f338f4f340acf2c54362b25cdf3b5dbf631a8e331c224db5bfbdbe203 WatchSource:0}: Error finding container cd82fc1f338f4f340acf2c54362b25cdf3b5dbf631a8e331c224db5bfbdbe203: Status 404 returned error can't find the container with id cd82fc1f338f4f340acf2c54362b25cdf3b5dbf631a8e331c224db5bfbdbe203
Jul 23 16:00:19.596330 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.596300    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66b7c849fb-r2226"]
Jul 23 16:00:19.599630 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.599609    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66b7c849fb-r2226"
Jul 23 16:00:19.602138 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.602117    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 23 16:00:19.607511 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.607257    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66b7c849fb-r2226"]
Jul 23 16:00:19.650165 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.650134    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd589c9c6-km4kd"
Jul 23 16:00:19.650165 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.650164    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28hzb" event={"ID":"04a82cde-8340-40ca-af3f-71e9d80c2c7e","Type":"ContainerStarted","Data":"cd82fc1f338f4f340acf2c54362b25cdf3b5dbf631a8e331c224db5bfbdbe203"}
Jul 23 16:00:19.655881 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.655859    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd589c9c6-km4kd"
Jul 23 16:00:19.657336 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.657317    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lkq8\" (UniqueName: \"kubernetes.io/projected/6c30f8d4-c09e-4cef-8520-08c5399f94d2-kube-api-access-4lkq8\") pod \"authorino-5dd589c9c6-km4kd\" (UID: \"6c30f8d4-c09e-4cef-8520-08c5399f94d2\") " pod="kuadrant-system/authorino-5dd589c9c6-km4kd"
Jul 23 16:00:19.657411 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.657375    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8cc2ec70-9434-4d64-b650-33e9c00e20a8-tls-cert\") pod \"authorino-66b7c849fb-r2226\" (UID: \"8cc2ec70-9434-4d64-b650-33e9c00e20a8\") " pod="kuadrant-system/authorino-66b7c849fb-r2226"
Jul 23 16:00:19.657453 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.657409    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx8qp\" (UniqueName: \"kubernetes.io/projected/8cc2ec70-9434-4d64-b650-33e9c00e20a8-kube-api-access-bx8qp\") pod \"authorino-66b7c849fb-r2226\" (UID: \"8cc2ec70-9434-4d64-b650-33e9c00e20a8\") " pod="kuadrant-system/authorino-66b7c849fb-r2226"
Jul 23 16:00:19.666904 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.666882    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lkq8\" (UniqueName: \"kubernetes.io/projected/6c30f8d4-c09e-4cef-8520-08c5399f94d2-kube-api-access-4lkq8\") pod \"authorino-5dd589c9c6-km4kd\" (UID: \"6c30f8d4-c09e-4cef-8520-08c5399f94d2\") " pod="kuadrant-system/authorino-5dd589c9c6-km4kd"
Jul 23 16:00:19.758589 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.758555    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4lkq8\" (UniqueName: \"kubernetes.io/projected/6c30f8d4-c09e-4cef-8520-08c5399f94d2-kube-api-access-4lkq8\") pod \"6c30f8d4-c09e-4cef-8520-08c5399f94d2\" (UID: \"6c30f8d4-c09e-4cef-8520-08c5399f94d2\") "
Jul 23 16:00:19.758768 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.758753    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx8qp\" (UniqueName: \"kubernetes.io/projected/8cc2ec70-9434-4d64-b650-33e9c00e20a8-kube-api-access-bx8qp\") pod \"authorino-66b7c849fb-r2226\" (UID: \"8cc2ec70-9434-4d64-b650-33e9c00e20a8\") " pod="kuadrant-system/authorino-66b7c849fb-r2226"
Jul 23 16:00:19.758871 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.758856    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8cc2ec70-9434-4d64-b650-33e9c00e20a8-tls-cert\") pod \"authorino-66b7c849fb-r2226\" (UID: \"8cc2ec70-9434-4d64-b650-33e9c00e20a8\") " pod="kuadrant-system/authorino-66b7c849fb-r2226"
Jul 23 16:00:19.766375 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.766340    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c30f8d4-c09e-4cef-8520-08c5399f94d2-kube-api-access-4lkq8" (OuterVolumeSpecName: "kube-api-access-4lkq8") pod "6c30f8d4-c09e-4cef-8520-08c5399f94d2" (UID: "6c30f8d4-c09e-4cef-8520-08c5399f94d2"). InnerVolumeSpecName "kube-api-access-4lkq8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:00:19.767076 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.767047    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8cc2ec70-9434-4d64-b650-33e9c00e20a8-tls-cert\") pod \"authorino-66b7c849fb-r2226\" (UID: \"8cc2ec70-9434-4d64-b650-33e9c00e20a8\") " pod="kuadrant-system/authorino-66b7c849fb-r2226"
Jul 23 16:00:19.768718 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.768697    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx8qp\" (UniqueName: \"kubernetes.io/projected/8cc2ec70-9434-4d64-b650-33e9c00e20a8-kube-api-access-bx8qp\") pod \"authorino-66b7c849fb-r2226\" (UID: \"8cc2ec70-9434-4d64-b650-33e9c00e20a8\") " pod="kuadrant-system/authorino-66b7c849fb-r2226"
Jul 23 16:00:19.859844 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.859754    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4lkq8\" (UniqueName: \"kubernetes.io/projected/6c30f8d4-c09e-4cef-8520-08c5399f94d2-kube-api-access-4lkq8\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:00:19.910713 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:19.910672    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66b7c849fb-r2226"
Jul 23 16:00:20.048066 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.048040    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66b7c849fb-r2226"]
Jul 23 16:00:20.049466 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:00:20.049442    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8cc2ec70_9434_4d64_b650_33e9c00e20a8.slice/crio-8482e7ce556210f8b177d4f8e76944a63a8fe838306c5dd92583b985f8b5d382 WatchSource:0}: Error finding container 8482e7ce556210f8b177d4f8e76944a63a8fe838306c5dd92583b985f8b5d382: Status 404 returned error can't find the container with id 8482e7ce556210f8b177d4f8e76944a63a8fe838306c5dd92583b985f8b5d382
Jul 23 16:00:20.659222 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.659123    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28hzb" event={"ID":"04a82cde-8340-40ca-af3f-71e9d80c2c7e","Type":"ContainerStarted","Data":"e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234"}
Jul 23 16:00:20.659595 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.659232    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-28hzb" podUID="04a82cde-8340-40ca-af3f-71e9d80c2c7e" containerName="authorino" containerID="cri-o://e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234" gracePeriod=30
Jul 23 16:00:20.662466 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.662437    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd589c9c6-km4kd"
Jul 23 16:00:20.662853 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.662823    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66b7c849fb-r2226" event={"ID":"8cc2ec70-9434-4d64-b650-33e9c00e20a8","Type":"ContainerStarted","Data":"f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b"}
Jul 23 16:00:20.662952 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.662868    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66b7c849fb-r2226" event={"ID":"8cc2ec70-9434-4d64-b650-33e9c00e20a8","Type":"ContainerStarted","Data":"8482e7ce556210f8b177d4f8e76944a63a8fe838306c5dd92583b985f8b5d382"}
Jul 23 16:00:20.677810 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.677754    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-28hzb" podStartSLOduration=0.73026111 podStartE2EDuration="1.677733434s" totalImagesPullingTime="947.472324ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:00:20.676469073 +0000 UTC m=+606.600323708" watchObservedRunningTime="2026-07-23 16:00:20.677733434 +0000 UTC m=+606.601588067"
Jul 23 16:00:20.706310 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.706278    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dd589c9c6-km4kd"]
Jul 23 16:00:20.711963 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.711925    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dd589c9c6-km4kd"]
Jul 23 16:00:20.724699 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.724636    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66b7c849fb-r2226" podStartSLOduration=1.277951483 podStartE2EDuration="1.724614071s" totalImagesPullingTime="446.662588ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:00:20.723246539 +0000 UTC m=+606.647101174" watchObservedRunningTime="2026-07-23 16:00:20.724614071 +0000 UTC m=+606.648468707"
Jul 23 16:00:20.913050 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.912957    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28hzb"
Jul 23 16:00:20.971806 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.971762    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk8qg\" (UniqueName: \"kubernetes.io/projected/04a82cde-8340-40ca-af3f-71e9d80c2c7e-kube-api-access-mk8qg\") pod \"04a82cde-8340-40ca-af3f-71e9d80c2c7e\" (UID: \"04a82cde-8340-40ca-af3f-71e9d80c2c7e\") "
Jul 23 16:00:20.973899 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:20.973874    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a82cde-8340-40ca-af3f-71e9d80c2c7e-kube-api-access-mk8qg" (OuterVolumeSpecName: "kube-api-access-mk8qg") pod "04a82cde-8340-40ca-af3f-71e9d80c2c7e" (UID: "04a82cde-8340-40ca-af3f-71e9d80c2c7e"). InnerVolumeSpecName "kube-api-access-mk8qg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:00:21.072779 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:21.072739    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk8qg\" (UniqueName: \"kubernetes.io/projected/04a82cde-8340-40ca-af3f-71e9d80c2c7e-kube-api-access-mk8qg\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:00:21.670151 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:21.670063    2570 generic.go:356] "Generic (PLEG): container finished" podID="04a82cde-8340-40ca-af3f-71e9d80c2c7e" containerID="e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234" exitCode=0
Jul 23 16:00:21.670151 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:21.670097    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-28hzb"
Jul 23 16:00:21.670565 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:21.670148    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28hzb" event={"ID":"04a82cde-8340-40ca-af3f-71e9d80c2c7e","Type":"ContainerDied","Data":"e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234"}
Jul 23 16:00:21.670565 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:21.670182    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-28hzb" event={"ID":"04a82cde-8340-40ca-af3f-71e9d80c2c7e","Type":"ContainerDied","Data":"cd82fc1f338f4f340acf2c54362b25cdf3b5dbf631a8e331c224db5bfbdbe203"}
Jul 23 16:00:21.670565 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:21.670199    2570 scope.go:117] "RemoveContainer" containerID="e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234"
Jul 23 16:00:21.680471 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:21.680449    2570 scope.go:117] "RemoveContainer" containerID="e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234"
Jul 23 16:00:21.680790 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:00:21.680763    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234\": container with ID starting with e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234 not found: ID does not exist" containerID="e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234"
Jul 23 16:00:21.680845 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:21.680801    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234"} err="failed to get container status \"e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234\": rpc error: code = NotFound desc = could not find container \"e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234\": container with ID starting with e444eed4b5ac64b7c21b262b33c47de59ada4531f90484120372f64cc191e234 not found: ID does not exist"
Jul 23 16:00:21.692532 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:21.692494    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28hzb"]
Jul 23 16:00:21.696403 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:21.696375    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-28hzb"]
Jul 23 16:00:22.603442 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:22.603407    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04a82cde-8340-40ca-af3f-71e9d80c2c7e" path="/var/lib/kubelet/pods/04a82cde-8340-40ca-af3f-71e9d80c2c7e/volumes"
Jul 23 16:00:22.603750 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:22.603737    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c30f8d4-c09e-4cef-8520-08c5399f94d2" path="/var/lib/kubelet/pods/6c30f8d4-c09e-4cef-8520-08c5399f94d2/volumes"
Jul 23 16:00:25.552174 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.552141    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:00:25.584061 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.584022    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7965fc9bc9-lp4h4"]
Jul 23 16:00:25.584514 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.584490    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a82cde-8340-40ca-af3f-71e9d80c2c7e" containerName="authorino"
Jul 23 16:00:25.584569 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.584517    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a82cde-8340-40ca-af3f-71e9d80c2c7e" containerName="authorino"
Jul 23 16:00:25.584608 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.584581    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a82cde-8340-40ca-af3f-71e9d80c2c7e" containerName="authorino"
Jul 23 16:00:25.587750 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.587730    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7965fc9bc9-lp4h4"
Jul 23 16:00:25.590969 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.590946    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 16:00:25.591267 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.591253    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w9pvj\""
Jul 23 16:00:25.591597 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.591583    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 16:00:25.599061 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.599035    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7965fc9bc9-lp4h4"]
Jul 23 16:00:25.665976 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.665943    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:00:25.719279 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.719237    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff1497d7-a41e-4adc-a792-83fd21c06244-webhook-cert\") pod \"maas-controller-7965fc9bc9-lp4h4\" (UID: \"ff1497d7-a41e-4adc-a792-83fd21c06244\") " pod="opendatahub/maas-controller-7965fc9bc9-lp4h4"
Jul 23 16:00:25.719473 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.719358    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cn7qj\" (UniqueName: \"kubernetes.io/projected/ff1497d7-a41e-4adc-a792-83fd21c06244-kube-api-access-cn7qj\") pod \"maas-controller-7965fc9bc9-lp4h4\" (UID: \"ff1497d7-a41e-4adc-a792-83fd21c06244\") " pod="opendatahub/maas-controller-7965fc9bc9-lp4h4"
Jul 23 16:00:25.769863 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.769814    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:00:25.785621 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.785584    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-688fcc8886-zgxq7"]
Jul 23 16:00:25.787990 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.787973    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688fcc8886-zgxq7"
Jul 23 16:00:25.800401 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.800364    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-688fcc8886-zgxq7"]
Jul 23 16:00:25.820064 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.819960    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff1497d7-a41e-4adc-a792-83fd21c06244-webhook-cert\") pod \"maas-controller-7965fc9bc9-lp4h4\" (UID: \"ff1497d7-a41e-4adc-a792-83fd21c06244\") " pod="opendatahub/maas-controller-7965fc9bc9-lp4h4"
Jul 23 16:00:25.820064 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.820002    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cn7qj\" (UniqueName: \"kubernetes.io/projected/ff1497d7-a41e-4adc-a792-83fd21c06244-kube-api-access-cn7qj\") pod \"maas-controller-7965fc9bc9-lp4h4\" (UID: \"ff1497d7-a41e-4adc-a792-83fd21c06244\") " pod="opendatahub/maas-controller-7965fc9bc9-lp4h4"
Jul 23 16:00:25.822416 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.822385    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff1497d7-a41e-4adc-a792-83fd21c06244-webhook-cert\") pod \"maas-controller-7965fc9bc9-lp4h4\" (UID: \"ff1497d7-a41e-4adc-a792-83fd21c06244\") " pod="opendatahub/maas-controller-7965fc9bc9-lp4h4"
Jul 23 16:00:25.828233 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.828212    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cn7qj\" (UniqueName: \"kubernetes.io/projected/ff1497d7-a41e-4adc-a792-83fd21c06244-kube-api-access-cn7qj\") pod \"maas-controller-7965fc9bc9-lp4h4\" (UID: \"ff1497d7-a41e-4adc-a792-83fd21c06244\") " pod="opendatahub/maas-controller-7965fc9bc9-lp4h4"
Jul 23 16:00:25.838962 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.838933    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:00:25.898582 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.898544    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7965fc9bc9-lp4h4"
Jul 23 16:00:25.920722 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.920685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50e1c39f-d56b-4cf1-acaa-bbc557addccd-webhook-cert\") pod \"maas-controller-688fcc8886-zgxq7\" (UID: \"50e1c39f-d56b-4cf1-acaa-bbc557addccd\") " pod="opendatahub/maas-controller-688fcc8886-zgxq7"
Jul 23 16:00:25.920863 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:25.920743    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh8f8\" (UniqueName: \"kubernetes.io/projected/50e1c39f-d56b-4cf1-acaa-bbc557addccd-kube-api-access-jh8f8\") pod \"maas-controller-688fcc8886-zgxq7\" (UID: \"50e1c39f-d56b-4cf1-acaa-bbc557addccd\") " pod="opendatahub/maas-controller-688fcc8886-zgxq7"
Jul 23 16:00:26.022290 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:26.022255    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50e1c39f-d56b-4cf1-acaa-bbc557addccd-webhook-cert\") pod \"maas-controller-688fcc8886-zgxq7\" (UID: \"50e1c39f-d56b-4cf1-acaa-bbc557addccd\") " pod="opendatahub/maas-controller-688fcc8886-zgxq7"
Jul 23 16:00:26.022441 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:26.022296    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh8f8\" (UniqueName: \"kubernetes.io/projected/50e1c39f-d56b-4cf1-acaa-bbc557addccd-kube-api-access-jh8f8\") pod \"maas-controller-688fcc8886-zgxq7\" (UID: \"50e1c39f-d56b-4cf1-acaa-bbc557addccd\") " pod="opendatahub/maas-controller-688fcc8886-zgxq7"
Jul 23 16:00:26.025163 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:26.025134    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50e1c39f-d56b-4cf1-acaa-bbc557addccd-webhook-cert\") pod \"maas-controller-688fcc8886-zgxq7\" (UID: \"50e1c39f-d56b-4cf1-acaa-bbc557addccd\") " pod="opendatahub/maas-controller-688fcc8886-zgxq7"
Jul 23 16:00:26.030344 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:26.030324    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh8f8\" (UniqueName: \"kubernetes.io/projected/50e1c39f-d56b-4cf1-acaa-bbc557addccd-kube-api-access-jh8f8\") pod \"maas-controller-688fcc8886-zgxq7\" (UID: \"50e1c39f-d56b-4cf1-acaa-bbc557addccd\") " pod="opendatahub/maas-controller-688fcc8886-zgxq7"
Jul 23 16:00:26.042920 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:26.042896    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7965fc9bc9-lp4h4"]
Jul 23 16:00:26.044709 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:00:26.044679    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff1497d7_a41e_4adc_a792_83fd21c06244.slice/crio-e4097ffc587e2f5c454edfd60ae3e1e3cdef75d281fbff327295b3f43dc3c095 WatchSource:0}: Error finding container e4097ffc587e2f5c454edfd60ae3e1e3cdef75d281fbff327295b3f43dc3c095: Status 404 returned error can't find the container with id e4097ffc587e2f5c454edfd60ae3e1e3cdef75d281fbff327295b3f43dc3c095
Jul 23 16:00:26.099092 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:26.098971    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688fcc8886-zgxq7"
Jul 23 16:00:26.257450 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:26.257421    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-688fcc8886-zgxq7"]
Jul 23 16:00:26.258991 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:00:26.258968    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50e1c39f_d56b_4cf1_acaa_bbc557addccd.slice/crio-0f2461c59568df6ff2243dcecf5833e07dee368082cd7080d6f91b70d8d934b7 WatchSource:0}: Error finding container 0f2461c59568df6ff2243dcecf5833e07dee368082cd7080d6f91b70d8d934b7: Status 404 returned error can't find the container with id 0f2461c59568df6ff2243dcecf5833e07dee368082cd7080d6f91b70d8d934b7
Jul 23 16:00:26.703897 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:26.703854    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7965fc9bc9-lp4h4" event={"ID":"ff1497d7-a41e-4adc-a792-83fd21c06244","Type":"ContainerStarted","Data":"e4097ffc587e2f5c454edfd60ae3e1e3cdef75d281fbff327295b3f43dc3c095"}
Jul 23 16:00:26.705060 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:26.705035    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688fcc8886-zgxq7" event={"ID":"50e1c39f-d56b-4cf1-acaa-bbc557addccd","Type":"ContainerStarted","Data":"0f2461c59568df6ff2243dcecf5833e07dee368082cd7080d6f91b70d8d934b7"}
Jul 23 16:00:28.832661 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:28.832621    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:00:29.731697 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:29.731658    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688fcc8886-zgxq7" event={"ID":"50e1c39f-d56b-4cf1-acaa-bbc557addccd","Type":"ContainerStarted","Data":"4dae715ae562d1f4aa4e2231e70147d0ef2da7bdd4e454319aeb5a312180a260"}
Jul 23 16:00:29.731970 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:29.731732    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-688fcc8886-zgxq7"
Jul 23 16:00:29.733330 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:29.733302    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7965fc9bc9-lp4h4" event={"ID":"ff1497d7-a41e-4adc-a792-83fd21c06244","Type":"ContainerStarted","Data":"0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3"}
Jul 23 16:00:29.733445 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:29.733381    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7965fc9bc9-lp4h4"
Jul 23 16:00:29.754439 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:29.754376    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-688fcc8886-zgxq7" podStartSLOduration=2.250287788 podStartE2EDuration="4.754357467s" totalImagesPullingTime="2.504069679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:00:29.752673974 +0000 UTC m=+615.676528609" watchObservedRunningTime="2026-07-23 16:00:29.754357467 +0000 UTC m=+615.678212097"
Jul 23 16:00:29.779772 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:29.779708    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7965fc9bc9-lp4h4" podStartSLOduration=2.17550087 podStartE2EDuration="4.779688942s" totalImagesPullingTime="2.604188072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:00:29.778995251 +0000 UTC m=+615.702849886" watchObservedRunningTime="2026-07-23 16:00:29.779688942 +0000 UTC m=+615.703543630"
Jul 23 16:00:30.667433 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:30.667404    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:00:40.740654 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:40.740439    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-688fcc8886-zgxq7"
Jul 23 16:00:40.741048 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:40.740690    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7965fc9bc9-lp4h4"
Jul 23 16:00:40.811051 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:40.810994    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7965fc9bc9-lp4h4"]
Jul 23 16:00:40.811279 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:40.811251    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7965fc9bc9-lp4h4" podUID="ff1497d7-a41e-4adc-a792-83fd21c06244" containerName="manager" containerID="cri-o://0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3" gracePeriod=30
Jul 23 16:00:41.073210 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.073181    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7965fc9bc9-lp4h4"
Jul 23 16:00:41.268544 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.268497    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cn7qj\" (UniqueName: \"kubernetes.io/projected/ff1497d7-a41e-4adc-a792-83fd21c06244-kube-api-access-cn7qj\") pod \"ff1497d7-a41e-4adc-a792-83fd21c06244\" (UID: \"ff1497d7-a41e-4adc-a792-83fd21c06244\") "
Jul 23 16:00:41.268739 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.268645    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff1497d7-a41e-4adc-a792-83fd21c06244-webhook-cert\") pod \"ff1497d7-a41e-4adc-a792-83fd21c06244\" (UID: \"ff1497d7-a41e-4adc-a792-83fd21c06244\") "
Jul 23 16:00:41.270852 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.270812    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff1497d7-a41e-4adc-a792-83fd21c06244-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ff1497d7-a41e-4adc-a792-83fd21c06244" (UID: "ff1497d7-a41e-4adc-a792-83fd21c06244"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:00:41.270852 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.270836    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff1497d7-a41e-4adc-a792-83fd21c06244-kube-api-access-cn7qj" (OuterVolumeSpecName: "kube-api-access-cn7qj") pod "ff1497d7-a41e-4adc-a792-83fd21c06244" (UID: "ff1497d7-a41e-4adc-a792-83fd21c06244"). InnerVolumeSpecName "kube-api-access-cn7qj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:00:41.370201 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.370113    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff1497d7-a41e-4adc-a792-83fd21c06244-webhook-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:00:41.370201 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.370146    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cn7qj\" (UniqueName: \"kubernetes.io/projected/ff1497d7-a41e-4adc-a792-83fd21c06244-kube-api-access-cn7qj\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:00:41.806429 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.806393    2570 generic.go:356] "Generic (PLEG): container finished" podID="ff1497d7-a41e-4adc-a792-83fd21c06244" containerID="0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3" exitCode=0
Jul 23 16:00:41.806429 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.806432    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7965fc9bc9-lp4h4" event={"ID":"ff1497d7-a41e-4adc-a792-83fd21c06244","Type":"ContainerDied","Data":"0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3"}
Jul 23 16:00:41.806917 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.806446    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7965fc9bc9-lp4h4"
Jul 23 16:00:41.806917 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.806476    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7965fc9bc9-lp4h4" event={"ID":"ff1497d7-a41e-4adc-a792-83fd21c06244","Type":"ContainerDied","Data":"e4097ffc587e2f5c454edfd60ae3e1e3cdef75d281fbff327295b3f43dc3c095"}
Jul 23 16:00:41.806917 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.806501    2570 scope.go:117] "RemoveContainer" containerID="0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3"
Jul 23 16:00:41.816749 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.816588    2570 scope.go:117] "RemoveContainer" containerID="0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3"
Jul 23 16:00:41.816943 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:00:41.816922    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3\": container with ID starting with 0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3 not found: ID does not exist" containerID="0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3"
Jul 23 16:00:41.816984 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.816955    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3"} err="failed to get container status \"0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3\": rpc error: code = NotFound desc = could not find container \"0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3\": container with ID starting with 0ab0a8532671add25c336dacafd4199c75f4fc501b2b3cfdb868cd1d9e5267a3 not found: ID does not exist"
Jul 23 16:00:41.831924 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.831889    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7965fc9bc9-lp4h4"]
Jul 23 16:00:41.836488 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:41.836455    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7965fc9bc9-lp4h4"]
Jul 23 16:00:42.603240 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:42.603207    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff1497d7-a41e-4adc-a792-83fd21c06244" path="/var/lib/kubelet/pods/ff1497d7-a41e-4adc-a792-83fd21c06244/volumes"
Jul 23 16:00:57.629852 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:57.629813    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:00:59.833047 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:59.832990    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:00:59.935692 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:00:59.935659    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:01:00.469166 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.469133    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:01:00.679005 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.678968    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:01:00.753728 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.753646    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"]
Jul 23 16:01:00.754064 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.754050    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff1497d7-a41e-4adc-a792-83fd21c06244" containerName="manager"
Jul 23 16:01:00.754120 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.754065    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff1497d7-a41e-4adc-a792-83fd21c06244" containerName="manager"
Jul 23 16:01:00.754165 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.754151    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff1497d7-a41e-4adc-a792-83fd21c06244" containerName="manager"
Jul 23 16:01:00.774490 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.774461    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"]
Jul 23 16:01:00.774647 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.774561    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:00.778836 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.778806    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 23 16:01:00.778836 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.778831    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lzv56\""
Jul 23 16:01:00.840073 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.840043    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa72918-35bb-428d-b750-fb57550cf685-openshift-service-ca\") pod \"maas-api-5bfcc994b9-sqhlc\" (UID: \"1aa72918-35bb-428d-b750-fb57550cf685\") " pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:00.840458 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.840110    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94c6s\" (UniqueName: \"kubernetes.io/projected/1aa72918-35bb-428d-b750-fb57550cf685-kube-api-access-94c6s\") pod \"maas-api-5bfcc994b9-sqhlc\" (UID: \"1aa72918-35bb-428d-b750-fb57550cf685\") " pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:00.840458 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.840155    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa72918-35bb-428d-b750-fb57550cf685-maas-api-tls\") pod \"maas-api-5bfcc994b9-sqhlc\" (UID: \"1aa72918-35bb-428d-b750-fb57550cf685\") " pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:00.941156 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.941120    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94c6s\" (UniqueName: \"kubernetes.io/projected/1aa72918-35bb-428d-b750-fb57550cf685-kube-api-access-94c6s\") pod \"maas-api-5bfcc994b9-sqhlc\" (UID: \"1aa72918-35bb-428d-b750-fb57550cf685\") " pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:00.941322 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.941161    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa72918-35bb-428d-b750-fb57550cf685-maas-api-tls\") pod \"maas-api-5bfcc994b9-sqhlc\" (UID: \"1aa72918-35bb-428d-b750-fb57550cf685\") " pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:00.941322 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.941228    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa72918-35bb-428d-b750-fb57550cf685-openshift-service-ca\") pod \"maas-api-5bfcc994b9-sqhlc\" (UID: \"1aa72918-35bb-428d-b750-fb57550cf685\") " pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:00.941846 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.941824    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1aa72918-35bb-428d-b750-fb57550cf685-openshift-service-ca\") pod \"maas-api-5bfcc994b9-sqhlc\" (UID: \"1aa72918-35bb-428d-b750-fb57550cf685\") " pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:00.943642 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.943622    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1aa72918-35bb-428d-b750-fb57550cf685-maas-api-tls\") pod \"maas-api-5bfcc994b9-sqhlc\" (UID: \"1aa72918-35bb-428d-b750-fb57550cf685\") " pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:00.954916 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:00.954888    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94c6s\" (UniqueName: \"kubernetes.io/projected/1aa72918-35bb-428d-b750-fb57550cf685-kube-api-access-94c6s\") pod \"maas-api-5bfcc994b9-sqhlc\" (UID: \"1aa72918-35bb-428d-b750-fb57550cf685\") " pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:01.085717 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.085622    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:01.171202 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.171171    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:01:01.260274 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.260242    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:01:01.344875 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.344793    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-mklln"]
Jul 23 16:01:01.348755 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.348737    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln"
Jul 23 16:01:01.352667 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.352642    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-snhfh\""
Jul 23 16:01:01.352974 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.352955    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 23 16:01:01.360037 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.359995    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-mklln"]
Jul 23 16:01:01.445506 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.445467    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktwgq\" (UniqueName: \"kubernetes.io/projected/d3e29cb9-b084-4916-b58a-f61d391dc80f-kube-api-access-ktwgq\") pod \"payload-pre-processing-7677b774bb-mklln\" (UID: \"d3e29cb9-b084-4916-b58a-f61d391dc80f\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln"
Jul 23 16:01:01.445672 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.445612    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3e29cb9-b084-4916-b58a-f61d391dc80f-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-mklln\" (UID: \"d3e29cb9-b084-4916-b58a-f61d391dc80f\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln"
Jul 23 16:01:01.461668 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.461640    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"]
Jul 23 16:01:01.464281 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:01:01.464253    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa72918_35bb_428d_b750_fb57550cf685.slice/crio-3f9623197cd6fdb788059cc84f7ddaa41ad8738066fa76182aac3d63559db9d6 WatchSource:0}: Error finding container 3f9623197cd6fdb788059cc84f7ddaa41ad8738066fa76182aac3d63559db9d6: Status 404 returned error can't find the container with id 3f9623197cd6fdb788059cc84f7ddaa41ad8738066fa76182aac3d63559db9d6
Jul 23 16:01:01.466050 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.465887    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:01:01.547028 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.546982    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktwgq\" (UniqueName: \"kubernetes.io/projected/d3e29cb9-b084-4916-b58a-f61d391dc80f-kube-api-access-ktwgq\") pod \"payload-pre-processing-7677b774bb-mklln\" (UID: \"d3e29cb9-b084-4916-b58a-f61d391dc80f\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln"
Jul 23 16:01:01.547226 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.547149    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3e29cb9-b084-4916-b58a-f61d391dc80f-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-mklln\" (UID: \"d3e29cb9-b084-4916-b58a-f61d391dc80f\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln"
Jul 23 16:01:01.547910 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.547891    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3e29cb9-b084-4916-b58a-f61d391dc80f-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-mklln\" (UID: \"d3e29cb9-b084-4916-b58a-f61d391dc80f\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln"
Jul 23 16:01:01.558170 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.558143    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktwgq\" (UniqueName: \"kubernetes.io/projected/d3e29cb9-b084-4916-b58a-f61d391dc80f-kube-api-access-ktwgq\") pod \"payload-pre-processing-7677b774bb-mklln\" (UID: \"d3e29cb9-b084-4916-b58a-f61d391dc80f\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln"
Jul 23 16:01:01.660935 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.660851    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln"
Jul 23 16:01:01.815163 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.815135    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-mklln"]
Jul 23 16:01:01.816667 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:01:01.816637    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e29cb9_b084_4916_b58a_f61d391dc80f.slice/crio-f55146647b0e42c99b9b7197a747453aeacc52f951877456c74dc6f5f83c5d00 WatchSource:0}: Error finding container f55146647b0e42c99b9b7197a747453aeacc52f951877456c74dc6f5f83c5d00: Status 404 returned error can't find the container with id f55146647b0e42c99b9b7197a747453aeacc52f951877456c74dc6f5f83c5d00
Jul 23 16:01:01.927941 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.927836    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln" event={"ID":"d3e29cb9-b084-4916-b58a-f61d391dc80f","Type":"ContainerStarted","Data":"f55146647b0e42c99b9b7197a747453aeacc52f951877456c74dc6f5f83c5d00"}
Jul 23 16:01:01.929204 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:01.929169    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc" event={"ID":"1aa72918-35bb-428d-b750-fb57550cf685","Type":"ContainerStarted","Data":"3f9623197cd6fdb788059cc84f7ddaa41ad8738066fa76182aac3d63559db9d6"}
Jul 23 16:01:03.944128 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:03.944093    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc" event={"ID":"1aa72918-35bb-428d-b750-fb57550cf685","Type":"ContainerStarted","Data":"61b42af5425636aac8ad52c861ce5bf05383529d4305633463239bad7e97c01f"}
Jul 23 16:01:03.944599 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:03.944246    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:03.966204 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:03.966131    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc" podStartSLOduration=2.2821161930000002 podStartE2EDuration="3.966108554s" totalImagesPullingTime="1.683992361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:01:03.962125479 +0000 UTC m=+649.885980115" watchObservedRunningTime="2026-07-23 16:01:03.966108554 +0000 UTC m=+649.889963189"
Jul 23 16:01:05.956726 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:05.956689    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln" event={"ID":"d3e29cb9-b084-4916-b58a-f61d391dc80f","Type":"ContainerStarted","Data":"669b6fe7690c18a6d62be68a5fa2da71f318d457e57b9e14037a139c824e20a3"}
Jul 23 16:01:05.957167 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:05.956882    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln"
Jul 23 16:01:05.989298 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:05.989245    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln" podStartSLOduration=1.773182356 podStartE2EDuration="4.989227443s" totalImagesPullingTime="3.216045087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:01:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:01:05.987191618 +0000 UTC m=+651.911046253" watchObservedRunningTime="2026-07-23 16:01:05.989227443 +0000 UTC m=+651.913082076"
Jul 23 16:01:09.956238 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:09.956208    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5bfcc994b9-sqhlc"
Jul 23 16:01:10.974608 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:10.974562    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:01:11.062339 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:11.062300    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:01:16.964983 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:16.964949    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-mklln"
Jul 23 16:01:30.355198 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:30.355157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:01:43.779202 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:43.779170    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:01:59.995390 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:59.995359    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"]
Jul 23 16:01:59.998607 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:01:59.998590    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.001258 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.001228    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 23 16:02:00.001401 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.001359    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m7bzl\""
Jul 23 16:02:00.002490 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.002474    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 23 16:02:00.002542 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.002510    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 23 16:02:00.008249 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.008221    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"]
Jul 23 16:02:00.022644 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.022604    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:02:00.075687 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.075653    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pctdt\" (UniqueName: \"kubernetes.io/projected/b05ac0a8-902c-4a40-be68-cef97080e0a5-kube-api-access-pctdt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.075857 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.075696    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b05ac0a8-902c-4a40-be68-cef97080e0a5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.075857 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.075713    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b05ac0a8-902c-4a40-be68-cef97080e0a5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.075857 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.075765    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b05ac0a8-902c-4a40-be68-cef97080e0a5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.075857 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.075804    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b05ac0a8-902c-4a40-be68-cef97080e0a5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.075857 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.075826    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b05ac0a8-902c-4a40-be68-cef97080e0a5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.177354 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.177317    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b05ac0a8-902c-4a40-be68-cef97080e0a5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.177547 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.177384    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b05ac0a8-902c-4a40-be68-cef97080e0a5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.177547 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.177414    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b05ac0a8-902c-4a40-be68-cef97080e0a5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.177547 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.177458    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pctdt\" (UniqueName: \"kubernetes.io/projected/b05ac0a8-902c-4a40-be68-cef97080e0a5-kube-api-access-pctdt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.177547 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.177493    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b05ac0a8-902c-4a40-be68-cef97080e0a5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.177547 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.177513    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b05ac0a8-902c-4a40-be68-cef97080e0a5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.177824 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.177721    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b05ac0a8-902c-4a40-be68-cef97080e0a5-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.177824 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.177796    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b05ac0a8-902c-4a40-be68-cef97080e0a5-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.177913 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.177883    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b05ac0a8-902c-4a40-be68-cef97080e0a5-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.179822 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.179794    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b05ac0a8-902c-4a40-be68-cef97080e0a5-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.180220 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.180200    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b05ac0a8-902c-4a40-be68-cef97080e0a5-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.185734 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.185714    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pctdt\" (UniqueName: \"kubernetes.io/projected/b05ac0a8-902c-4a40-be68-cef97080e0a5-kube-api-access-pctdt\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wg52p\" (UID: \"b05ac0a8-902c-4a40-be68-cef97080e0a5\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.309746 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.309651    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:00.454107 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:00.454062    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"]
Jul 23 16:02:00.455189 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:02:00.455154    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05ac0a8_902c_4a40_be68_cef97080e0a5.slice/crio-9815010b7973d397e78b4110c68e5fec3324c46943daa049a675aef47fc6b472 WatchSource:0}: Error finding container 9815010b7973d397e78b4110c68e5fec3324c46943daa049a675aef47fc6b472: Status 404 returned error can't find the container with id 9815010b7973d397e78b4110c68e5fec3324c46943daa049a675aef47fc6b472
Jul 23 16:02:01.281086 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:01.281047    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p" event={"ID":"b05ac0a8-902c-4a40-be68-cef97080e0a5","Type":"ContainerStarted","Data":"9815010b7973d397e78b4110c68e5fec3324c46943daa049a675aef47fc6b472"}
Jul 23 16:02:05.841424 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:05.841340    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:02:10.212063 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.211978    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"]
Jul 23 16:02:10.214787 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.214768    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.217647 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.217624    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 23 16:02:10.225101 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.225076    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"]
Jul 23 16:02:10.238345 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.238306    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:02:10.386825 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.386783    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.386825 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.386826    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.387123 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.386910    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.387123 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.387089    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9j2r\" (UniqueName: \"kubernetes.io/projected/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-kube-api-access-f9j2r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.387243 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.387157    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.387243 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.387189    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.488435 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.488392    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.488631 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.488538    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9j2r\" (UniqueName: \"kubernetes.io/projected/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-kube-api-access-f9j2r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.488631 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.488578    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.488631 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.488600    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.488631 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.488627    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.488820 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.488665    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.489089 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.489063    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.489089 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.489085    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.489309 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.489136    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.490879 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.490847    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.491160 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.491144    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.497397 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.497375    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9j2r\" (UniqueName: \"kubernetes.io/projected/41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78-kube-api-access-f9j2r\") pod \"e2e-trlp-test-simulated-kserve-598466548d-tblfw\" (UID: \"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.527450 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.527411    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:10.672838 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:10.672809    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"]
Jul 23 16:02:10.673496 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:02:10.673467    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41caa2e0_9ea1_4ef5_b9b5_f74da5bc8d78.slice/crio-e8161d9a23cc3b4e2b51aaadcafdf272f697fb795e2aeca5e1b4b9875cb6aad4 WatchSource:0}: Error finding container e8161d9a23cc3b4e2b51aaadcafdf272f697fb795e2aeca5e1b4b9875cb6aad4: Status 404 returned error can't find the container with id e8161d9a23cc3b4e2b51aaadcafdf272f697fb795e2aeca5e1b4b9875cb6aad4
Jul 23 16:02:11.344292 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:11.344252    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw" event={"ID":"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78","Type":"ContainerStarted","Data":"e8161d9a23cc3b4e2b51aaadcafdf272f697fb795e2aeca5e1b4b9875cb6aad4"}
Jul 23 16:02:12.352274 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:12.352171    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw" event={"ID":"41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78","Type":"ContainerStarted","Data":"cbd0d9db6645f17cd04a6c520f066fb3854d5126e2cba2ae9574160a8dcc2afa"}
Jul 23 16:02:12.375856 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:12.375794    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw" podStartSLOduration=1.071891722 podStartE2EDuration="2.375774968s" totalImagesPullingTime="1.303883246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:02:12.373499386 +0000 UTC m=+718.297354045" watchObservedRunningTime="2026-07-23 16:02:12.375774968 +0000 UTC m=+718.299629620"
Jul 23 16:02:15.498959 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:15.498921    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:02:20.527640 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:20.527598    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:20.528049 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:20.527677    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:20.543559 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:20.543521    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:20.994198 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:20.994156    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:02:21.417528 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:21.417450    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-tblfw"
Jul 23 16:02:36.512458 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:36.512415    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p" event={"ID":"b05ac0a8-902c-4a40-be68-cef97080e0a5","Type":"ContainerStarted","Data":"add111caa701df27e724b1f0896af76e0efc8c40c4633aee142cf6e228b2031e"}
Jul 23 16:02:36.538928 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:36.538873    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p" podStartSLOduration=2.275113168 podStartE2EDuration="37.538855922s" totalImagesPullingTime="35.263742754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:02:36.535366864 +0000 UTC m=+742.459221500" watchObservedRunningTime="2026-07-23 16:02:36.538855922 +0000 UTC m=+742.462710556"
Jul 23 16:02:37.542974 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:37.542940    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:02:40.309819 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:40.309774    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:40.310255 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:40.309871    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:40.323701 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:40.323669    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:02:40.553767 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:02:40.553728    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wg52p"
Jul 23 16:03:22.028976 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.028937    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86b6896cf5-zfhqj"]
Jul 23 16:03:22.032812 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.032788    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.043216 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.043192    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b6896cf5-zfhqj"]
Jul 23 16:03:22.086929 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.086892    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:03:22.180519 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.180478    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-console-config\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.180711 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.180554    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-console-serving-cert\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.180711 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.180588    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-console-oauth-config\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.180711 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.180607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-service-ca\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.180711 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.180681    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-oauth-serving-cert\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.180871 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.180719    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98jgd\" (UniqueName: \"kubernetes.io/projected/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-kube-api-access-98jgd\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.180871 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.180755    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-trusted-ca-bundle\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.188138 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.188104    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:03:22.281548 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.281458    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-oauth-serving-cert\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.281548 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.281498    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98jgd\" (UniqueName: \"kubernetes.io/projected/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-kube-api-access-98jgd\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.281548 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.281523    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-trusted-ca-bundle\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.281807 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.281554    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-console-config\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.281807 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.281614    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-console-serving-cert\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.281807 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.281663    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-console-oauth-config\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.281807 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.281694    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-service-ca\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.282299 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.282275    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-oauth-serving-cert\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.282438 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.282413    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-console-config\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.282489 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.282443    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-service-ca\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.282552 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.282534    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-trusted-ca-bundle\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.284717 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.284688    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-console-serving-cert\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.284717 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.284712    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-console-oauth-config\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.287711 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.287688    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:03:22.289734 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.289708    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98jgd\" (UniqueName: \"kubernetes.io/projected/fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b-kube-api-access-98jgd\") pod \"console-86b6896cf5-zfhqj\" (UID: \"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b\") " pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.342831 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.342790    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:22.485700 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.485676    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86b6896cf5-zfhqj"]
Jul 23 16:03:22.487481 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:03:22.487455    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbb629e_77b6_48d2_8ebe_e9bec3f3ec5b.slice/crio-55dc0d5882d54832f30ce3c81171f7b3fada1fa993713a63e7ab09dc3e98fc8e WatchSource:0}: Error finding container 55dc0d5882d54832f30ce3c81171f7b3fada1fa993713a63e7ab09dc3e98fc8e: Status 404 returned error can't find the container with id 55dc0d5882d54832f30ce3c81171f7b3fada1fa993713a63e7ab09dc3e98fc8e
Jul 23 16:03:22.781286 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.781248    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b6896cf5-zfhqj" event={"ID":"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b","Type":"ContainerStarted","Data":"1df0507720eb29cdf070be856c8b3f2dff9976e7b008db0dc8b8abab2dd5f757"}
Jul 23 16:03:22.781472 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.781310    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86b6896cf5-zfhqj" event={"ID":"fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b","Type":"ContainerStarted","Data":"55dc0d5882d54832f30ce3c81171f7b3fada1fa993713a63e7ab09dc3e98fc8e"}
Jul 23 16:03:22.799803 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.799694    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86b6896cf5-zfhqj" podStartSLOduration=0.799676714 podStartE2EDuration="799.676714ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:03:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:03:22.796723176 +0000 UTC m=+788.720577811" watchObservedRunningTime="2026-07-23 16:03:22.799676714 +0000 UTC m=+788.723531343"
Jul 23 16:03:22.839790 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.839751    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:03:22.939990 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:22.939955    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:03:32.343104 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:32.343063    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:32.343710 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:32.343137    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:32.348936 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:32.348910    2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:32.844313 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:32.844287    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86b6896cf5-zfhqj"
Jul 23 16:03:32.900620 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:32.900580    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85db7d764f-d8zts"]
Jul 23 16:03:33.002365 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:33.002322    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:03:33.060783 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:33.060745    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:03:33.120457 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:33.120347    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:03:35.478232 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:35.478199    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:03:35.577139 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:35.577104    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:03:36.491736 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.491685    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66b7c849fb-r2226"]
Jul 23 16:03:36.492277 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.491904    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-66b7c849fb-r2226" podUID="8cc2ec70-9434-4d64-b650-33e9c00e20a8" containerName="authorino" containerID="cri-o://f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b" gracePeriod=30
Jul 23 16:03:36.772483 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.772456    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66b7c849fb-r2226"
Jul 23 16:03:36.815533 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.815495    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bx8qp\" (UniqueName: \"kubernetes.io/projected/8cc2ec70-9434-4d64-b650-33e9c00e20a8-kube-api-access-bx8qp\") pod \"8cc2ec70-9434-4d64-b650-33e9c00e20a8\" (UID: \"8cc2ec70-9434-4d64-b650-33e9c00e20a8\") "
Jul 23 16:03:36.815714 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.815633    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8cc2ec70-9434-4d64-b650-33e9c00e20a8-tls-cert\") pod \"8cc2ec70-9434-4d64-b650-33e9c00e20a8\" (UID: \"8cc2ec70-9434-4d64-b650-33e9c00e20a8\") "
Jul 23 16:03:36.817725 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.817691    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cc2ec70-9434-4d64-b650-33e9c00e20a8-kube-api-access-bx8qp" (OuterVolumeSpecName: "kube-api-access-bx8qp") pod "8cc2ec70-9434-4d64-b650-33e9c00e20a8" (UID: "8cc2ec70-9434-4d64-b650-33e9c00e20a8"). InnerVolumeSpecName "kube-api-access-bx8qp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:03:36.827384 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.827348    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cc2ec70-9434-4d64-b650-33e9c00e20a8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8cc2ec70-9434-4d64-b650-33e9c00e20a8" (UID: "8cc2ec70-9434-4d64-b650-33e9c00e20a8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:03:36.865843 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.865807    2570 generic.go:356] "Generic (PLEG): container finished" podID="8cc2ec70-9434-4d64-b650-33e9c00e20a8" containerID="f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b" exitCode=0
Jul 23 16:03:36.866069 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.865849    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66b7c849fb-r2226"
Jul 23 16:03:36.866069 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.865892    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66b7c849fb-r2226" event={"ID":"8cc2ec70-9434-4d64-b650-33e9c00e20a8","Type":"ContainerDied","Data":"f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b"}
Jul 23 16:03:36.866069 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.865936    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66b7c849fb-r2226" event={"ID":"8cc2ec70-9434-4d64-b650-33e9c00e20a8","Type":"ContainerDied","Data":"8482e7ce556210f8b177d4f8e76944a63a8fe838306c5dd92583b985f8b5d382"}
Jul 23 16:03:36.866069 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.865959    2570 scope.go:117] "RemoveContainer" containerID="f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b"
Jul 23 16:03:36.876301 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.876273    2570 scope.go:117] "RemoveContainer" containerID="f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b"
Jul 23 16:03:36.876692 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:03:36.876662    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b\": container with ID starting with f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b not found: ID does not exist" containerID="f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b"
Jul 23 16:03:36.876784 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.876706    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b"} err="failed to get container status \"f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b\": rpc error: code = NotFound desc = could not find container \"f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b\": container with ID starting with f63efa942cc4e2445be5e2f1f6325c8dcabfe11d1a3d603b211454102d1c2a9b not found: ID does not exist"
Jul 23 16:03:36.894562 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.894520    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66b7c849fb-r2226"]
Jul 23 16:03:36.910267 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.910233    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66b7c849fb-r2226"]
Jul 23 16:03:36.916673 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.916646    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bx8qp\" (UniqueName: \"kubernetes.io/projected/8cc2ec70-9434-4d64-b650-33e9c00e20a8-kube-api-access-bx8qp\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:03:36.916762 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:36.916674    2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8cc2ec70-9434-4d64-b650-33e9c00e20a8-tls-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:03:38.030699 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:38.030653    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:03:38.169305 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:38.169271    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:03:38.604353 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:38.604321    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cc2ec70-9434-4d64-b650-33e9c00e20a8" path="/var/lib/kubelet/pods/8cc2ec70-9434-4d64-b650-33e9c00e20a8/volumes"
Jul 23 16:03:57.922748 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:57.922686    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85db7d764f-d8zts" podUID="69fa9bb6-2b67-4160-be57-4d4ed39a7140" containerName="console" containerID="cri-o://d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959" gracePeriod=15
Jul 23 16:03:58.186080 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.186002    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 16:03:58.325187 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.325147    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-service-ca\") pod \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") "
Jul 23 16:03:58.325187 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.325188    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-config\") pod \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") "
Jul 23 16:03:58.325396 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.325230    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-oauth-config\") pod \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") "
Jul 23 16:03:58.325396 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.325255    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-oauth-serving-cert\") pod \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") "
Jul 23 16:03:58.325467 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.325427    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-serving-cert\") pod \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") "
Jul 23 16:03:58.325524 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.325483    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-trusted-ca-bundle\") pod \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") "
Jul 23 16:03:58.325579 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.325548    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rzdt\" (UniqueName: \"kubernetes.io/projected/69fa9bb6-2b67-4160-be57-4d4ed39a7140-kube-api-access-6rzdt\") pod \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\" (UID: \"69fa9bb6-2b67-4160-be57-4d4ed39a7140\") "
Jul 23 16:03:58.325657 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.325632    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-service-ca" (OuterVolumeSpecName: "service-ca") pod "69fa9bb6-2b67-4160-be57-4d4ed39a7140" (UID: "69fa9bb6-2b67-4160-be57-4d4ed39a7140"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:03:58.325772 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.325666    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-config" (OuterVolumeSpecName: "console-config") pod "69fa9bb6-2b67-4160-be57-4d4ed39a7140" (UID: "69fa9bb6-2b67-4160-be57-4d4ed39a7140"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:03:58.325772 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.325682    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "69fa9bb6-2b67-4160-be57-4d4ed39a7140" (UID: "69fa9bb6-2b67-4160-be57-4d4ed39a7140"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:03:58.325994 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.325969    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "69fa9bb6-2b67-4160-be57-4d4ed39a7140" (UID: "69fa9bb6-2b67-4160-be57-4d4ed39a7140"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:03:58.326157 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.326099    2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:03:58.326157 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.326118    2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:03:58.326157 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.326133    2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-oauth-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:03:58.326157 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.326148    2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69fa9bb6-2b67-4160-be57-4d4ed39a7140-trusted-ca-bundle\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:03:58.327666 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.327637    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "69fa9bb6-2b67-4160-be57-4d4ed39a7140" (UID: "69fa9bb6-2b67-4160-be57-4d4ed39a7140"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:03:58.328038 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.327987    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "69fa9bb6-2b67-4160-be57-4d4ed39a7140" (UID: "69fa9bb6-2b67-4160-be57-4d4ed39a7140"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:03:58.328038 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.328003    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69fa9bb6-2b67-4160-be57-4d4ed39a7140-kube-api-access-6rzdt" (OuterVolumeSpecName: "kube-api-access-6rzdt") pod "69fa9bb6-2b67-4160-be57-4d4ed39a7140" (UID: "69fa9bb6-2b67-4160-be57-4d4ed39a7140"). InnerVolumeSpecName "kube-api-access-6rzdt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:03:58.427322 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.427273    2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-oauth-config\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:03:58.427322 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.427318    2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69fa9bb6-2b67-4160-be57-4d4ed39a7140-console-serving-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:03:58.427322 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:58.427329    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rzdt\" (UniqueName: \"kubernetes.io/projected/69fa9bb6-2b67-4160-be57-4d4ed39a7140-kube-api-access-6rzdt\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:03:59.005336 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:59.005297    2570 generic.go:356] "Generic (PLEG): container finished" podID="69fa9bb6-2b67-4160-be57-4d4ed39a7140" containerID="d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959" exitCode=0
Jul 23 16:03:59.005755 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:59.005338    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85db7d764f-d8zts"
Jul 23 16:03:59.005755 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:59.005386    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85db7d764f-d8zts" event={"ID":"69fa9bb6-2b67-4160-be57-4d4ed39a7140","Type":"ContainerDied","Data":"d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959"}
Jul 23 16:03:59.005755 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:59.005432    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85db7d764f-d8zts" event={"ID":"69fa9bb6-2b67-4160-be57-4d4ed39a7140","Type":"ContainerDied","Data":"33078921e0a8c7a4ac59d96354b7377e08aea6e63947acb026d84ea83057f7f0"}
Jul 23 16:03:59.005755 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:59.005454    2570 scope.go:117] "RemoveContainer" containerID="d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959"
Jul 23 16:03:59.015185 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:59.015162    2570 scope.go:117] "RemoveContainer" containerID="d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959"
Jul 23 16:03:59.015470 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:03:59.015453    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959\": container with ID starting with d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959 not found: ID does not exist" containerID="d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959"
Jul 23 16:03:59.015539 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:59.015492    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959"} err="failed to get container status \"d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959\": rpc error: code = NotFound desc = could not find container \"d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959\": container with ID starting with d2b3c12bd052a68ec72a1885a9a81056e96bd79dc093e646b67cd25025a9f959 not found: ID does not exist"
Jul 23 16:03:59.023458 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:59.023429    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85db7d764f-d8zts"]
Jul 23 16:03:59.028103 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:03:59.028074    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85db7d764f-d8zts"]
Jul 23 16:04:00.604099 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:00.604067    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69fa9bb6-2b67-4160-be57-4d4ed39a7140" path="/var/lib/kubelet/pods/69fa9bb6-2b67-4160-be57-4d4ed39a7140/volumes"
Jul 23 16:04:23.000490 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:23.000450    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-688fcc8886-zgxq7"]
Jul 23 16:04:23.001062 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:23.000711    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-688fcc8886-zgxq7" podUID="50e1c39f-d56b-4cf1-acaa-bbc557addccd" containerName="manager" containerID="cri-o://4dae715ae562d1f4aa4e2231e70147d0ef2da7bdd4e454319aeb5a312180a260" gracePeriod=30
Jul 23 16:04:23.157270 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:23.157231    2570 generic.go:356] "Generic (PLEG): container finished" podID="50e1c39f-d56b-4cf1-acaa-bbc557addccd" containerID="4dae715ae562d1f4aa4e2231e70147d0ef2da7bdd4e454319aeb5a312180a260" exitCode=0
Jul 23 16:04:23.157458 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:23.157301    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688fcc8886-zgxq7" event={"ID":"50e1c39f-d56b-4cf1-acaa-bbc557addccd","Type":"ContainerDied","Data":"4dae715ae562d1f4aa4e2231e70147d0ef2da7bdd4e454319aeb5a312180a260"}
Jul 23 16:04:23.255704 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:23.255644    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688fcc8886-zgxq7"
Jul 23 16:04:23.355634 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:23.355595    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50e1c39f-d56b-4cf1-acaa-bbc557addccd-webhook-cert\") pod \"50e1c39f-d56b-4cf1-acaa-bbc557addccd\" (UID: \"50e1c39f-d56b-4cf1-acaa-bbc557addccd\") "
Jul 23 16:04:23.355856 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:23.355655    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh8f8\" (UniqueName: \"kubernetes.io/projected/50e1c39f-d56b-4cf1-acaa-bbc557addccd-kube-api-access-jh8f8\") pod \"50e1c39f-d56b-4cf1-acaa-bbc557addccd\" (UID: \"50e1c39f-d56b-4cf1-acaa-bbc557addccd\") "
Jul 23 16:04:23.357745 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:23.357713    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50e1c39f-d56b-4cf1-acaa-bbc557addccd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "50e1c39f-d56b-4cf1-acaa-bbc557addccd" (UID: "50e1c39f-d56b-4cf1-acaa-bbc557addccd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:04:23.357850 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:23.357781    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50e1c39f-d56b-4cf1-acaa-bbc557addccd-kube-api-access-jh8f8" (OuterVolumeSpecName: "kube-api-access-jh8f8") pod "50e1c39f-d56b-4cf1-acaa-bbc557addccd" (UID: "50e1c39f-d56b-4cf1-acaa-bbc557addccd"). InnerVolumeSpecName "kube-api-access-jh8f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:04:23.456755 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:23.456723    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50e1c39f-d56b-4cf1-acaa-bbc557addccd-webhook-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:04:23.456755 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:23.456753    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh8f8\" (UniqueName: \"kubernetes.io/projected/50e1c39f-d56b-4cf1-acaa-bbc557addccd-kube-api-access-jh8f8\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:04:24.164677 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:24.164648    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688fcc8886-zgxq7"
Jul 23 16:04:24.165173 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:24.164686    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688fcc8886-zgxq7" event={"ID":"50e1c39f-d56b-4cf1-acaa-bbc557addccd","Type":"ContainerDied","Data":"0f2461c59568df6ff2243dcecf5833e07dee368082cd7080d6f91b70d8d934b7"}
Jul 23 16:04:24.165173 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:24.164746    2570 scope.go:117] "RemoveContainer" containerID="4dae715ae562d1f4aa4e2231e70147d0ef2da7bdd4e454319aeb5a312180a260"
Jul 23 16:04:24.186902 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:24.186874    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-688fcc8886-zgxq7"]
Jul 23 16:04:24.192931 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:24.192902    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-688fcc8886-zgxq7"]
Jul 23 16:04:24.604354 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:24.604321    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50e1c39f-d56b-4cf1-acaa-bbc557addccd" path="/var/lib/kubelet/pods/50e1c39f-d56b-4cf1-acaa-bbc557addccd/volumes"
Jul 23 16:04:43.544320 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:04:43.544282    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:05:24.411126 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:24.411088    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:05:24.511060 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:24.511001    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:05:25.029899 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.029859    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-688fcc8886-hprlx"]
Jul 23 16:05:25.030631 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.030610    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cc2ec70-9434-4d64-b650-33e9c00e20a8" containerName="authorino"
Jul 23 16:05:25.030740 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.030635    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cc2ec70-9434-4d64-b650-33e9c00e20a8" containerName="authorino"
Jul 23 16:05:25.030740 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.030670    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50e1c39f-d56b-4cf1-acaa-bbc557addccd" containerName="manager"
Jul 23 16:05:25.030740 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.030679    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="50e1c39f-d56b-4cf1-acaa-bbc557addccd" containerName="manager"
Jul 23 16:05:25.030740 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.030695    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69fa9bb6-2b67-4160-be57-4d4ed39a7140" containerName="console"
Jul 23 16:05:25.030740 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.030704    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="69fa9bb6-2b67-4160-be57-4d4ed39a7140" containerName="console"
Jul 23 16:05:25.030921 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.030791    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="69fa9bb6-2b67-4160-be57-4d4ed39a7140" containerName="console"
Jul 23 16:05:25.030921 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.030803    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cc2ec70-9434-4d64-b650-33e9c00e20a8" containerName="authorino"
Jul 23 16:05:25.030921 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.030816    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="50e1c39f-d56b-4cf1-acaa-bbc557addccd" containerName="manager"
Jul 23 16:05:25.035623 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.035607    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688fcc8886-hprlx"
Jul 23 16:05:25.040387 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.040361    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w9pvj\""
Jul 23 16:05:25.040387 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.040384    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 16:05:25.040578 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.040364    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 16:05:25.045298 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.045275    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-688fcc8886-hprlx"]
Jul 23 16:05:25.149048 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.148985    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/497998b7-e9fc-47cc-b50f-14db5539894d-webhook-cert\") pod \"maas-controller-688fcc8886-hprlx\" (UID: \"497998b7-e9fc-47cc-b50f-14db5539894d\") " pod="opendatahub/maas-controller-688fcc8886-hprlx"
Jul 23 16:05:25.149228 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.149091    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7zdh\" (UniqueName: \"kubernetes.io/projected/497998b7-e9fc-47cc-b50f-14db5539894d-kube-api-access-m7zdh\") pod \"maas-controller-688fcc8886-hprlx\" (UID: \"497998b7-e9fc-47cc-b50f-14db5539894d\") " pod="opendatahub/maas-controller-688fcc8886-hprlx"
Jul 23 16:05:25.249654 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.249622    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/497998b7-e9fc-47cc-b50f-14db5539894d-webhook-cert\") pod \"maas-controller-688fcc8886-hprlx\" (UID: \"497998b7-e9fc-47cc-b50f-14db5539894d\") " pod="opendatahub/maas-controller-688fcc8886-hprlx"
Jul 23 16:05:25.249816 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.249666    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7zdh\" (UniqueName: \"kubernetes.io/projected/497998b7-e9fc-47cc-b50f-14db5539894d-kube-api-access-m7zdh\") pod \"maas-controller-688fcc8886-hprlx\" (UID: \"497998b7-e9fc-47cc-b50f-14db5539894d\") " pod="opendatahub/maas-controller-688fcc8886-hprlx"
Jul 23 16:05:25.252174 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.252155    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/497998b7-e9fc-47cc-b50f-14db5539894d-webhook-cert\") pod \"maas-controller-688fcc8886-hprlx\" (UID: \"497998b7-e9fc-47cc-b50f-14db5539894d\") " pod="opendatahub/maas-controller-688fcc8886-hprlx"
Jul 23 16:05:25.259326 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.259303    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7zdh\" (UniqueName: \"kubernetes.io/projected/497998b7-e9fc-47cc-b50f-14db5539894d-kube-api-access-m7zdh\") pod \"maas-controller-688fcc8886-hprlx\" (UID: \"497998b7-e9fc-47cc-b50f-14db5539894d\") " pod="opendatahub/maas-controller-688fcc8886-hprlx"
Jul 23 16:05:25.347257 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.347178    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688fcc8886-hprlx"
Jul 23 16:05:25.489610 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.489582    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-688fcc8886-hprlx"]
Jul 23 16:05:25.490911 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:05:25.490881    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497998b7_e9fc_47cc_b50f_14db5539894d.slice/crio-928a67b1cb117a6209041c6d2016951a9d651ad14080ffad26d10e8afe00c062 WatchSource:0}: Error finding container 928a67b1cb117a6209041c6d2016951a9d651ad14080ffad26d10e8afe00c062: Status 404 returned error can't find the container with id 928a67b1cb117a6209041c6d2016951a9d651ad14080ffad26d10e8afe00c062
Jul 23 16:05:25.532353 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:25.532311    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688fcc8886-hprlx" event={"ID":"497998b7-e9fc-47cc-b50f-14db5539894d","Type":"ContainerStarted","Data":"928a67b1cb117a6209041c6d2016951a9d651ad14080ffad26d10e8afe00c062"}
Jul 23 16:05:26.540519 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:26.540412    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688fcc8886-hprlx" event={"ID":"497998b7-e9fc-47cc-b50f-14db5539894d","Type":"ContainerStarted","Data":"bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1"}
Jul 23 16:05:26.540519 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:26.540491    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-688fcc8886-hprlx"
Jul 23 16:05:26.560301 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:26.560243    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-688fcc8886-hprlx" podStartSLOduration=0.771370348 podStartE2EDuration="1.560225421s" totalImagesPullingTime="788.855073ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:05:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:05:26.559123699 +0000 UTC m=+912.482978334" watchObservedRunningTime="2026-07-23 16:05:26.560225421 +0000 UTC m=+912.484080055"
Jul 23 16:05:37.548274 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:37.548243    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-688fcc8886-hprlx"
Jul 23 16:05:42.116442 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.116407    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:05:42.228939 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.228901    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-688fcc8886-hprlx"]
Jul 23 16:05:42.229185 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.229161    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-688fcc8886-hprlx" podUID="497998b7-e9fc-47cc-b50f-14db5539894d" containerName="manager" containerID="cri-o://bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1" gracePeriod=30
Jul 23 16:05:42.477845 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.477815    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688fcc8886-hprlx"
Jul 23 16:05:42.502733 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.502696    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/497998b7-e9fc-47cc-b50f-14db5539894d-webhook-cert\") pod \"497998b7-e9fc-47cc-b50f-14db5539894d\" (UID: \"497998b7-e9fc-47cc-b50f-14db5539894d\") "
Jul 23 16:05:42.502927 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.502746    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7zdh\" (UniqueName: \"kubernetes.io/projected/497998b7-e9fc-47cc-b50f-14db5539894d-kube-api-access-m7zdh\") pod \"497998b7-e9fc-47cc-b50f-14db5539894d\" (UID: \"497998b7-e9fc-47cc-b50f-14db5539894d\") "
Jul 23 16:05:42.504891 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.504855    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/497998b7-e9fc-47cc-b50f-14db5539894d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "497998b7-e9fc-47cc-b50f-14db5539894d" (UID: "497998b7-e9fc-47cc-b50f-14db5539894d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:05:42.504891 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.504870    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/497998b7-e9fc-47cc-b50f-14db5539894d-kube-api-access-m7zdh" (OuterVolumeSpecName: "kube-api-access-m7zdh") pod "497998b7-e9fc-47cc-b50f-14db5539894d" (UID: "497998b7-e9fc-47cc-b50f-14db5539894d"). InnerVolumeSpecName "kube-api-access-m7zdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:05:42.603876 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.603845    2570 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/497998b7-e9fc-47cc-b50f-14db5539894d-webhook-cert\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:05:42.603876 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.603872    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7zdh\" (UniqueName: \"kubernetes.io/projected/497998b7-e9fc-47cc-b50f-14db5539894d-kube-api-access-m7zdh\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:05:42.630566 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.630536    2570 generic.go:356] "Generic (PLEG): container finished" podID="497998b7-e9fc-47cc-b50f-14db5539894d" containerID="bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1" exitCode=0
Jul 23 16:05:42.630728 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.630584    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688fcc8886-hprlx"
Jul 23 16:05:42.630728 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.630583    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688fcc8886-hprlx" event={"ID":"497998b7-e9fc-47cc-b50f-14db5539894d","Type":"ContainerDied","Data":"bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1"}
Jul 23 16:05:42.630728 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.630635    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688fcc8886-hprlx" event={"ID":"497998b7-e9fc-47cc-b50f-14db5539894d","Type":"ContainerDied","Data":"928a67b1cb117a6209041c6d2016951a9d651ad14080ffad26d10e8afe00c062"}
Jul 23 16:05:42.630728 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.630656    2570 scope.go:117] "RemoveContainer" containerID="bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1"
Jul 23 16:05:42.641992 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.641952    2570 scope.go:117] "RemoveContainer" containerID="bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1"
Jul 23 16:05:42.642490 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:05:42.642469    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1\": container with ID starting with bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1 not found: ID does not exist" containerID="bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1"
Jul 23 16:05:42.642592 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.642500    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1"} err="failed to get container status \"bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1\": rpc error: code = NotFound desc = could not find container \"bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1\": container with ID starting with bb42ed66293b0adae47d4969eac204b3d7fef56dcb793ef875c773efade733c1 not found: ID does not exist"
Jul 23 16:05:42.654574 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.654497    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-688fcc8886-hprlx"]
Jul 23 16:05:42.656926 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:42.656903    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-688fcc8886-hprlx"]
Jul 23 16:05:43.482055 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.482021    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-688fcc8886-mbbwq"]
Jul 23 16:05:43.482691 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.482667    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="497998b7-e9fc-47cc-b50f-14db5539894d" containerName="manager"
Jul 23 16:05:43.482788 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.482693    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="497998b7-e9fc-47cc-b50f-14db5539894d" containerName="manager"
Jul 23 16:05:43.482848 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.482800    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="497998b7-e9fc-47cc-b50f-14db5539894d" containerName="manager"
Jul 23 16:05:43.485934 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.485910    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688fcc8886-mbbwq"
Jul 23 16:05:43.490666 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.490634    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w9pvj\""
Jul 23 16:05:43.490666 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.490666    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 23 16:05:43.490841 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.490645    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 23 16:05:43.497217 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.497193    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-688fcc8886-mbbwq"]
Jul 23 16:05:43.511689 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.511650    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8hhw\" (UniqueName: \"kubernetes.io/projected/2794f966-bd7d-4187-bdd9-06ce5ab40f8a-kube-api-access-w8hhw\") pod \"maas-controller-688fcc8886-mbbwq\" (UID: \"2794f966-bd7d-4187-bdd9-06ce5ab40f8a\") " pod="opendatahub/maas-controller-688fcc8886-mbbwq"
Jul 23 16:05:43.511863 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.511802    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2794f966-bd7d-4187-bdd9-06ce5ab40f8a-webhook-cert\") pod \"maas-controller-688fcc8886-mbbwq\" (UID: \"2794f966-bd7d-4187-bdd9-06ce5ab40f8a\") " pod="opendatahub/maas-controller-688fcc8886-mbbwq"
Jul 23 16:05:43.613148 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.613110    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8hhw\" (UniqueName: \"kubernetes.io/projected/2794f966-bd7d-4187-bdd9-06ce5ab40f8a-kube-api-access-w8hhw\") pod \"maas-controller-688fcc8886-mbbwq\" (UID: \"2794f966-bd7d-4187-bdd9-06ce5ab40f8a\") " pod="opendatahub/maas-controller-688fcc8886-mbbwq"
Jul 23 16:05:43.613353 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.613210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2794f966-bd7d-4187-bdd9-06ce5ab40f8a-webhook-cert\") pod \"maas-controller-688fcc8886-mbbwq\" (UID: \"2794f966-bd7d-4187-bdd9-06ce5ab40f8a\") " pod="opendatahub/maas-controller-688fcc8886-mbbwq"
Jul 23 16:05:43.615728 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.615706    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2794f966-bd7d-4187-bdd9-06ce5ab40f8a-webhook-cert\") pod \"maas-controller-688fcc8886-mbbwq\" (UID: \"2794f966-bd7d-4187-bdd9-06ce5ab40f8a\") " pod="opendatahub/maas-controller-688fcc8886-mbbwq"
Jul 23 16:05:43.622087 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.622062    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8hhw\" (UniqueName: \"kubernetes.io/projected/2794f966-bd7d-4187-bdd9-06ce5ab40f8a-kube-api-access-w8hhw\") pod \"maas-controller-688fcc8886-mbbwq\" (UID: \"2794f966-bd7d-4187-bdd9-06ce5ab40f8a\") " pod="opendatahub/maas-controller-688fcc8886-mbbwq"
Jul 23 16:05:43.797532 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.797439    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-688fcc8886-mbbwq"
Jul 23 16:05:43.942205 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:43.942172    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-688fcc8886-mbbwq"]
Jul 23 16:05:43.943698 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:05:43.943666    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2794f966_bd7d_4187_bdd9_06ce5ab40f8a.slice/crio-ea59059d7f45202ad70c55476580a07be1927d432ec78f15674f05bbc36d3c86 WatchSource:0}: Error finding container ea59059d7f45202ad70c55476580a07be1927d432ec78f15674f05bbc36d3c86: Status 404 returned error can't find the container with id ea59059d7f45202ad70c55476580a07be1927d432ec78f15674f05bbc36d3c86
Jul 23 16:05:44.604814 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:44.604776    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="497998b7-e9fc-47cc-b50f-14db5539894d" path="/var/lib/kubelet/pods/497998b7-e9fc-47cc-b50f-14db5539894d/volumes"
Jul 23 16:05:44.638309 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:44.638271    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:05:44.644326 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:44.644299    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688fcc8886-mbbwq" event={"ID":"2794f966-bd7d-4187-bdd9-06ce5ab40f8a","Type":"ContainerStarted","Data":"ea59059d7f45202ad70c55476580a07be1927d432ec78f15674f05bbc36d3c86"}
Jul 23 16:05:46.657468 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:46.657417    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-688fcc8886-mbbwq" event={"ID":"2794f966-bd7d-4187-bdd9-06ce5ab40f8a","Type":"ContainerStarted","Data":"3a0a378e5e4d94cd6b2be0638d4105bf4ecdc64f8e7e93382b2d1037b99d0436"}
Jul 23 16:05:46.657902 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:46.657571    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-688fcc8886-mbbwq"
Jul 23 16:05:46.675285 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:46.675229    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-688fcc8886-mbbwq" podStartSLOduration=1.6400541739999999 podStartE2EDuration="3.675212767s" totalImagesPullingTime="2.035158593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:05:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:05:46.673242638 +0000 UTC m=+932.597097271" watchObservedRunningTime="2026-07-23 16:05:46.675212767 +0000 UTC m=+932.599067400"
Jul 23 16:05:57.665583 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:05:57.665546    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-688fcc8886-mbbwq"
Jul 23 16:06:28.309996 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:06:28.309961    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:06:28.398552 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:06:28.398495    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:06:29.622705 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:06:29.622670    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:06:34.307388 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:06:34.307347    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:06:35.288909 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:06:35.288868    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:06:35.391289 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:06:35.391233    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:06:40.336775 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:06:40.336673    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:06:40.437500 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:06:40.437451    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:07:09.777110 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:07:09.777065    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:07:09.839470 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:07:09.839429    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:07:10.185236 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:07:10.185119    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:08:24.434332 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:08:24.434210    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:10:38.882051 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:38.882001    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"]
Jul 23 16:10:38.884651 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:38.882220    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922" podUID="3df21c6c-b408-446d-90cb-932b04113898" containerName="manager" containerID="cri-o://16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05" gracePeriod=10
Jul 23 16:10:42.337605 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.337582    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"
Jul 23 16:10:42.392213 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.392121    2570 generic.go:356] "Generic (PLEG): container finished" podID="3df21c6c-b408-446d-90cb-932b04113898" containerID="16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05" exitCode=0
Jul 23 16:10:42.392213 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.392170    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"
Jul 23 16:10:42.392213 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.392202    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922" event={"ID":"3df21c6c-b408-446d-90cb-932b04113898","Type":"ContainerDied","Data":"16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05"}
Jul 23 16:10:42.392431 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.392263    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922" event={"ID":"3df21c6c-b408-446d-90cb-932b04113898","Type":"ContainerDied","Data":"d594c4a8503862950217915024a707687d0a4bbc3d07e90817ff2cac25d7562d"}
Jul 23 16:10:42.392431 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.392294    2570 scope.go:117] "RemoveContainer" containerID="16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05"
Jul 23 16:10:42.402140 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.402124    2570 scope.go:117] "RemoveContainer" containerID="16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05"
Jul 23 16:10:42.402399 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:10:42.402379    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05\": container with ID starting with 16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05 not found: ID does not exist" containerID="16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05"
Jul 23 16:10:42.402474 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.402413    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05"} err="failed to get container status \"16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05\": rpc error: code = NotFound desc = could not find container \"16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05\": container with ID starting with 16679b23718ae2b4d6fca970651279b4d14e968ef71e7bb0ca2aa9038176ae05 not found: ID does not exist"
Jul 23 16:10:42.428637 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.428606    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ns4sd\" (UniqueName: \"kubernetes.io/projected/3df21c6c-b408-446d-90cb-932b04113898-kube-api-access-ns4sd\") pod \"3df21c6c-b408-446d-90cb-932b04113898\" (UID: \"3df21c6c-b408-446d-90cb-932b04113898\") "
Jul 23 16:10:42.428779 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.428697    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3df21c6c-b408-446d-90cb-932b04113898-extensions-socket-volume\") pod \"3df21c6c-b408-446d-90cb-932b04113898\" (UID: \"3df21c6c-b408-446d-90cb-932b04113898\") "
Jul 23 16:10:42.429130 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.429106    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3df21c6c-b408-446d-90cb-932b04113898-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3df21c6c-b408-446d-90cb-932b04113898" (UID: "3df21c6c-b408-446d-90cb-932b04113898"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 23 16:10:42.430655 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.430632    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3df21c6c-b408-446d-90cb-932b04113898-kube-api-access-ns4sd" (OuterVolumeSpecName: "kube-api-access-ns4sd") pod "3df21c6c-b408-446d-90cb-932b04113898" (UID: "3df21c6c-b408-446d-90cb-932b04113898"). InnerVolumeSpecName "kube-api-access-ns4sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:10:42.530466 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.530421    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ns4sd\" (UniqueName: \"kubernetes.io/projected/3df21c6c-b408-446d-90cb-932b04113898-kube-api-access-ns4sd\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:10:42.530466 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.530458    2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3df21c6c-b408-446d-90cb-932b04113898-extensions-socket-volume\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:10:42.713053 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.712938    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"]
Jul 23 16:10:42.715908 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:42.715882    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-k4922"]
Jul 23 16:10:44.604029 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:10:44.603990    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3df21c6c-b408-446d-90cb-932b04113898" path="/var/lib/kubelet/pods/3df21c6c-b408-446d-90cb-932b04113898/volumes"
Jul 23 16:11:40.131042 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.130977    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"]
Jul 23 16:11:40.131679 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.131658    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3df21c6c-b408-446d-90cb-932b04113898" containerName="manager"
Jul 23 16:11:40.131767 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.131683    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3df21c6c-b408-446d-90cb-932b04113898" containerName="manager"
Jul 23 16:11:40.131836 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.131820    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3df21c6c-b408-446d-90cb-932b04113898" containerName="manager"
Jul 23 16:11:40.136291 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.136269    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"
Jul 23 16:11:40.139425 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.139408    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rjnxw\""
Jul 23 16:11:40.157280 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.157253    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"]
Jul 23 16:11:40.264999 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.264964    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7bac498-f029-4343-b65f-b8c6e675ae7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-glbnr\" (UID: \"f7bac498-f029-4343-b65f-b8c6e675ae7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"
Jul 23 16:11:40.265196 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.265041    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4fbm\" (UniqueName: \"kubernetes.io/projected/f7bac498-f029-4343-b65f-b8c6e675ae7b-kube-api-access-w4fbm\") pod \"kuadrant-operator-controller-manager-86878c769f-glbnr\" (UID: \"f7bac498-f029-4343-b65f-b8c6e675ae7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"
Jul 23 16:11:40.365924 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.365881    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7bac498-f029-4343-b65f-b8c6e675ae7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-glbnr\" (UID: \"f7bac498-f029-4343-b65f-b8c6e675ae7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"
Jul 23 16:11:40.366126 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.365933    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4fbm\" (UniqueName: \"kubernetes.io/projected/f7bac498-f029-4343-b65f-b8c6e675ae7b-kube-api-access-w4fbm\") pod \"kuadrant-operator-controller-manager-86878c769f-glbnr\" (UID: \"f7bac498-f029-4343-b65f-b8c6e675ae7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"
Jul 23 16:11:40.366318 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.366293    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7bac498-f029-4343-b65f-b8c6e675ae7b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-glbnr\" (UID: \"f7bac498-f029-4343-b65f-b8c6e675ae7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"
Jul 23 16:11:40.379106 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.379074    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4fbm\" (UniqueName: \"kubernetes.io/projected/f7bac498-f029-4343-b65f-b8c6e675ae7b-kube-api-access-w4fbm\") pod \"kuadrant-operator-controller-manager-86878c769f-glbnr\" (UID: \"f7bac498-f029-4343-b65f-b8c6e675ae7b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"
Jul 23 16:11:40.446344 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.446243    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"
Jul 23 16:11:40.613927 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.613898    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"]
Jul 23 16:11:40.615477 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:11:40.615444    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7bac498_f029_4343_b65f_b8c6e675ae7b.slice/crio-4a318c87ebffcc863210c195ebcf3363a1d5babd1f4e1593ba25bf7b7926dfcb WatchSource:0}: Error finding container 4a318c87ebffcc863210c195ebcf3363a1d5babd1f4e1593ba25bf7b7926dfcb: Status 404 returned error can't find the container with id 4a318c87ebffcc863210c195ebcf3363a1d5babd1f4e1593ba25bf7b7926dfcb
Jul 23 16:11:40.720861 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.720828    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr" event={"ID":"f7bac498-f029-4343-b65f-b8c6e675ae7b","Type":"ContainerStarted","Data":"7368d97b1c6a44d651f4710a55970ba7a6ed6cde84f10eccc3a0868aa2137b75"}
Jul 23 16:11:40.721050 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.720889    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr" event={"ID":"f7bac498-f029-4343-b65f-b8c6e675ae7b","Type":"ContainerStarted","Data":"4a318c87ebffcc863210c195ebcf3363a1d5babd1f4e1593ba25bf7b7926dfcb"}
Jul 23 16:11:40.721050 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.720917    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"
Jul 23 16:11:40.749283 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:40.749233    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr" podStartSLOduration=0.749217466 podStartE2EDuration="749.217466ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:11:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:11:40.74710886 +0000 UTC m=+1286.670963494" watchObservedRunningTime="2026-07-23 16:11:40.749217466 +0000 UTC m=+1286.673072188"
Jul 23 16:11:51.729096 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:11:51.729068    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-glbnr"
Jul 23 16:12:15.723972 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:12:15.723940    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:13:59.337862 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:13:59.337831    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:14:24.018768 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:14:24.018689    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:14:55.290123 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:14:55.290092    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:15:00.141299 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:00.141261    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747055-d7gw4"]
Jul 23 16:15:00.144817 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:00.144797    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747055-d7gw4"
Jul 23 16:15:00.147644 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:00.147621    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:15:00.153639 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:00.153144    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747055-d7gw4"]
Jul 23 16:15:00.158118 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:00.158094    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747055-d7gw4"
Jul 23 16:15:00.301004 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:15:00.300966    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62bef16f_e0ba_4d2c_8468_dae0b8af9561.slice/crio-eef785836320751ef1c3b1512036a93ad2bc234ee79ec2354e0cd0378faa9e18 WatchSource:0}: Error finding container eef785836320751ef1c3b1512036a93ad2bc234ee79ec2354e0cd0378faa9e18: Status 404 returned error can't find the container with id eef785836320751ef1c3b1512036a93ad2bc234ee79ec2354e0cd0378faa9e18
Jul 23 16:15:00.301395 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:00.301367    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747055-d7gw4"]
Jul 23 16:15:00.303158 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:00.303136    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:15:00.886525 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:00.886488    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747055-d7gw4" event={"ID":"62bef16f-e0ba-4d2c-8468-dae0b8af9561","Type":"ContainerStarted","Data":"eef785836320751ef1c3b1512036a93ad2bc234ee79ec2354e0cd0378faa9e18"}
Jul 23 16:15:16.982878 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:16.982843    2570 generic.go:356] "Generic (PLEG): container finished" podID="62bef16f-e0ba-4d2c-8468-dae0b8af9561" containerID="eb098864f5c5635dbbb293ddcba2ad3143b5b72af7f9f4e2fc016f437d70e075" exitCode=0
Jul 23 16:15:16.983283 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:16.982927    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747055-d7gw4" event={"ID":"62bef16f-e0ba-4d2c-8468-dae0b8af9561","Type":"ContainerDied","Data":"eb098864f5c5635dbbb293ddcba2ad3143b5b72af7f9f4e2fc016f437d70e075"}
Jul 23 16:15:18.135406 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:18.135380    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747055-d7gw4"
Jul 23 16:15:18.995915 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:18.995887    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747055-d7gw4"
Jul 23 16:15:18.996164 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:18.995920    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747055-d7gw4" event={"ID":"62bef16f-e0ba-4d2c-8468-dae0b8af9561","Type":"ContainerDied","Data":"eef785836320751ef1c3b1512036a93ad2bc234ee79ec2354e0cd0378faa9e18"}
Jul 23 16:15:18.996164 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:18.995965    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eef785836320751ef1c3b1512036a93ad2bc234ee79ec2354e0cd0378faa9e18"
Jul 23 16:15:21.268306 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:21.268271    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:15:22.324593 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:22.324549    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:15:35.556124 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:35.556086    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:15:45.896673 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:15:45.896632    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:18.808130 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:16:18.808096    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:40.045745 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:16:40.045708    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:16:40.145787 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:16:40.145757    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:34.975438 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:18:34.975392    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:18:56.809191 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:18:56.809152    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:00.457604 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:00.457567    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:00.556711 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:00.556680    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:01.322950 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:01.322913    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:07.466657 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:07.466612    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:07.538082 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:07.538037    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:07.720185 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:07.720085    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:08.179813 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:08.179720    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:08.454428 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:08.454328    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:10.881550 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:10.881501    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:10.972720 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:10.972690    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:10.975001 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:10.974976    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"]
Jul 23 16:19:10.975427 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:10.975412    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62bef16f-e0ba-4d2c-8468-dae0b8af9561" containerName="cleanup"
Jul 23 16:19:10.975509 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:10.975429    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="62bef16f-e0ba-4d2c-8468-dae0b8af9561" containerName="cleanup"
Jul 23 16:19:10.975572 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:10.975528    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="62bef16f-e0ba-4d2c-8468-dae0b8af9561" containerName="cleanup"
Jul 23 16:19:10.978295 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:10.978275    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:10.981380 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:10.981361    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f8d3e728-serving-cert\""
Jul 23 16:19:10.990212 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:10.990186    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"]
Jul 23 16:19:10.992998 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:10.992977    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-openshift-service-ca\") pod \"maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:10.993146 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:10.993053    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-maas-api-tls\") pod \"maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:10.993146 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:10.993075    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsbqs\" (UniqueName: \"kubernetes.io/projected/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-kube-api-access-zsbqs\") pod \"maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:11.094522 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:11.094490    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-openshift-service-ca\") pod \"maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:11.094730 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:11.094556    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-maas-api-tls\") pod \"maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:11.094730 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:11.094579    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsbqs\" (UniqueName: \"kubernetes.io/projected/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-kube-api-access-zsbqs\") pod \"maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:11.094730 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:19:11.094717    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-serving-cert: secret "maas-api-e2e-ait-f8d3e728-serving-cert" not found
Jul 23 16:19:11.094901 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:19:11.094797    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-maas-api-tls podName:2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf nodeName:}" failed. No retries permitted until 2026-07-23 16:19:11.594776699 +0000 UTC m=+1737.518631330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-maas-api-tls") pod "maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99" (UID: "2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf") : secret "maas-api-e2e-ait-f8d3e728-serving-cert" not found
Jul 23 16:19:11.095187 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:11.095165    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-openshift-service-ca\") pod \"maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:11.096315 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:11.096291    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:11.108912 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:11.108887    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsbqs\" (UniqueName: \"kubernetes.io/projected/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-kube-api-access-zsbqs\") pod \"maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:11.433250 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:11.433214    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:11.600585 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:11.600551    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-maas-api-tls\") pod \"maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:11.603290 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:11.603260    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-maas-api-tls\") pod \"maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:11.657633 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:11.657592    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:11.767414 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:11.767373    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:11.889628 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:11.889588    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:12.036715 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:19:12.036672    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bebfbb1_17ac_44bf_ae15_d7a15a4c3cbf.slice/crio-849bac8cf2607cbd2add2490728edb698f08e88620d3ea1d3f5d17bbf6e5a0c0 WatchSource:0}: Error finding container 849bac8cf2607cbd2add2490728edb698f08e88620d3ea1d3f5d17bbf6e5a0c0: Status 404 returned error can't find the container with id 849bac8cf2607cbd2add2490728edb698f08e88620d3ea1d3f5d17bbf6e5a0c0
Jul 23 16:19:12.037248 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:12.037219    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"]
Jul 23 16:19:12.387999 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:12.387913    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99" event={"ID":"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf","Type":"ContainerStarted","Data":"849bac8cf2607cbd2add2490728edb698f08e88620d3ea1d3f5d17bbf6e5a0c0"}
Jul 23 16:19:13.394818 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:13.394785    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99" event={"ID":"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf","Type":"ContainerStarted","Data":"ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433"}
Jul 23 16:19:13.395228 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:13.394852    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:13.415848 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:13.415792    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99" podStartSLOduration=2.983747982 podStartE2EDuration="3.415776427s" totalImagesPullingTime="432.028445ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:19:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:19:13.413953683 +0000 UTC m=+1739.337808317" watchObservedRunningTime="2026-07-23 16:19:13.415776427 +0000 UTC m=+1739.339631059"
Jul 23 16:19:19.405967 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:19.405938    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:36.433307 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:36.433274    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz"]
Jul 23 16:19:36.437046 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:36.437027    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz"
Jul 23 16:19:36.439993 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:36.439970    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:19:36.447075 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:36.447050    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz"]
Jul 23 16:19:36.548170 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:36.548133    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/090152fb-f4df-4cfd-87b5-f925ad334c4e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz\" (UID: \"090152fb-f4df-4cfd-87b5-f925ad334c4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz"
Jul 23 16:19:36.649303 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:36.649259    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/090152fb-f4df-4cfd-87b5-f925ad334c4e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz\" (UID: \"090152fb-f4df-4cfd-87b5-f925ad334c4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz"
Jul 23 16:19:36.649893 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:36.649873    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/090152fb-f4df-4cfd-87b5-f925ad334c4e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz\" (UID: \"090152fb-f4df-4cfd-87b5-f925ad334c4e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz"
Jul 23 16:19:36.749613 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:36.749572    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz"
Jul 23 16:19:36.894422 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:36.894394    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz"]
Jul 23 16:19:36.895695 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:19:36.895666    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod090152fb_f4df_4cfd_87b5_f925ad334c4e.slice/crio-0b7e5f49210e258caf6dde29554b63cb67d0c47a6bcac80dd5061e9876d806ed WatchSource:0}: Error finding container 0b7e5f49210e258caf6dde29554b63cb67d0c47a6bcac80dd5061e9876d806ed: Status 404 returned error can't find the container with id 0b7e5f49210e258caf6dde29554b63cb67d0c47a6bcac80dd5061e9876d806ed
Jul 23 16:19:37.531536 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:37.531501    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz" event={"ID":"090152fb-f4df-4cfd-87b5-f925ad334c4e","Type":"ContainerStarted","Data":"c95f5a05fde5231477c392694a1686661f90209c99012182858933f2603f4b98"}
Jul 23 16:19:37.531929 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:37.531555    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz" event={"ID":"090152fb-f4df-4cfd-87b5-f925ad334c4e","Type":"ContainerStarted","Data":"0b7e5f49210e258caf6dde29554b63cb67d0c47a6bcac80dd5061e9876d806ed"}
Jul 23 16:19:37.552530 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:37.552468    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz" podStartSLOduration=1.5524525169999999 podStartE2EDuration="1.552452517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:19:37.548712613 +0000 UTC m=+1763.472567250" watchObservedRunningTime="2026-07-23 16:19:37.552452517 +0000 UTC m=+1763.476307151"
Jul 23 16:19:38.540312 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:38.540276    2570 generic.go:356] "Generic (PLEG): container finished" podID="090152fb-f4df-4cfd-87b5-f925ad334c4e" containerID="c95f5a05fde5231477c392694a1686661f90209c99012182858933f2603f4b98" exitCode=0
Jul 23 16:19:38.540791 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:38.540368    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz" event={"ID":"090152fb-f4df-4cfd-87b5-f925ad334c4e","Type":"ContainerDied","Data":"c95f5a05fde5231477c392694a1686661f90209c99012182858933f2603f4b98"}
Jul 23 16:19:39.680932 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:39.680908    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz"
Jul 23 16:19:39.780230 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:39.780191    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/090152fb-f4df-4cfd-87b5-f925ad334c4e-maas-api-service-ca\") pod \"090152fb-f4df-4cfd-87b5-f925ad334c4e\" (UID: \"090152fb-f4df-4cfd-87b5-f925ad334c4e\") "
Jul 23 16:19:39.780575 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:39.780551    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/090152fb-f4df-4cfd-87b5-f925ad334c4e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "090152fb-f4df-4cfd-87b5-f925ad334c4e" (UID: "090152fb-f4df-4cfd-87b5-f925ad334c4e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:19:39.881464 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:39.881367    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/090152fb-f4df-4cfd-87b5-f925ad334c4e-maas-api-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:19:40.553052 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:40.553002    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz"
Jul 23 16:19:40.553052 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:40.553046    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz" event={"ID":"090152fb-f4df-4cfd-87b5-f925ad334c4e","Type":"ContainerDied","Data":"0b7e5f49210e258caf6dde29554b63cb67d0c47a6bcac80dd5061e9876d806ed"}
Jul 23 16:19:40.553280 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:40.553095    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b7e5f49210e258caf6dde29554b63cb67d0c47a6bcac80dd5061e9876d806ed"
Jul 23 16:19:47.220699 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.220666    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"]
Jul 23 16:19:47.221198 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.220949    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99" podUID="2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf" containerName="maas-api" containerID="cri-o://ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433" gracePeriod=30
Jul 23 16:19:47.258373 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.258338    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:47.485100 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.485033    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:47.596949 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.596907    2570 generic.go:356] "Generic (PLEG): container finished" podID="2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf" containerID="ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433" exitCode=0
Jul 23 16:19:47.596949 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.596944    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"
Jul 23 16:19:47.597237 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.596966    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99" event={"ID":"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf","Type":"ContainerDied","Data":"ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433"}
Jul 23 16:19:47.597237 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.597040    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99" event={"ID":"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf","Type":"ContainerDied","Data":"849bac8cf2607cbd2add2490728edb698f08e88620d3ea1d3f5d17bbf6e5a0c0"}
Jul 23 16:19:47.597237 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.597066    2570 scope.go:117] "RemoveContainer" containerID="ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433"
Jul 23 16:19:47.606380 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.606358    2570 scope.go:117] "RemoveContainer" containerID="ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433"
Jul 23 16:19:47.606653 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:19:47.606633    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433\": container with ID starting with ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433 not found: ID does not exist" containerID="ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433"
Jul 23 16:19:47.606713 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.606665    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433"} err="failed to get container status \"ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433\": rpc error: code = NotFound desc = could not find container \"ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433\": container with ID starting with ab332c13731309302f2f873dcd29a23584afd35499d71b0acf06e9269d64c433 not found: ID does not exist"
Jul 23 16:19:47.650084 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.650047    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-openshift-service-ca\") pod \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") "
Jul 23 16:19:47.650289 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.650107    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zsbqs\" (UniqueName: \"kubernetes.io/projected/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-kube-api-access-zsbqs\") pod \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") "
Jul 23 16:19:47.650289 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.650171    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-maas-api-tls\") pod \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\" (UID: \"2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf\") "
Jul 23 16:19:47.650429 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.650403    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf" (UID: "2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:19:47.652354 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.652330    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf" (UID: "2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:19:47.652545 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.652527    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-kube-api-access-zsbqs" (OuterVolumeSpecName: "kube-api-access-zsbqs") pod "2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf" (UID: "2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf"). InnerVolumeSpecName "kube-api-access-zsbqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:19:47.751059 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.750940    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-openshift-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:19:47.751059 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.750976    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zsbqs\" (UniqueName: \"kubernetes.io/projected/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-kube-api-access-zsbqs\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:19:47.751059 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.750988    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf-maas-api-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:19:47.922490 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.922457    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"]
Jul 23 16:19:47.928756 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:47.928728    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f8d3e728-59675d5f8c-72z99"]
Jul 23 16:19:48.604709 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:48.604671    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf" path="/var/lib/kubelet/pods/2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf/volumes"
Jul 23 16:19:51.516694 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:51.516661    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:51.517288 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:51.517255    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz"]
Jul 23 16:19:51.520801 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:51.520774    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f8d3e728-nk2qz"]
Jul 23 16:19:51.722640 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:51.722610    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:51.970403 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:51.970372    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:52.255641 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:52.255544    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:52.347054 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:52.346998    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:52.483623 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:52.483591    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:52.608236 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:52.605318    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="090152fb-f4df-4cfd-87b5-f925ad334c4e" path="/var/lib/kubelet/pods/090152fb-f4df-4cfd-87b5-f925ad334c4e/volumes"
Jul 23 16:19:52.840873 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:52.840815    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:53.003734 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:53.003689    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:55.215429 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.215389    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"]
Jul 23 16:19:55.215840 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.215826    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf" containerName="maas-api"
Jul 23 16:19:55.215886 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.215842    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf" containerName="maas-api"
Jul 23 16:19:55.215886 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.215852    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="090152fb-f4df-4cfd-87b5-f925ad334c4e" containerName="revoke-keys"
Jul 23 16:19:55.215886 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.215860    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="090152fb-f4df-4cfd-87b5-f925ad334c4e" containerName="revoke-keys"
Jul 23 16:19:55.215974 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.215923    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bebfbb1-17ac-44bf-ae15-d7a15a4c3cbf" containerName="maas-api"
Jul 23 16:19:55.215974 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.215934    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="090152fb-f4df-4cfd-87b5-f925ad334c4e" containerName="revoke-keys"
Jul 23 16:19:55.220353 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.220332    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:19:55.222906 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.222883    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-ad12ff20-serving-cert\""
Jul 23 16:19:55.231941 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.231915    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"]
Jul 23 16:19:55.253495 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.253459    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:55.313581 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.313548    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83ad1fde-606c-4505-8540-e7c705f3de6e-openshift-service-ca\") pod \"maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl\" (UID: \"83ad1fde-606c-4505-8540-e7c705f3de6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:19:55.313581 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.313586    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwhs7\" (UniqueName: \"kubernetes.io/projected/83ad1fde-606c-4505-8540-e7c705f3de6e-kube-api-access-vwhs7\") pod \"maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl\" (UID: \"83ad1fde-606c-4505-8540-e7c705f3de6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:19:55.313842 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.313662    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83ad1fde-606c-4505-8540-e7c705f3de6e-maas-api-tls\") pod \"maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl\" (UID: \"83ad1fde-606c-4505-8540-e7c705f3de6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:19:55.355611 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.355578    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:55.414739 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.414701    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83ad1fde-606c-4505-8540-e7c705f3de6e-openshift-service-ca\") pod \"maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl\" (UID: \"83ad1fde-606c-4505-8540-e7c705f3de6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:19:55.414739 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.414735    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwhs7\" (UniqueName: \"kubernetes.io/projected/83ad1fde-606c-4505-8540-e7c705f3de6e-kube-api-access-vwhs7\") pod \"maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl\" (UID: \"83ad1fde-606c-4505-8540-e7c705f3de6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:19:55.414996 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.414771    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83ad1fde-606c-4505-8540-e7c705f3de6e-maas-api-tls\") pod \"maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl\" (UID: \"83ad1fde-606c-4505-8540-e7c705f3de6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:19:55.415447 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.415427    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83ad1fde-606c-4505-8540-e7c705f3de6e-openshift-service-ca\") pod \"maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl\" (UID: \"83ad1fde-606c-4505-8540-e7c705f3de6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:19:55.417386 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.417364    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83ad1fde-606c-4505-8540-e7c705f3de6e-maas-api-tls\") pod \"maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl\" (UID: \"83ad1fde-606c-4505-8540-e7c705f3de6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:19:55.422830 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.422808    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwhs7\" (UniqueName: \"kubernetes.io/projected/83ad1fde-606c-4505-8540-e7c705f3de6e-kube-api-access-vwhs7\") pod \"maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl\" (UID: \"83ad1fde-606c-4505-8540-e7c705f3de6e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:19:55.454024 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.453979    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:55.533780 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.533672    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:19:55.683751 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.683717    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"]
Jul 23 16:19:55.684732 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:19:55.684707    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83ad1fde_606c_4505_8540_e7c705f3de6e.slice/crio-68c871449162d105971ba78aca49f9f6c677cf133f3a9f6aadd77d2d805b1a9f WatchSource:0}: Error finding container 68c871449162d105971ba78aca49f9f6c677cf133f3a9f6aadd77d2d805b1a9f: Status 404 returned error can't find the container with id 68c871449162d105971ba78aca49f9f6c677cf133f3a9f6aadd77d2d805b1a9f
Jul 23 16:19:55.761958 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.761910    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:55.862997 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:55.862906    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:19:56.658074 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:56.658035    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl" event={"ID":"83ad1fde-606c-4505-8540-e7c705f3de6e","Type":"ContainerStarted","Data":"4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833"}
Jul 23 16:19:56.658511 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:56.658095    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl" event={"ID":"83ad1fde-606c-4505-8540-e7c705f3de6e","Type":"ContainerStarted","Data":"68c871449162d105971ba78aca49f9f6c677cf133f3a9f6aadd77d2d805b1a9f"}
Jul 23 16:19:56.658511 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:56.658174    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:19:56.686676 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:19:56.686624    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl" podStartSLOduration=1.214008792 podStartE2EDuration="1.686608672s" totalImagesPullingTime="472.59988ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:19:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:19:56.683995957 +0000 UTC m=+1782.607850590" watchObservedRunningTime="2026-07-23 16:19:56.686608672 +0000 UTC m=+1782.610463304"
Jul 23 16:20:02.670063 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:02.670029    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:20:20.230085 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:20.230048    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8"]
Jul 23 16:20:20.233758 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:20.233737    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8"
Jul 23 16:20:20.236538 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:20.236514    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:20:20.241438 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:20.241410    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8"]
Jul 23 16:20:20.366362 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:20.366328    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5671e55d-25e4-4de2-bfdd-3476affaa735-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8\" (UID: \"5671e55d-25e4-4de2-bfdd-3476affaa735\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8"
Jul 23 16:20:20.467240 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:20.467197    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5671e55d-25e4-4de2-bfdd-3476affaa735-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8\" (UID: \"5671e55d-25e4-4de2-bfdd-3476affaa735\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8"
Jul 23 16:20:20.467835 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:20.467813    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5671e55d-25e4-4de2-bfdd-3476affaa735-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8\" (UID: \"5671e55d-25e4-4de2-bfdd-3476affaa735\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8"
Jul 23 16:20:20.546387 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:20.546296    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8"
Jul 23 16:20:20.704026 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:20.703928    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8"]
Jul 23 16:20:20.706218 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:20:20.706189    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5671e55d_25e4_4de2_bfdd_3476affaa735.slice/crio-9e4ccc43d990007297486737509a9a712089dd1b72889f230bb83a8d51341e11 WatchSource:0}: Error finding container 9e4ccc43d990007297486737509a9a712089dd1b72889f230bb83a8d51341e11: Status 404 returned error can't find the container with id 9e4ccc43d990007297486737509a9a712089dd1b72889f230bb83a8d51341e11
Jul 23 16:20:20.804741 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:20.804644    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8" event={"ID":"5671e55d-25e4-4de2-bfdd-3476affaa735","Type":"ContainerStarted","Data":"9e4ccc43d990007297486737509a9a712089dd1b72889f230bb83a8d51341e11"}
Jul 23 16:20:21.812178 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:21.812082    2570 generic.go:356] "Generic (PLEG): container finished" podID="5671e55d-25e4-4de2-bfdd-3476affaa735" containerID="17b9d922a541c14566dcc554fc1b3509ae89385340943d1ed33ec2ffd0fafea7" exitCode=0
Jul 23 16:20:21.812178 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:21.812166    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8" event={"ID":"5671e55d-25e4-4de2-bfdd-3476affaa735","Type":"ContainerDied","Data":"17b9d922a541c14566dcc554fc1b3509ae89385340943d1ed33ec2ffd0fafea7"}
Jul 23 16:20:22.959636 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:22.959607    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8"
Jul 23 16:20:23.093612 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:23.093513    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5671e55d-25e4-4de2-bfdd-3476affaa735-maas-api-service-ca\") pod \"5671e55d-25e4-4de2-bfdd-3476affaa735\" (UID: \"5671e55d-25e4-4de2-bfdd-3476affaa735\") "
Jul 23 16:20:23.093933 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:23.093910    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5671e55d-25e4-4de2-bfdd-3476affaa735-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5671e55d-25e4-4de2-bfdd-3476affaa735" (UID: "5671e55d-25e4-4de2-bfdd-3476affaa735"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:20:23.195225 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:23.195181    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5671e55d-25e4-4de2-bfdd-3476affaa735-maas-api-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:20:23.830733 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:23.830694    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8" event={"ID":"5671e55d-25e4-4de2-bfdd-3476affaa735","Type":"ContainerDied","Data":"9e4ccc43d990007297486737509a9a712089dd1b72889f230bb83a8d51341e11"}
Jul 23 16:20:23.830733 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:23.830729    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8"
Jul 23 16:20:23.830952 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:23.830784    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e4ccc43d990007297486737509a9a712089dd1b72889f230bb83a8d51341e11"
Jul 23 16:20:30.778075 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:30.778033    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"]
Jul 23 16:20:30.778552 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:30.778304    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl" podUID="83ad1fde-606c-4505-8540-e7c705f3de6e" containerName="maas-api" containerID="cri-o://4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833" gracePeriod=30
Jul 23 16:20:30.817238 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:30.817199    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:31.034145 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.034083    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:20:31.076695 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.076666    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83ad1fde-606c-4505-8540-e7c705f3de6e-maas-api-tls\") pod \"83ad1fde-606c-4505-8540-e7c705f3de6e\" (UID: \"83ad1fde-606c-4505-8540-e7c705f3de6e\") "
Jul 23 16:20:31.076864 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.076710    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwhs7\" (UniqueName: \"kubernetes.io/projected/83ad1fde-606c-4505-8540-e7c705f3de6e-kube-api-access-vwhs7\") pod \"83ad1fde-606c-4505-8540-e7c705f3de6e\" (UID: \"83ad1fde-606c-4505-8540-e7c705f3de6e\") "
Jul 23 16:20:31.076864 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.076747    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83ad1fde-606c-4505-8540-e7c705f3de6e-openshift-service-ca\") pod \"83ad1fde-606c-4505-8540-e7c705f3de6e\" (UID: \"83ad1fde-606c-4505-8540-e7c705f3de6e\") "
Jul 23 16:20:31.077299 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.077266    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83ad1fde-606c-4505-8540-e7c705f3de6e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "83ad1fde-606c-4505-8540-e7c705f3de6e" (UID: "83ad1fde-606c-4505-8540-e7c705f3de6e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:20:31.078961 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.078936    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/83ad1fde-606c-4505-8540-e7c705f3de6e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "83ad1fde-606c-4505-8540-e7c705f3de6e" (UID: "83ad1fde-606c-4505-8540-e7c705f3de6e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:20:31.079080 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.079047    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ad1fde-606c-4505-8540-e7c705f3de6e-kube-api-access-vwhs7" (OuterVolumeSpecName: "kube-api-access-vwhs7") pod "83ad1fde-606c-4505-8540-e7c705f3de6e" (UID: "83ad1fde-606c-4505-8540-e7c705f3de6e"). InnerVolumeSpecName "kube-api-access-vwhs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:20:31.178181 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.178144    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/83ad1fde-606c-4505-8540-e7c705f3de6e-maas-api-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:20:31.178181 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.178183    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwhs7\" (UniqueName: \"kubernetes.io/projected/83ad1fde-606c-4505-8540-e7c705f3de6e-kube-api-access-vwhs7\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:20:31.178398 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.178198    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/83ad1fde-606c-4505-8540-e7c705f3de6e-openshift-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:20:31.879353 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.879313    2570 generic.go:356] "Generic (PLEG): container finished" podID="83ad1fde-606c-4505-8540-e7c705f3de6e" containerID="4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833" exitCode=0
Jul 23 16:20:31.879792 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.879357    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"
Jul 23 16:20:31.879792 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.879398    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl" event={"ID":"83ad1fde-606c-4505-8540-e7c705f3de6e","Type":"ContainerDied","Data":"4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833"}
Jul 23 16:20:31.879792 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.879450    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl" event={"ID":"83ad1fde-606c-4505-8540-e7c705f3de6e","Type":"ContainerDied","Data":"68c871449162d105971ba78aca49f9f6c677cf133f3a9f6aadd77d2d805b1a9f"}
Jul 23 16:20:31.879792 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.879474    2570 scope.go:117] "RemoveContainer" containerID="4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833"
Jul 23 16:20:31.889056 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.889003    2570 scope.go:117] "RemoveContainer" containerID="4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833"
Jul 23 16:20:31.889323 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:20:31.889302    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833\": container with ID starting with 4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833 not found: ID does not exist" containerID="4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833"
Jul 23 16:20:31.889389 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.889336    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833"} err="failed to get container status \"4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833\": rpc error: code = NotFound desc = could not find container \"4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833\": container with ID starting with 4accbd8962bafdf944da1adb3ce7f7a4e2985f811d66241f82b23a7e06914833 not found: ID does not exist"
Jul 23 16:20:31.907117 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.907085    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"]
Jul 23 16:20:31.909687 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:31.909666    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-ad12ff20-8485fc5dd9-gq6tl"]
Jul 23 16:20:32.604512 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:32.604478    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83ad1fde-606c-4505-8540-e7c705f3de6e" path="/var/lib/kubelet/pods/83ad1fde-606c-4505-8540-e7c705f3de6e/volumes"
Jul 23 16:20:35.319259 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:35.319224    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:35.321620 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:35.321553    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8"]
Jul 23 16:20:35.324397 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:35.324363    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ad12ff20-6qxr8"]
Jul 23 16:20:35.513498 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:35.513463    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:35.740992 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:35.740951    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:35.998437 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:35.998345    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:36.355653 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:36.355555    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:36.471373 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:36.471335    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:36.605186 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:36.605153    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5671e55d-25e4-4de2-bfdd-3476affaa735" path="/var/lib/kubelet/pods/5671e55d-25e4-4de2-bfdd-3476affaa735/volumes"
Jul 23 16:20:38.259827 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.259787    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:38.367293 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.367257    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:38.375680 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.375648    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"]
Jul 23 16:20:38.376341 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.376320    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5671e55d-25e4-4de2-bfdd-3476affaa735" containerName="revoke-keys"
Jul 23 16:20:38.376408 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.376346    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5671e55d-25e4-4de2-bfdd-3476affaa735" containerName="revoke-keys"
Jul 23 16:20:38.376446 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.376407    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83ad1fde-606c-4505-8540-e7c705f3de6e" containerName="maas-api"
Jul 23 16:20:38.376446 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.376418    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ad1fde-606c-4505-8540-e7c705f3de6e" containerName="maas-api"
Jul 23 16:20:38.376598 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.376583    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="83ad1fde-606c-4505-8540-e7c705f3de6e" containerName="maas-api"
Jul 23 16:20:38.376634 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.376604    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5671e55d-25e4-4de2-bfdd-3476affaa735" containerName="revoke-keys"
Jul 23 16:20:38.381637 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.381614    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:20:38.385364 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.385340    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-12b5e3d2-serving-cert\""
Jul 23 16:20:38.394835 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.394807    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"]
Jul 23 16:20:38.447344 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.447306    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-294k7\" (UniqueName: \"kubernetes.io/projected/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-kube-api-access-294k7\") pod \"maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj\" (UID: \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:20:38.447532 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.447389    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-openshift-service-ca\") pod \"maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj\" (UID: \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:20:38.447532 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.447477    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-maas-api-tls\") pod \"maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj\" (UID: \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:20:38.465037 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.464971    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:38.548678 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.548578    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-openshift-service-ca\") pod \"maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj\" (UID: \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:20:38.548678 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.548675    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-maas-api-tls\") pod \"maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj\" (UID: \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:20:38.548926 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.548737    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-294k7\" (UniqueName: \"kubernetes.io/projected/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-kube-api-access-294k7\") pod \"maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj\" (UID: \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:20:38.549372 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.549341    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-openshift-service-ca\") pod \"maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj\" (UID: \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:20:38.551394 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.551369    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-maas-api-tls\") pod \"maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj\" (UID: \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:20:38.560586 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.560553    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-294k7\" (UniqueName: \"kubernetes.io/projected/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-kube-api-access-294k7\") pod \"maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj\" (UID: \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:20:38.573588 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.573554    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:38.692979 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.692928    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:20:38.844908 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.844881    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"]
Jul 23 16:20:38.847245 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:20:38.847212    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d9fd317_c81d_4a34_b0f4_f984c4511bd7.slice/crio-62ff2e4933de8509ea3b4fc9835925ab792c3e82787d2989967c4bdbc2b68d45 WatchSource:0}: Error finding container 62ff2e4933de8509ea3b4fc9835925ab792c3e82787d2989967c4bdbc2b68d45: Status 404 returned error can't find the container with id 62ff2e4933de8509ea3b4fc9835925ab792c3e82787d2989967c4bdbc2b68d45
Jul 23 16:20:38.848658 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.848637    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:20:38.922896 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:38.922861    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj" event={"ID":"2d9fd317-c81d-4a34-b0f4-f984c4511bd7","Type":"ContainerStarted","Data":"62ff2e4933de8509ea3b4fc9835925ab792c3e82787d2989967c4bdbc2b68d45"}
Jul 23 16:20:39.101926 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:39.101829    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:39.248963 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:39.248914    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:20:39.932084 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:39.932006    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj" event={"ID":"2d9fd317-c81d-4a34-b0f4-f984c4511bd7","Type":"ContainerStarted","Data":"127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070"}
Jul 23 16:20:39.932599 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:39.932235    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:20:39.950494 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:39.950441    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj" podStartSLOduration=1.520657468 podStartE2EDuration="1.950423923s" totalImagesPullingTime="429.766455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:20:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:20:39.948990764 +0000 UTC m=+1825.872845402" watchObservedRunningTime="2026-07-23 16:20:39.950423923 +0000 UTC m=+1825.874278556"
Jul 23 16:20:45.946889 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:20:45.946795    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:21:04.234143 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:04.234106    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl"]
Jul 23 16:21:04.238118 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:04.238093    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl"
Jul 23 16:21:04.240898 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:04.240873    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:21:04.247629 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:04.247581    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl"]
Jul 23 16:21:04.400944 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:04.400911    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b3f975-9fdf-4689-82e5-cfe09961f9dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl\" (UID: \"26b3f975-9fdf-4689-82e5-cfe09961f9dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl"
Jul 23 16:21:04.502514 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:04.502415    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b3f975-9fdf-4689-82e5-cfe09961f9dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl\" (UID: \"26b3f975-9fdf-4689-82e5-cfe09961f9dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl"
Jul 23 16:21:04.503116 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:04.503094    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b3f975-9fdf-4689-82e5-cfe09961f9dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl\" (UID: \"26b3f975-9fdf-4689-82e5-cfe09961f9dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl"
Jul 23 16:21:04.554001 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:04.553964    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl"
Jul 23 16:21:04.705168 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:04.705136    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl"]
Jul 23 16:21:04.706681 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:21:04.706656    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b3f975_9fdf_4689_82e5_cfe09961f9dc.slice/crio-4e6e6cd223545423a938e2b19ab3e1a13a1f4566e6293c7c41729b24478a22ab WatchSource:0}: Error finding container 4e6e6cd223545423a938e2b19ab3e1a13a1f4566e6293c7c41729b24478a22ab: Status 404 returned error can't find the container with id 4e6e6cd223545423a938e2b19ab3e1a13a1f4566e6293c7c41729b24478a22ab
Jul 23 16:21:05.086791 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:05.086747    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl" event={"ID":"26b3f975-9fdf-4689-82e5-cfe09961f9dc","Type":"ContainerStarted","Data":"4e6e6cd223545423a938e2b19ab3e1a13a1f4566e6293c7c41729b24478a22ab"}
Jul 23 16:21:06.058325 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:06.058284    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:06.093809 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:06.093777    2570 generic.go:356] "Generic (PLEG): container finished" podID="26b3f975-9fdf-4689-82e5-cfe09961f9dc" containerID="20fd69f32c283f8ff02730eaccfa06d938130be7d17b14feb5db4d09462fa9b9" exitCode=0
Jul 23 16:21:06.094003 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:06.093859    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl" event={"ID":"26b3f975-9fdf-4689-82e5-cfe09961f9dc","Type":"ContainerDied","Data":"20fd69f32c283f8ff02730eaccfa06d938130be7d17b14feb5db4d09462fa9b9"}
Jul 23 16:21:07.240859 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:07.240832    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl"
Jul 23 16:21:07.331325 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:07.331288    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b3f975-9fdf-4689-82e5-cfe09961f9dc-maas-api-service-ca\") pod \"26b3f975-9fdf-4689-82e5-cfe09961f9dc\" (UID: \"26b3f975-9fdf-4689-82e5-cfe09961f9dc\") "
Jul 23 16:21:07.331658 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:07.331636    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26b3f975-9fdf-4689-82e5-cfe09961f9dc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "26b3f975-9fdf-4689-82e5-cfe09961f9dc" (UID: "26b3f975-9fdf-4689-82e5-cfe09961f9dc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:21:07.432734 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:07.432638    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/26b3f975-9fdf-4689-82e5-cfe09961f9dc-maas-api-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:21:07.874287 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:07.874249    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:08.106682 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:08.106645    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:08.110585 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:08.110556    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl" event={"ID":"26b3f975-9fdf-4689-82e5-cfe09961f9dc","Type":"ContainerDied","Data":"4e6e6cd223545423a938e2b19ab3e1a13a1f4566e6293c7c41729b24478a22ab"}
Jul 23 16:21:08.110733 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:08.110604    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e6e6cd223545423a938e2b19ab3e1a13a1f4566e6293c7c41729b24478a22ab"
Jul 23 16:21:08.110733 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:08.110564    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl"
Jul 23 16:21:14.960558 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:14.960500    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:15.074887 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.074845    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:15.198860 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.198771    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"]
Jul 23 16:21:15.199365 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.199331    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj" podUID="2d9fd317-c81d-4a34-b0f4-f984c4511bd7" containerName="maas-api" containerID="cri-o://127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070" gracePeriod=30
Jul 23 16:21:15.230782 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.230747    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:15.454152 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.454086    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:21:15.509335 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.509303    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-openshift-service-ca\") pod \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\" (UID: \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\") "
Jul 23 16:21:15.509504 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.509351    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-maas-api-tls\") pod \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\" (UID: \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\") "
Jul 23 16:21:15.509504 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.509385    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-294k7\" (UniqueName: \"kubernetes.io/projected/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-kube-api-access-294k7\") pod \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\" (UID: \"2d9fd317-c81d-4a34-b0f4-f984c4511bd7\") "
Jul 23 16:21:15.509752 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.509722    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2d9fd317-c81d-4a34-b0f4-f984c4511bd7" (UID: "2d9fd317-c81d-4a34-b0f4-f984c4511bd7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:21:15.511500 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.511468    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-kube-api-access-294k7" (OuterVolumeSpecName: "kube-api-access-294k7") pod "2d9fd317-c81d-4a34-b0f4-f984c4511bd7" (UID: "2d9fd317-c81d-4a34-b0f4-f984c4511bd7"). InnerVolumeSpecName "kube-api-access-294k7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:21:15.511500 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.511492    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2d9fd317-c81d-4a34-b0f4-f984c4511bd7" (UID: "2d9fd317-c81d-4a34-b0f4-f984c4511bd7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:21:15.610481 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.610445    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-openshift-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:21:15.610481 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.610477    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-maas-api-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:21:15.610685 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:15.610490    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-294k7\" (UniqueName: \"kubernetes.io/projected/2d9fd317-c81d-4a34-b0f4-f984c4511bd7-kube-api-access-294k7\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:21:16.157555 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:16.157522    2570 generic.go:356] "Generic (PLEG): container finished" podID="2d9fd317-c81d-4a34-b0f4-f984c4511bd7" containerID="127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070" exitCode=0
Jul 23 16:21:16.158035 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:16.157570    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"
Jul 23 16:21:16.158035 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:16.157596    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj" event={"ID":"2d9fd317-c81d-4a34-b0f4-f984c4511bd7","Type":"ContainerDied","Data":"127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070"}
Jul 23 16:21:16.158035 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:16.157641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj" event={"ID":"2d9fd317-c81d-4a34-b0f4-f984c4511bd7","Type":"ContainerDied","Data":"62ff2e4933de8509ea3b4fc9835925ab792c3e82787d2989967c4bdbc2b68d45"}
Jul 23 16:21:16.158035 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:16.157666    2570 scope.go:117] "RemoveContainer" containerID="127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070"
Jul 23 16:21:16.169044 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:16.168990    2570 scope.go:117] "RemoveContainer" containerID="127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070"
Jul 23 16:21:16.169383 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:21:16.169361    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070\": container with ID starting with 127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070 not found: ID does not exist" containerID="127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070"
Jul 23 16:21:16.169432 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:16.169393    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070"} err="failed to get container status \"127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070\": rpc error: code = NotFound desc = could not find container \"127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070\": container with ID starting with 127829a7a2e9a3e2847be8970f39524aac1937d40f756280194b7415ebddb070 not found: ID does not exist"
Jul 23 16:21:16.181623 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:16.181597    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"]
Jul 23 16:21:16.185290 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:16.185269    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-12b5e3d2-8564bcb4c4-psslj"]
Jul 23 16:21:16.603414 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:16.603381    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d9fd317-c81d-4a34-b0f4-f984c4511bd7" path="/var/lib/kubelet/pods/2d9fd317-c81d-4a34-b0f4-f984c4511bd7/volumes"
Jul 23 16:21:19.314074 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:19.314029    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:19.315640 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:19.315619    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl"]
Jul 23 16:21:19.318993 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:19.318969    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-12b5e3d2-xkzzl"]
Jul 23 16:21:20.603722 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:20.603685    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26b3f975-9fdf-4689-82e5-cfe09961f9dc" path="/var/lib/kubelet/pods/26b3f975-9fdf-4689-82e5-cfe09961f9dc/volumes"
Jul 23 16:21:20.683950 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:20.683915    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:21.150044 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:21.149973    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:21.206708 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:21.206671    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:21.493995 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:21.493951    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:21.574614 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:21.574571    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:23.547092 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.547060    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:23.635346 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.635315    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"]
Jul 23 16:21:23.635839 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.635822    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d9fd317-c81d-4a34-b0f4-f984c4511bd7" containerName="maas-api"
Jul 23 16:21:23.635956 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.635841    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d9fd317-c81d-4a34-b0f4-f984c4511bd7" containerName="maas-api"
Jul 23 16:21:23.635956 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.635859    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26b3f975-9fdf-4689-82e5-cfe09961f9dc" containerName="revoke-keys"
Jul 23 16:21:23.635956 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.635867    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="26b3f975-9fdf-4689-82e5-cfe09961f9dc" containerName="revoke-keys"
Jul 23 16:21:23.636149 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.636027    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d9fd317-c81d-4a34-b0f4-f984c4511bd7" containerName="maas-api"
Jul 23 16:21:23.636149 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.636039    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="26b3f975-9fdf-4689-82e5-cfe09961f9dc" containerName="revoke-keys"
Jul 23 16:21:23.640816 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.640782    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:23.644869 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.644800    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-5bb1d507-serving-cert\""
Jul 23 16:21:23.656509 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.656483    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"]
Jul 23 16:21:23.657675 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.657575    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:23.685054 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.685000    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-maas-api-tls\") pod \"maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr\" (UID: \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:23.685200 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.685124    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-openshift-service-ca\") pod \"maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr\" (UID: \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:23.685264 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.685244    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqs2v\" (UniqueName: \"kubernetes.io/projected/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-kube-api-access-vqs2v\") pod \"maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr\" (UID: \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:23.749886 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.749846    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:23.785792 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.785752    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqs2v\" (UniqueName: \"kubernetes.io/projected/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-kube-api-access-vqs2v\") pod \"maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr\" (UID: \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:23.785978 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.785822    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-maas-api-tls\") pod \"maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr\" (UID: \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:23.785978 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.785897    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-openshift-service-ca\") pod \"maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr\" (UID: \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:23.786650 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.786621    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-openshift-service-ca\") pod \"maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr\" (UID: \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:23.788461 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.788437    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-maas-api-tls\") pod \"maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr\" (UID: \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:23.795768 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.795740    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqs2v\" (UniqueName: \"kubernetes.io/projected/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-kube-api-access-vqs2v\") pod \"maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr\" (UID: \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:23.856615 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.856529    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:23.951665 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:23.951628    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:24.121680 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:24.121650    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"]
Jul 23 16:21:24.122736 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:21:24.122711    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af9c3a7_e626_4e1b_a15f_02e60d2ae2d8.slice/crio-891bb09e17f47e7d2f3af65dec1b0a4a3b80bccefd07ab9e405ac105ce9f79ec WatchSource:0}: Error finding container 891bb09e17f47e7d2f3af65dec1b0a4a3b80bccefd07ab9e405ac105ce9f79ec: Status 404 returned error can't find the container with id 891bb09e17f47e7d2f3af65dec1b0a4a3b80bccefd07ab9e405ac105ce9f79ec
Jul 23 16:21:24.216398 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:24.216360    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr" event={"ID":"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8","Type":"ContainerStarted","Data":"891bb09e17f47e7d2f3af65dec1b0a4a3b80bccefd07ab9e405ac105ce9f79ec"}
Jul 23 16:21:24.460510 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:24.460422    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:24.560954 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:24.560911    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:26.229452 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:26.229416    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr" event={"ID":"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8","Type":"ContainerStarted","Data":"88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942"}
Jul 23 16:21:26.229965 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:26.229536    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:26.249075 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:26.248994    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr" podStartSLOduration=2.000438818 podStartE2EDuration="3.248974853s" totalImagesPullingTime="1.248536035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:21:26.246194069 +0000 UTC m=+1872.170048717" watchObservedRunningTime="2026-07-23 16:21:26.248974853 +0000 UTC m=+1872.172829486"
Jul 23 16:21:32.241583 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:32.241549    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:48.426173 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:48.426138    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg"]
Jul 23 16:21:48.429757 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:48.429732    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg"
Jul 23 16:21:48.432607 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:48.432570    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:21:48.438209 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:48.438172    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg"]
Jul 23 16:21:48.536932 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:48.536879    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8107c72e-2c61-41f9-bacd-9ecabef47bbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg\" (UID: \"8107c72e-2c61-41f9-bacd-9ecabef47bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg"
Jul 23 16:21:48.637660 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:48.637626    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8107c72e-2c61-41f9-bacd-9ecabef47bbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg\" (UID: \"8107c72e-2c61-41f9-bacd-9ecabef47bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg"
Jul 23 16:21:48.638340 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:48.638321    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8107c72e-2c61-41f9-bacd-9ecabef47bbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg\" (UID: \"8107c72e-2c61-41f9-bacd-9ecabef47bbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg"
Jul 23 16:21:48.747880 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:48.747846    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg"
Jul 23 16:21:48.897667 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:48.897636    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg"]
Jul 23 16:21:48.899237 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:21:48.899208    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8107c72e_2c61_41f9_bacd_9ecabef47bbd.slice/crio-eceea0bde5cb1185ccb3a721ed54cad069425a1035fb08d60a071b7a89fcc030 WatchSource:0}: Error finding container eceea0bde5cb1185ccb3a721ed54cad069425a1035fb08d60a071b7a89fcc030: Status 404 returned error can't find the container with id eceea0bde5cb1185ccb3a721ed54cad069425a1035fb08d60a071b7a89fcc030
Jul 23 16:21:49.365994 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:49.365953    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg" event={"ID":"8107c72e-2c61-41f9-bacd-9ecabef47bbd","Type":"ContainerStarted","Data":"5540efe91235a1ff20a906984de4983156ec2fc703422acb0fec8f1516f6e6cc"}
Jul 23 16:21:49.366200 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:49.366042    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg" event={"ID":"8107c72e-2c61-41f9-bacd-9ecabef47bbd","Type":"ContainerStarted","Data":"eceea0bde5cb1185ccb3a721ed54cad069425a1035fb08d60a071b7a89fcc030"}
Jul 23 16:21:49.382611 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:49.382558    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg" podStartSLOduration=1.382542081 podStartE2EDuration="1.382542081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:21:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:21:49.381345243 +0000 UTC m=+1895.305199878" watchObservedRunningTime="2026-07-23 16:21:49.382542081 +0000 UTC m=+1895.306396715"
Jul 23 16:21:50.374077 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:50.374037    2570 generic.go:356] "Generic (PLEG): container finished" podID="8107c72e-2c61-41f9-bacd-9ecabef47bbd" containerID="5540efe91235a1ff20a906984de4983156ec2fc703422acb0fec8f1516f6e6cc" exitCode=0
Jul 23 16:21:50.374547 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:50.374128    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg" event={"ID":"8107c72e-2c61-41f9-bacd-9ecabef47bbd","Type":"ContainerDied","Data":"5540efe91235a1ff20a906984de4983156ec2fc703422acb0fec8f1516f6e6cc"}
Jul 23 16:21:51.519265 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:51.519231    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg"
Jul 23 16:21:51.565997 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:51.565952    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8107c72e-2c61-41f9-bacd-9ecabef47bbd-maas-api-service-ca\") pod \"8107c72e-2c61-41f9-bacd-9ecabef47bbd\" (UID: \"8107c72e-2c61-41f9-bacd-9ecabef47bbd\") "
Jul 23 16:21:51.566332 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:51.566311    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8107c72e-2c61-41f9-bacd-9ecabef47bbd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8107c72e-2c61-41f9-bacd-9ecabef47bbd" (UID: "8107c72e-2c61-41f9-bacd-9ecabef47bbd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:21:51.666891 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:51.666793    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8107c72e-2c61-41f9-bacd-9ecabef47bbd-maas-api-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:21:52.388848 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:52.388789    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg" event={"ID":"8107c72e-2c61-41f9-bacd-9ecabef47bbd","Type":"ContainerDied","Data":"eceea0bde5cb1185ccb3a721ed54cad069425a1035fb08d60a071b7a89fcc030"}
Jul 23 16:21:52.389083 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:52.388865    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg"
Jul 23 16:21:52.389083 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:52.388872    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eceea0bde5cb1185ccb3a721ed54cad069425a1035fb08d60a071b7a89fcc030"
Jul 23 16:21:58.927549 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:58.927511    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"]
Jul 23 16:21:58.928030 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:58.927770    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr" podUID="2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8" containerName="maas-api" containerID="cri-o://88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942" gracePeriod=30
Jul 23 16:21:58.969201 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:58.969157    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:21:59.196213 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.196185    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:59.222054 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.222002    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-maas-api-tls\") pod \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\" (UID: \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\") "
Jul 23 16:21:59.222249 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.222134    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqs2v\" (UniqueName: \"kubernetes.io/projected/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-kube-api-access-vqs2v\") pod \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\" (UID: \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\") "
Jul 23 16:21:59.222249 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.222174    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-openshift-service-ca\") pod \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\" (UID: \"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8\") "
Jul 23 16:21:59.222690 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.222661    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8" (UID: "2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:21:59.224151 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.224119    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8" (UID: "2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:21:59.224515 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.224495    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-kube-api-access-vqs2v" (OuterVolumeSpecName: "kube-api-access-vqs2v") pod "2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8" (UID: "2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8"). InnerVolumeSpecName "kube-api-access-vqs2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:21:59.322948 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.322902    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqs2v\" (UniqueName: \"kubernetes.io/projected/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-kube-api-access-vqs2v\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:21:59.322948 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.322939    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-openshift-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:21:59.322948 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.322953    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8-maas-api-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:21:59.435227 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.435126    2570 generic.go:356] "Generic (PLEG): container finished" podID="2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8" containerID="88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942" exitCode=0
Jul 23 16:21:59.435227 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.435177    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"
Jul 23 16:21:59.435227 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.435213    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr" event={"ID":"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8","Type":"ContainerDied","Data":"88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942"}
Jul 23 16:21:59.435497 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.435270    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr" event={"ID":"2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8","Type":"ContainerDied","Data":"891bb09e17f47e7d2f3af65dec1b0a4a3b80bccefd07ab9e405ac105ce9f79ec"}
Jul 23 16:21:59.435497 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.435292    2570 scope.go:117] "RemoveContainer" containerID="88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942"
Jul 23 16:21:59.446052 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.446029    2570 scope.go:117] "RemoveContainer" containerID="88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942"
Jul 23 16:21:59.446409 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:21:59.446387    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942\": container with ID starting with 88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942 not found: ID does not exist" containerID="88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942"
Jul 23 16:21:59.446501 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.446419    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942"} err="failed to get container status \"88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942\": rpc error: code = NotFound desc = could not find container \"88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942\": container with ID starting with 88d7ea60ce8fed14dbea406a738f95beacb5914bc7059954f34775a739926942 not found: ID does not exist"
Jul 23 16:21:59.458660 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.458627    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"]
Jul 23 16:21:59.461311 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:21:59.461284    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-5bb1d507-7f5b986587-mr9lr"]
Jul 23 16:22:00.603778 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:00.603743    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8" path="/var/lib/kubelet/pods/2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8/volumes"
Jul 23 16:22:03.517614 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:03.517582    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:03.518759 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:03.518735    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg"]
Jul 23 16:22:03.521245 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:03.521224    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5bb1d507-mkmbg"]
Jul 23 16:22:03.695494 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:03.695449    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:03.940849 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:03.940745    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:04.448142 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:04.448099    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:04.543422 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:04.543382    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:04.603967 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:04.603934    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8107c72e-2c61-41f9-bacd-9ecabef47bbd" path="/var/lib/kubelet/pods/8107c72e-2c61-41f9-bacd-9ecabef47bbd/volumes"
Jul 23 16:22:04.643963 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:04.643929    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:06.143112 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:06.143068    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:11.919092 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:11.919053    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:11.973869 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:11.973832    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:12.072940 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:12.072899    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:12.172157 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:12.172058    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:12.267740 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:12.267706    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:12.659383 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:12.659352    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:22.291355 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:22.291319    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:38.690051 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:38.689996    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:44.870382 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:44.870319    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:44.979027 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:44.978982    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:22:45.076993 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:22:45.076952    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:01.053600 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:01.053560    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:02.674202 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:02.674158    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:07.261548 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:07.261444    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:07.461120 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:07.461084    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:07.553667 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:07.553561    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:18.036679 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:18.036632    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:18.935567 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:18.935509    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:25.017451 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:25.017412    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:25.142200 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:25.142161    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:25.267795 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:25.267702    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:25.404552 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:25.404514    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:26.163851 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:26.163812    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:26.266644 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:26.266600    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:26.371114 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:26.371079    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:33.194964 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:33.194921    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:40.098404 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:40.098360    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:41.422906 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:41.422872    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:46.718986 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:46.718948    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:46.784881 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:46.784842    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:46.951667 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:46.951629    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:47.274691 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:47.274653    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:47.578299 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:47.578214    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:50.260701 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.260658    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:50.345232 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.345199    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"]
Jul 23 16:23:50.345645 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.345632    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8107c72e-2c61-41f9-bacd-9ecabef47bbd" containerName="revoke-keys"
Jul 23 16:23:50.345695 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.345648    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8107c72e-2c61-41f9-bacd-9ecabef47bbd" containerName="revoke-keys"
Jul 23 16:23:50.345695 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.345668    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8" containerName="maas-api"
Jul 23 16:23:50.345695 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.345674    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8" containerName="maas-api"
Jul 23 16:23:50.345789 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.345761    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2af9c3a7-e626-4e1b-a15f-02e60d2ae2d8" containerName="maas-api"
Jul 23 16:23:50.345789 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.345772    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8107c72e-2c61-41f9-bacd-9ecabef47bbd" containerName="revoke-keys"
Jul 23 16:23:50.348554 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.348538    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:23:50.351181 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.351165    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-77a41a7f-serving-cert\""
Jul 23 16:23:50.354514 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.354483    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:50.360654 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.360630    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"]
Jul 23 16:23:50.438938 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.438904    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:50.458934 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.458903    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26af2ce3-e539-4f07-9597-3fe84f26ee6d-maas-api-tls\") pod \"maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g\" (UID: \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:23:50.459120 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.458959    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gdln\" (UniqueName: \"kubernetes.io/projected/26af2ce3-e539-4f07-9597-3fe84f26ee6d-kube-api-access-2gdln\") pod \"maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g\" (UID: \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:23:50.459120 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.459023    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26af2ce3-e539-4f07-9597-3fe84f26ee6d-openshift-service-ca\") pod \"maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g\" (UID: \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:23:50.533453 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.533356    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:50.559844 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.559807    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gdln\" (UniqueName: \"kubernetes.io/projected/26af2ce3-e539-4f07-9597-3fe84f26ee6d-kube-api-access-2gdln\") pod \"maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g\" (UID: \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:23:50.559844 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.559848    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26af2ce3-e539-4f07-9597-3fe84f26ee6d-openshift-service-ca\") pod \"maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g\" (UID: \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:23:50.560086 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.559969    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26af2ce3-e539-4f07-9597-3fe84f26ee6d-maas-api-tls\") pod \"maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g\" (UID: \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:23:50.560595 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.560572    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26af2ce3-e539-4f07-9597-3fe84f26ee6d-openshift-service-ca\") pod \"maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g\" (UID: \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:23:50.562563 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.562539    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26af2ce3-e539-4f07-9597-3fe84f26ee6d-maas-api-tls\") pod \"maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g\" (UID: \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:23:50.570947 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.570927    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gdln\" (UniqueName: \"kubernetes.io/projected/26af2ce3-e539-4f07-9597-3fe84f26ee6d-kube-api-access-2gdln\") pod \"maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g\" (UID: \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:23:50.661167 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.661133    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:23:50.813392 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.812503    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"]
Jul 23 16:23:50.816396 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:23:50.816364    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26af2ce3_e539_4f07_9597_3fe84f26ee6d.slice/crio-3ff75287ad44e116f1bda617343d0f18257cca5ec376451354620f8d3d0b2b1c WatchSource:0}: Error finding container 3ff75287ad44e116f1bda617343d0f18257cca5ec376451354620f8d3d0b2b1c: Status 404 returned error can't find the container with id 3ff75287ad44e116f1bda617343d0f18257cca5ec376451354620f8d3d0b2b1c
Jul 23 16:23:50.981744 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:50.981699    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:51.083866 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:51.083767    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:51.108000 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:51.107964    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g" event={"ID":"26af2ce3-e539-4f07-9597-3fe84f26ee6d","Type":"ContainerStarted","Data":"3ff75287ad44e116f1bda617343d0f18257cca5ec376451354620f8d3d0b2b1c"}
Jul 23 16:23:52.116524 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:52.116474    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g" event={"ID":"26af2ce3-e539-4f07-9597-3fe84f26ee6d","Type":"ContainerStarted","Data":"a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b"}
Jul 23 16:23:52.116926 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:52.116564    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:23:52.136201 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:52.136153    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g" podStartSLOduration=1.6990830940000001 podStartE2EDuration="2.136138124s" totalImagesPullingTime="437.05503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:23:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:23:52.134586138 +0000 UTC m=+2018.058440785" watchObservedRunningTime="2026-07-23 16:23:52.136138124 +0000 UTC m=+2018.059992758"
Jul 23 16:23:54.776529 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:54.776490    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:55.562845 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:55.562804    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:55.662233 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:55.662197    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:56.089390 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:56.089353    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:23:58.128005 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:23:58.127975    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:24:01.818919 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:01.818874    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:01.926625 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:01.926592    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:02.184036 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:02.183926    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg"]
Jul 23 16:24:02.187942 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:02.187920    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg"
Jul 23 16:24:02.190520 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:02.190498    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:24:02.194830 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:02.194802    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg"]
Jul 23 16:24:02.279766 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:02.279722    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/102d3680-1541-439b-9f2a-173f42160195-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg\" (UID: \"102d3680-1541-439b-9f2a-173f42160195\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg"
Jul 23 16:24:02.381385 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:02.381342    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/102d3680-1541-439b-9f2a-173f42160195-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg\" (UID: \"102d3680-1541-439b-9f2a-173f42160195\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg"
Jul 23 16:24:02.382025 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:02.381983    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/102d3680-1541-439b-9f2a-173f42160195-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg\" (UID: \"102d3680-1541-439b-9f2a-173f42160195\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg"
Jul 23 16:24:02.500684 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:02.500647    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg"
Jul 23 16:24:02.647417 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:02.647392    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg"]
Jul 23 16:24:02.649186 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:24:02.649147    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102d3680_1541_439b_9f2a_173f42160195.slice/crio-7e92a1b980eb85bd28cb05b378a1db7c23c1c40bfde141adfaecd43c24b9541a WatchSource:0}: Error finding container 7e92a1b980eb85bd28cb05b378a1db7c23c1c40bfde141adfaecd43c24b9541a: Status 404 returned error can't find the container with id 7e92a1b980eb85bd28cb05b378a1db7c23c1c40bfde141adfaecd43c24b9541a
Jul 23 16:24:03.183789 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:03.183695    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg" event={"ID":"102d3680-1541-439b-9f2a-173f42160195","Type":"ContainerStarted","Data":"dc4796185f52dba46f5c3562309254541cd8a1868b10175ac9860dbd4944dfda"}
Jul 23 16:24:03.183789 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:03.183747    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg" event={"ID":"102d3680-1541-439b-9f2a-173f42160195","Type":"ContainerStarted","Data":"7e92a1b980eb85bd28cb05b378a1db7c23c1c40bfde141adfaecd43c24b9541a"}
Jul 23 16:24:03.209051 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:03.208978    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg" podStartSLOduration=1.208962717 podStartE2EDuration="1.208962717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:24:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:03.206630621 +0000 UTC m=+2029.130485254" watchObservedRunningTime="2026-07-23 16:24:03.208962717 +0000 UTC m=+2029.132817351"
Jul 23 16:24:04.191419 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:04.191378    2570 generic.go:356] "Generic (PLEG): container finished" podID="102d3680-1541-439b-9f2a-173f42160195" containerID="dc4796185f52dba46f5c3562309254541cd8a1868b10175ac9860dbd4944dfda" exitCode=0
Jul 23 16:24:04.191813 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:04.191434    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg" event={"ID":"102d3680-1541-439b-9f2a-173f42160195","Type":"ContainerDied","Data":"dc4796185f52dba46f5c3562309254541cd8a1868b10175ac9860dbd4944dfda"}
Jul 23 16:24:05.338433 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:05.338409    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg"
Jul 23 16:24:05.414529 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:05.414495    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/102d3680-1541-439b-9f2a-173f42160195-maas-api-service-ca\") pod \"102d3680-1541-439b-9f2a-173f42160195\" (UID: \"102d3680-1541-439b-9f2a-173f42160195\") "
Jul 23 16:24:05.414852 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:05.414823    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/102d3680-1541-439b-9f2a-173f42160195-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "102d3680-1541-439b-9f2a-173f42160195" (UID: "102d3680-1541-439b-9f2a-173f42160195"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:24:05.515645 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:05.515612    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/102d3680-1541-439b-9f2a-173f42160195-maas-api-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:24:06.204155 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:06.204120    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg" event={"ID":"102d3680-1541-439b-9f2a-173f42160195","Type":"ContainerDied","Data":"7e92a1b980eb85bd28cb05b378a1db7c23c1c40bfde141adfaecd43c24b9541a"}
Jul 23 16:24:06.204155 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:06.204155    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg"
Jul 23 16:24:06.204383 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:06.204170    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e92a1b980eb85bd28cb05b378a1db7c23c1c40bfde141adfaecd43c24b9541a"
Jul 23 16:24:07.977862 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:07.977817    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:12.617360 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:12.617324    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"]
Jul 23 16:24:12.617797 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:12.617512    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g" podUID="26af2ce3-e539-4f07-9597-3fe84f26ee6d" containerName="maas-api" containerID="cri-o://a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b" gracePeriod=30
Jul 23 16:24:12.622388 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:12.622358    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:12.872563 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:12.872499    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:24:12.987475 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:12.987445    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gdln\" (UniqueName: \"kubernetes.io/projected/26af2ce3-e539-4f07-9597-3fe84f26ee6d-kube-api-access-2gdln\") pod \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\" (UID: \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\") "
Jul 23 16:24:12.987642 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:12.987555    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26af2ce3-e539-4f07-9597-3fe84f26ee6d-maas-api-tls\") pod \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\" (UID: \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\") "
Jul 23 16:24:12.987642 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:12.987601    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26af2ce3-e539-4f07-9597-3fe84f26ee6d-openshift-service-ca\") pod \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\" (UID: \"26af2ce3-e539-4f07-9597-3fe84f26ee6d\") "
Jul 23 16:24:12.987980 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:12.987948    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26af2ce3-e539-4f07-9597-3fe84f26ee6d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "26af2ce3-e539-4f07-9597-3fe84f26ee6d" (UID: "26af2ce3-e539-4f07-9597-3fe84f26ee6d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:24:12.989586 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:12.989561    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26af2ce3-e539-4f07-9597-3fe84f26ee6d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "26af2ce3-e539-4f07-9597-3fe84f26ee6d" (UID: "26af2ce3-e539-4f07-9597-3fe84f26ee6d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:24:12.989665 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:12.989618    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26af2ce3-e539-4f07-9597-3fe84f26ee6d-kube-api-access-2gdln" (OuterVolumeSpecName: "kube-api-access-2gdln") pod "26af2ce3-e539-4f07-9597-3fe84f26ee6d" (UID: "26af2ce3-e539-4f07-9597-3fe84f26ee6d"). InnerVolumeSpecName "kube-api-access-2gdln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:24:13.088249 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:13.088212    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26af2ce3-e539-4f07-9597-3fe84f26ee6d-maas-api-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:24:13.088249 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:13.088245    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26af2ce3-e539-4f07-9597-3fe84f26ee6d-openshift-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:24:13.088249 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:13.088255    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gdln\" (UniqueName: \"kubernetes.io/projected/26af2ce3-e539-4f07-9597-3fe84f26ee6d-kube-api-access-2gdln\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:24:13.247448 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:13.247411    2570 generic.go:356] "Generic (PLEG): container finished" podID="26af2ce3-e539-4f07-9597-3fe84f26ee6d" containerID="a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b" exitCode=0
Jul 23 16:24:13.247598 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:13.247456    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g" event={"ID":"26af2ce3-e539-4f07-9597-3fe84f26ee6d","Type":"ContainerDied","Data":"a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b"}
Jul 23 16:24:13.247598 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:13.247497    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g" event={"ID":"26af2ce3-e539-4f07-9597-3fe84f26ee6d","Type":"ContainerDied","Data":"3ff75287ad44e116f1bda617343d0f18257cca5ec376451354620f8d3d0b2b1c"}
Jul 23 16:24:13.247598 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:13.247519    2570 scope.go:117] "RemoveContainer" containerID="a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b"
Jul 23 16:24:13.247598 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:13.247458    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"
Jul 23 16:24:13.257080 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:13.257059    2570 scope.go:117] "RemoveContainer" containerID="a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b"
Jul 23 16:24:13.257352 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:24:13.257332    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b\": container with ID starting with a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b not found: ID does not exist" containerID="a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b"
Jul 23 16:24:13.257402 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:13.257359    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b"} err="failed to get container status \"a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b\": rpc error: code = NotFound desc = could not find container \"a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b\": container with ID starting with a64f4d12bbe0b961f0be49516ac9257ee46c5ffa842a1edba9a084280d0cc21b not found: ID does not exist"
Jul 23 16:24:13.276162 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:13.276130    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"]
Jul 23 16:24:13.280231 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:13.280209    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-77a41a7f-85b5f96b6f-rtt4g"]
Jul 23 16:24:14.604377 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:14.604337    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26af2ce3-e539-4f07-9597-3fe84f26ee6d" path="/var/lib/kubelet/pods/26af2ce3-e539-4f07-9597-3fe84f26ee6d/volumes"
Jul 23 16:24:17.261335 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:17.261292    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:17.261803 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:17.261536    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg"]
Jul 23 16:24:17.264058 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:17.264037    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-77a41a7f-4lpzg"]
Jul 23 16:24:17.654571 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:17.654483    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:18.604157 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:18.604125    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="102d3680-1541-439b-9f2a-173f42160195" path="/var/lib/kubelet/pods/102d3680-1541-439b-9f2a-173f42160195/volumes"
Jul 23 16:24:23.478795 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:23.478762    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:23.579715 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:23.579683    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:23.824176 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:23.824062    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:24.010803 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:24.010771    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:24.182073 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:24.181962    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:24.281497 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:24.281466    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:24.387185 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:24.387152    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:30.356021 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:30.355986    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:30.433748 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:30.433712    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:30.563603 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:30.563569    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:30.741315 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:30.741286    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:36.398399 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:36.398313    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:36.477312 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:36.477281    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:43.372847 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:43.372812    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:43.696659 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:43.696559    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:43.879300 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:43.879269    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:47.148653 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.148607    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:47.248833 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.248796    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:47.422567 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.422474    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"]
Jul 23 16:24:47.423131 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.423104    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26af2ce3-e539-4f07-9597-3fe84f26ee6d" containerName="maas-api"
Jul 23 16:24:47.423131 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.423131    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="26af2ce3-e539-4f07-9597-3fe84f26ee6d" containerName="maas-api"
Jul 23 16:24:47.423310 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.423181    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="102d3680-1541-439b-9f2a-173f42160195" containerName="revoke-keys"
Jul 23 16:24:47.423310 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.423190    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="102d3680-1541-439b-9f2a-173f42160195" containerName="revoke-keys"
Jul 23 16:24:47.423310 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.423298    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="26af2ce3-e539-4f07-9597-3fe84f26ee6d" containerName="maas-api"
Jul 23 16:24:47.423415 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.423311    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="102d3680-1541-439b-9f2a-173f42160195" containerName="revoke-keys"
Jul 23 16:24:47.426815 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.426797    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:47.429709 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.429690    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5000bdcd-serving-cert\""
Jul 23 16:24:47.445663 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.445634    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"]
Jul 23 16:24:47.501499 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.501466    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:47.524117 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.524080    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-maas-api-tls\") pod \"maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:47.524280 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.524200    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-openshift-service-ca\") pod \"maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:47.524329 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.524295    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swczm\" (UniqueName: \"kubernetes.io/projected/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-kube-api-access-swczm\") pod \"maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:47.625490 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.625455    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swczm\" (UniqueName: \"kubernetes.io/projected/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-kube-api-access-swczm\") pod \"maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:47.625490 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.625502    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-maas-api-tls\") pod \"maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:47.625726 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.625566    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-openshift-service-ca\") pod \"maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:47.625726 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:24:47.625684    2570 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-serving-cert: secret "maas-api-e2e-mt-5000bdcd-serving-cert" not found
Jul 23 16:24:47.625797 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:24:47.625753    2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-maas-api-tls podName:cc6179ee-5aa1-4e05-ad7e-c9be38ffa948 nodeName:}" failed. No retries permitted until 2026-07-23 16:24:48.125732795 +0000 UTC m=+2074.049587417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-maas-api-tls") pod "maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d" (UID: "cc6179ee-5aa1-4e05-ad7e-c9be38ffa948") : secret "maas-api-e2e-mt-5000bdcd-serving-cert" not found
Jul 23 16:24:47.626290 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.626267    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-openshift-service-ca\") pod \"maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:47.636580 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.636550    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swczm\" (UniqueName: \"kubernetes.io/projected/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-kube-api-access-swczm\") pod \"maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:47.784157 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:47.784123    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:48.131491 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:48.131389    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-maas-api-tls\") pod \"maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:48.134651 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:48.134617    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-maas-api-tls\") pod \"maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:48.191826 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:48.191786    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:48.292282 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:48.292248    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:48.339100 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:48.339066    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:48.485953 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:48.485925    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"]
Jul 23 16:24:48.488002 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:24:48.487971    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6179ee_5aa1_4e05_ad7e_c9be38ffa948.slice/crio-5eb41622ae74f6e367657be13d1bb54b09bd2a003045bbed4206a97d03bcf40d WatchSource:0}: Error finding container 5eb41622ae74f6e367657be13d1bb54b09bd2a003045bbed4206a97d03bcf40d: Status 404 returned error can't find the container with id 5eb41622ae74f6e367657be13d1bb54b09bd2a003045bbed4206a97d03bcf40d
Jul 23 16:24:49.470000 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:49.469963    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d" event={"ID":"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948","Type":"ContainerStarted","Data":"b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85"}
Jul 23 16:24:49.470446 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:49.470048    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d" event={"ID":"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948","Type":"ContainerStarted","Data":"5eb41622ae74f6e367657be13d1bb54b09bd2a003045bbed4206a97d03bcf40d"}
Jul 23 16:24:49.470446 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:49.470078    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:49.489328 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:49.489279    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d" podStartSLOduration=2.125108564 podStartE2EDuration="2.489263233s" totalImagesPullingTime="364.154669ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:24:49.487113491 +0000 UTC m=+2075.410968124" watchObservedRunningTime="2026-07-23 16:24:49.489263233 +0000 UTC m=+2075.413117866"
Jul 23 16:24:51.643193 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:51.643156    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:24:55.482710 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:55.482679    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:24:56.399371 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:24:56.399334    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:25.329327 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:25.329289    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz"]
Jul 23 16:25:25.333147 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:25.333121    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz"
Jul 23 16:25:25.336364 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:25.336335    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:25:25.340146 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:25.340122    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz"]
Jul 23 16:25:25.489716 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:25.489675    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b0cb69c-418a-4895-bcac-6c6b8f913e2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz\" (UID: \"8b0cb69c-418a-4895-bcac-6c6b8f913e2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz"
Jul 23 16:25:25.590609 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:25.590522    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b0cb69c-418a-4895-bcac-6c6b8f913e2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz\" (UID: \"8b0cb69c-418a-4895-bcac-6c6b8f913e2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz"
Jul 23 16:25:25.591184 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:25.591162    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b0cb69c-418a-4895-bcac-6c6b8f913e2d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz\" (UID: \"8b0cb69c-418a-4895-bcac-6c6b8f913e2d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz"
Jul 23 16:25:25.647517 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:25.647485    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz"
Jul 23 16:25:25.787877 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:25.787845    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz"]
Jul 23 16:25:25.788578 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:25:25.788542    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b0cb69c_418a_4895_bcac_6c6b8f913e2d.slice/crio-6f8f7bc9f1f49225820c858e74bf66a18e5025411dea341cbc451fec60f7391c WatchSource:0}: Error finding container 6f8f7bc9f1f49225820c858e74bf66a18e5025411dea341cbc451fec60f7391c: Status 404 returned error can't find the container with id 6f8f7bc9f1f49225820c858e74bf66a18e5025411dea341cbc451fec60f7391c
Jul 23 16:25:26.695159 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:26.695113    2570 generic.go:356] "Generic (PLEG): container finished" podID="8b0cb69c-418a-4895-bcac-6c6b8f913e2d" containerID="34a20c13da43b18ad7e140fb6381a30f96e282e46bf15dff314df1fb88ec3728" exitCode=0
Jul 23 16:25:26.695549 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:26.695178    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz" event={"ID":"8b0cb69c-418a-4895-bcac-6c6b8f913e2d","Type":"ContainerDied","Data":"34a20c13da43b18ad7e140fb6381a30f96e282e46bf15dff314df1fb88ec3728"}
Jul 23 16:25:26.695549 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:26.695222    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz" event={"ID":"8b0cb69c-418a-4895-bcac-6c6b8f913e2d","Type":"ContainerStarted","Data":"6f8f7bc9f1f49225820c858e74bf66a18e5025411dea341cbc451fec60f7391c"}
Jul 23 16:25:27.842944 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:27.842912    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz"
Jul 23 16:25:28.016203 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:28.016174    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b0cb69c-418a-4895-bcac-6c6b8f913e2d-maas-api-service-ca\") pod \"8b0cb69c-418a-4895-bcac-6c6b8f913e2d\" (UID: \"8b0cb69c-418a-4895-bcac-6c6b8f913e2d\") "
Jul 23 16:25:28.016513 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:28.016490    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b0cb69c-418a-4895-bcac-6c6b8f913e2d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8b0cb69c-418a-4895-bcac-6c6b8f913e2d" (UID: "8b0cb69c-418a-4895-bcac-6c6b8f913e2d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:25:28.117363 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:28.117327    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b0cb69c-418a-4895-bcac-6c6b8f913e2d-maas-api-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:25:28.710051 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:28.710022    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz"
Jul 23 16:25:28.710218 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:28.710050    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz" event={"ID":"8b0cb69c-418a-4895-bcac-6c6b8f913e2d","Type":"ContainerDied","Data":"6f8f7bc9f1f49225820c858e74bf66a18e5025411dea341cbc451fec60f7391c"}
Jul 23 16:25:28.710218 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:28.710097    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f8f7bc9f1f49225820c858e74bf66a18e5025411dea341cbc451fec60f7391c"
Jul 23 16:25:40.793970 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:40.793935    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"]
Jul 23 16:25:40.794395 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:40.794170    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d" podUID="cc6179ee-5aa1-4e05-ad7e-c9be38ffa948" containerName="maas-api" containerID="cri-o://b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85" gracePeriod=30
Jul 23 16:25:40.818812 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:40.818785    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:41.055749 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.055683    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:25:41.133974 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.133937    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-openshift-service-ca\") pod \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") "
Jul 23 16:25:41.134200 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.133988    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-maas-api-tls\") pod \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") "
Jul 23 16:25:41.134200 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.134069    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swczm\" (UniqueName: \"kubernetes.io/projected/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-kube-api-access-swczm\") pod \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\" (UID: \"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948\") "
Jul 23 16:25:41.134493 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.134463    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cc6179ee-5aa1-4e05-ad7e-c9be38ffa948" (UID: "cc6179ee-5aa1-4e05-ad7e-c9be38ffa948"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:25:41.136789 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.136762    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-kube-api-access-swczm" (OuterVolumeSpecName: "kube-api-access-swczm") pod "cc6179ee-5aa1-4e05-ad7e-c9be38ffa948" (UID: "cc6179ee-5aa1-4e05-ad7e-c9be38ffa948"). InnerVolumeSpecName "kube-api-access-swczm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:25:41.136876 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.136780    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cc6179ee-5aa1-4e05-ad7e-c9be38ffa948" (UID: "cc6179ee-5aa1-4e05-ad7e-c9be38ffa948"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:25:41.235520 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.235481    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swczm\" (UniqueName: \"kubernetes.io/projected/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-kube-api-access-swczm\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:25:41.235520 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.235512    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-openshift-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:25:41.235520 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.235524    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948-maas-api-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:25:41.788287 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.788251    2570 generic.go:356] "Generic (PLEG): container finished" podID="cc6179ee-5aa1-4e05-ad7e-c9be38ffa948" containerID="b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85" exitCode=0
Jul 23 16:25:41.788496 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.788300    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"
Jul 23 16:25:41.788496 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.788338    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d" event={"ID":"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948","Type":"ContainerDied","Data":"b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85"}
Jul 23 16:25:41.788496 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.788401    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d" event={"ID":"cc6179ee-5aa1-4e05-ad7e-c9be38ffa948","Type":"ContainerDied","Data":"5eb41622ae74f6e367657be13d1bb54b09bd2a003045bbed4206a97d03bcf40d"}
Jul 23 16:25:41.788496 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.788444    2570 scope.go:117] "RemoveContainer" containerID="b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85"
Jul 23 16:25:41.798200 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.798042    2570 scope.go:117] "RemoveContainer" containerID="b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85"
Jul 23 16:25:41.798412 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:25:41.798310    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85\": container with ID starting with b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85 not found: ID does not exist" containerID="b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85"
Jul 23 16:25:41.798412 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.798335    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85"} err="failed to get container status \"b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85\": rpc error: code = NotFound desc = could not find container \"b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85\": container with ID starting with b9d2f3fb54acd1ffadcb61d92f67e01122acf2385d49ddf31b005dbe948e2e85 not found: ID does not exist"
Jul 23 16:25:41.811059 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.811036    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"]
Jul 23 16:25:41.816702 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:41.816673    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5000bdcd-6994999c6f-fmz8d"]
Jul 23 16:25:42.609714 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:42.609683    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc6179ee-5aa1-4e05-ad7e-c9be38ffa948" path="/var/lib/kubelet/pods/cc6179ee-5aa1-4e05-ad7e-c9be38ffa948/volumes"
Jul 23 16:25:45.423686 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:45.423636    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz"]
Jul 23 16:25:45.425814 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:45.425789    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:45.426578 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:45.426559    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-5000bdcd-bp9pz"]
Jul 23 16:25:46.603699 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:46.603660    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b0cb69c-418a-4895-bcac-6c6b8f913e2d" path="/var/lib/kubelet/pods/8b0cb69c-418a-4895-bcac-6c6b8f913e2d/volumes"
Jul 23 16:25:47.871125 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:47.871083    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:25:52.899817 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:25:52.899777    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:08.753844 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:08.753741    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:08.854696 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:08.854652    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:14.906487 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:14.906454    2570 scope.go:117] "RemoveContainer" containerID="c95f5a05fde5231477c392694a1686661f90209c99012182858933f2603f4b98"
Jul 23 16:26:29.314177 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:29.314144    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:29.788637 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:29.788591    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:35.301250 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:35.301213    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:49.574025 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:49.573984    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:49.655058 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:49.654986    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:49.927835 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:49.927739    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:50.160658 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:50.160624    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:51.299491 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:51.299393    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:51.399433 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:51.399390    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:51.497582 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:51.497545    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:52.314341 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:52.314266    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:52.407204 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:52.407164    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:52.508688 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:52.508644    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:26:53.956323 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:26:53.956288    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:00.027254 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:00.027206    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:00.122940 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:00.122901    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:00.719378 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:00.719336    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:07.002676 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:07.002642    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:07.113332 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:07.113294    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:07.266613 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:07.266512    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:14.933987 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:14.933954    2570 scope.go:117] "RemoveContainer" containerID="17b9d922a541c14566dcc554fc1b3509ae89385340943d1ed33ec2ffd0fafea7"
Jul 23 16:27:14.943092 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:14.943072    2570 scope.go:117] "RemoveContainer" containerID="20fd69f32c283f8ff02730eaccfa06d938130be7d17b14feb5db4d09462fa9b9"
Jul 23 16:27:17.803525 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:17.803468    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:18.184487 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:18.184393    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:39.189253 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:39.189158    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:45.680168 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:45.680122    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:45.780290 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:45.780250    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:46.040406 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:46.040358    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:46.370779 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:46.370669    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:46.685261 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:46.685173    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:49.013973 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.013940    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:49.089560 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.089522    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"]
Jul 23 16:27:49.090205 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.090179    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6179ee-5aa1-4e05-ad7e-c9be38ffa948" containerName="maas-api"
Jul 23 16:27:49.090205 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.090205    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6179ee-5aa1-4e05-ad7e-c9be38ffa948" containerName="maas-api"
Jul 23 16:27:49.090410 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.090215    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b0cb69c-418a-4895-bcac-6c6b8f913e2d" containerName="revoke-keys"
Jul 23 16:27:49.090410 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.090225    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b0cb69c-418a-4895-bcac-6c6b8f913e2d" containerName="revoke-keys"
Jul 23 16:27:49.090410 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.090326    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc6179ee-5aa1-4e05-ad7e-c9be38ffa948" containerName="maas-api"
Jul 23 16:27:49.090410 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.090335    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b0cb69c-418a-4895-bcac-6c6b8f913e2d" containerName="revoke-keys"
Jul 23 16:27:49.091214 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.091182    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:49.093661 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.093645    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:49.096166 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.096146    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-652934-serving-cert\""
Jul 23 16:27:49.114399 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.114330    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"]
Jul 23 16:27:49.159986 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.159927    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:49.265555 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.265463    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:49.267625 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.267601    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80ee8ce-2a5f-45ab-8697-2901b9702893-openshift-service-ca\") pod \"maas-api-e2e-inf-a-652934-b4648df96-wdk72\" (UID: \"b80ee8ce-2a5f-45ab-8697-2901b9702893\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:49.267680 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.267634    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj4dm\" (UniqueName: \"kubernetes.io/projected/b80ee8ce-2a5f-45ab-8697-2901b9702893-kube-api-access-wj4dm\") pod \"maas-api-e2e-inf-a-652934-b4648df96-wdk72\" (UID: \"b80ee8ce-2a5f-45ab-8697-2901b9702893\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:49.267788 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.267767    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80ee8ce-2a5f-45ab-8697-2901b9702893-maas-api-tls\") pod \"maas-api-e2e-inf-a-652934-b4648df96-wdk72\" (UID: \"b80ee8ce-2a5f-45ab-8697-2901b9702893\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:49.368467 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.368423    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80ee8ce-2a5f-45ab-8697-2901b9702893-openshift-service-ca\") pod \"maas-api-e2e-inf-a-652934-b4648df96-wdk72\" (UID: \"b80ee8ce-2a5f-45ab-8697-2901b9702893\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:49.368467 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.368465    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj4dm\" (UniqueName: \"kubernetes.io/projected/b80ee8ce-2a5f-45ab-8697-2901b9702893-kube-api-access-wj4dm\") pod \"maas-api-e2e-inf-a-652934-b4648df96-wdk72\" (UID: \"b80ee8ce-2a5f-45ab-8697-2901b9702893\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:49.368725 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.368542    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80ee8ce-2a5f-45ab-8697-2901b9702893-maas-api-tls\") pod \"maas-api-e2e-inf-a-652934-b4648df96-wdk72\" (UID: \"b80ee8ce-2a5f-45ab-8697-2901b9702893\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:49.369153 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.369127    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80ee8ce-2a5f-45ab-8697-2901b9702893-openshift-service-ca\") pod \"maas-api-e2e-inf-a-652934-b4648df96-wdk72\" (UID: \"b80ee8ce-2a5f-45ab-8697-2901b9702893\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:49.370946 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.370924    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80ee8ce-2a5f-45ab-8697-2901b9702893-maas-api-tls\") pod \"maas-api-e2e-inf-a-652934-b4648df96-wdk72\" (UID: \"b80ee8ce-2a5f-45ab-8697-2901b9702893\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:49.378435 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.378408    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj4dm\" (UniqueName: \"kubernetes.io/projected/b80ee8ce-2a5f-45ab-8697-2901b9702893-kube-api-access-wj4dm\") pod \"maas-api-e2e-inf-a-652934-b4648df96-wdk72\" (UID: \"b80ee8ce-2a5f-45ab-8697-2901b9702893\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:49.410427 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.410385    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:49.586337 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.586304    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"]
Jul 23 16:27:49.587622 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:27:49.587593    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80ee8ce_2a5f_45ab_8697_2901b9702893.slice/crio-96070dc148721f8a08260fd142d07670d3a1360122acc9d7d3ccdd28b5abd4e9 WatchSource:0}: Error finding container 96070dc148721f8a08260fd142d07670d3a1360122acc9d7d3ccdd28b5abd4e9: Status 404 returned error can't find the container with id 96070dc148721f8a08260fd142d07670d3a1360122acc9d7d3ccdd28b5abd4e9
Jul 23 16:27:49.589045 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.589025    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:27:49.727922 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.727887    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:49.826592 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:49.826540    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:50.580232 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:50.580129    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72" event={"ID":"b80ee8ce-2a5f-45ab-8697-2901b9702893","Type":"ContainerStarted","Data":"c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab"}
Jul 23 16:27:50.580232 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:50.580193    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72" event={"ID":"b80ee8ce-2a5f-45ab-8697-2901b9702893","Type":"ContainerStarted","Data":"96070dc148721f8a08260fd142d07670d3a1360122acc9d7d3ccdd28b5abd4e9"}
Jul 23 16:27:50.580747 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:50.580334    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:50.603967 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:50.603916    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72" podStartSLOduration=0.958353488 podStartE2EDuration="1.603899186s" totalImagesPullingTime="645.545698ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:27:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:27:50.60166901 +0000 UTC m=+2256.525523646" watchObservedRunningTime="2026-07-23 16:27:50.603899186 +0000 UTC m=+2256.527753873"
Jul 23 16:27:53.514285 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:53.514212    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:53.874702 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:53.874592    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:54.202810 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:54.202715    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:54.559508 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:54.559473    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:56.591826 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:56.591792    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:27:57.025696 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.025636    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:57.125521 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.125477    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:57.205805 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.205771    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"]
Jul 23 16:27:57.209898 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.209872    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:27:57.212580 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.212552    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-d1deea-serving-cert\""
Jul 23 16:27:57.221528 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.221500    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"]
Jul 23 16:27:57.235777 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.235738    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f52637a3-f331-4276-bf6b-1ead20e7513b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg\" (UID: \"f52637a3-f331-4276-bf6b-1ead20e7513b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:27:57.235967 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.235799    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsn9f\" (UniqueName: \"kubernetes.io/projected/f52637a3-f331-4276-bf6b-1ead20e7513b-kube-api-access-hsn9f\") pod \"maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg\" (UID: \"f52637a3-f331-4276-bf6b-1ead20e7513b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:27:57.235967 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.235867    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f52637a3-f331-4276-bf6b-1ead20e7513b-maas-api-tls\") pod \"maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg\" (UID: \"f52637a3-f331-4276-bf6b-1ead20e7513b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:27:57.244870 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.244831    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:57.336944 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.336846    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f52637a3-f331-4276-bf6b-1ead20e7513b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg\" (UID: \"f52637a3-f331-4276-bf6b-1ead20e7513b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:27:57.336944 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.336891    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsn9f\" (UniqueName: \"kubernetes.io/projected/f52637a3-f331-4276-bf6b-1ead20e7513b-kube-api-access-hsn9f\") pod \"maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg\" (UID: \"f52637a3-f331-4276-bf6b-1ead20e7513b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:27:57.336944 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.336939    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f52637a3-f331-4276-bf6b-1ead20e7513b-maas-api-tls\") pod \"maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg\" (UID: \"f52637a3-f331-4276-bf6b-1ead20e7513b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:27:57.337604 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.337577    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f52637a3-f331-4276-bf6b-1ead20e7513b-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg\" (UID: \"f52637a3-f331-4276-bf6b-1ead20e7513b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:27:57.339569 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.339538    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f52637a3-f331-4276-bf6b-1ead20e7513b-maas-api-tls\") pod \"maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg\" (UID: \"f52637a3-f331-4276-bf6b-1ead20e7513b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:27:57.346733 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.346709    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsn9f\" (UniqueName: \"kubernetes.io/projected/f52637a3-f331-4276-bf6b-1ead20e7513b-kube-api-access-hsn9f\") pod \"maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg\" (UID: \"f52637a3-f331-4276-bf6b-1ead20e7513b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:27:57.356920 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.356886    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:57.524190 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.524157    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:27:57.683448 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.683417    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"]
Jul 23 16:27:57.684738 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:27:57.684704    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52637a3_f331_4276_bf6b_1ead20e7513b.slice/crio-e735233914fa0233056ef9b3c53b09ae67a6dc24b979acd5fdf41ad011eb26d2 WatchSource:0}: Error finding container e735233914fa0233056ef9b3c53b09ae67a6dc24b979acd5fdf41ad011eb26d2: Status 404 returned error can't find the container with id e735233914fa0233056ef9b3c53b09ae67a6dc24b979acd5fdf41ad011eb26d2
Jul 23 16:27:57.720636 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.720597    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:57.820727 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:57.820696    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:27:58.638817 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:58.638765    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg" event={"ID":"f52637a3-f331-4276-bf6b-1ead20e7513b","Type":"ContainerStarted","Data":"9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806"}
Jul 23 16:27:58.639072 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:58.638847    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg" event={"ID":"f52637a3-f331-4276-bf6b-1ead20e7513b","Type":"ContainerStarted","Data":"e735233914fa0233056ef9b3c53b09ae67a6dc24b979acd5fdf41ad011eb26d2"}
Jul 23 16:27:58.639072 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:58.638991    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:27:58.658030 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:27:58.657961    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg" podStartSLOduration=1.260511722 podStartE2EDuration="1.657944504s" totalImagesPullingTime="397.432782ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:27:58.655061104 +0000 UTC m=+2264.578915741" watchObservedRunningTime="2026-07-23 16:27:58.657944504 +0000 UTC m=+2264.581799158"
Jul 23 16:28:01.615374 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:28:01.615330    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:28:04.651209 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:28:04.651181    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:28:09.531233 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:28:09.531192    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:28:10.778191 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:28:10.778151    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:28:10.878057 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:28:10.877995    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:28:14.970803 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:28:14.970770    2570 scope.go:117] "RemoveContainer" containerID="5540efe91235a1ff20a906984de4983156ec2fc703422acb0fec8f1516f6e6cc"
Jul 23 16:28:15.979462 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:28:15.979418    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:28:18.656277 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:28:18.656239    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:28:18.757063 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:28:18.757021    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:28:50.214613 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:28:50.214566    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:17.239200 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:17.239096    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:31.735465 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:31.735427    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:32.712904 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:32.712862    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:32.812716 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:32.812673    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59"]
Jul 23 16:29:32.817178 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:32.817154    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59"
Jul 23 16:29:32.820254 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:32.819826    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:29:32.822433 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:32.822401    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59"]
Jul 23 16:29:32.853501 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:32.853464    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-652934-nfp59\" (UID: \"a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59"
Jul 23 16:29:32.954088 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:32.954049    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-652934-nfp59\" (UID: \"a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59"
Jul 23 16:29:32.954675 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:32.954654    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-652934-nfp59\" (UID: \"a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59"
Jul 23 16:29:33.132184 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:33.132140    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59"
Jul 23 16:29:33.281541 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:33.281510    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59"]
Jul 23 16:29:33.282801 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:29:33.282773    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda19a9dd6_6488_4ab4_ac1b_da0fc86d68a5.slice/crio-7b55002577edb136cab925d327d77a4556830bac45604e869fcd72f7b74167e5 WatchSource:0}: Error finding container 7b55002577edb136cab925d327d77a4556830bac45604e869fcd72f7b74167e5: Status 404 returned error can't find the container with id 7b55002577edb136cab925d327d77a4556830bac45604e869fcd72f7b74167e5
Jul 23 16:29:33.361335 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:33.361305    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:33.462213 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:33.462180    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:34.244522 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:34.244491    2570 generic.go:356] "Generic (PLEG): container finished" podID="a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5" containerID="fa3925a06e53b1badf5429c45857b82458c6f9ae4588f24114e8bb901c2fdd63" exitCode=0
Jul 23 16:29:34.244943 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:34.244583    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59" event={"ID":"a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5","Type":"ContainerDied","Data":"fa3925a06e53b1badf5429c45857b82458c6f9ae4588f24114e8bb901c2fdd63"}
Jul 23 16:29:34.244943 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:34.244641    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59" event={"ID":"a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5","Type":"ContainerStarted","Data":"7b55002577edb136cab925d327d77a4556830bac45604e869fcd72f7b74167e5"}
Jul 23 16:29:35.397167 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:35.397137    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59"
Jul 23 16:29:35.476649 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:35.476608    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5-maas-api-service-ca\") pod \"a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5\" (UID: \"a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5\") "
Jul 23 16:29:35.476996 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:35.476971    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5" (UID: "a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:29:35.578274 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:35.578179    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5-maas-api-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:29:36.258986 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:36.258952    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59"
Jul 23 16:29:36.259177 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:36.258984    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59" event={"ID":"a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5","Type":"ContainerDied","Data":"7b55002577edb136cab925d327d77a4556830bac45604e869fcd72f7b74167e5"}
Jul 23 16:29:36.259177 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:36.259055    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b55002577edb136cab925d327d77a4556830bac45604e869fcd72f7b74167e5"
Jul 23 16:29:43.237548 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.237494    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"]
Jul 23 16:29:43.238205 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.237769    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72" podUID="b80ee8ce-2a5f-45ab-8697-2901b9702893" containerName="maas-api" containerID="cri-o://c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab" gracePeriod=30
Jul 23 16:29:43.271464 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.271431    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:43.496941 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.496867    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:29:43.563204 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.563163    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80ee8ce-2a5f-45ab-8697-2901b9702893-openshift-service-ca\") pod \"b80ee8ce-2a5f-45ab-8697-2901b9702893\" (UID: \"b80ee8ce-2a5f-45ab-8697-2901b9702893\") "
Jul 23 16:29:43.563379 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.563218    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80ee8ce-2a5f-45ab-8697-2901b9702893-maas-api-tls\") pod \"b80ee8ce-2a5f-45ab-8697-2901b9702893\" (UID: \"b80ee8ce-2a5f-45ab-8697-2901b9702893\") "
Jul 23 16:29:43.563379 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.563262    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wj4dm\" (UniqueName: \"kubernetes.io/projected/b80ee8ce-2a5f-45ab-8697-2901b9702893-kube-api-access-wj4dm\") pod \"b80ee8ce-2a5f-45ab-8697-2901b9702893\" (UID: \"b80ee8ce-2a5f-45ab-8697-2901b9702893\") "
Jul 23 16:29:43.563625 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.563597    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b80ee8ce-2a5f-45ab-8697-2901b9702893-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b80ee8ce-2a5f-45ab-8697-2901b9702893" (UID: "b80ee8ce-2a5f-45ab-8697-2901b9702893"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:29:43.565342 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.565316    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b80ee8ce-2a5f-45ab-8697-2901b9702893-kube-api-access-wj4dm" (OuterVolumeSpecName: "kube-api-access-wj4dm") pod "b80ee8ce-2a5f-45ab-8697-2901b9702893" (UID: "b80ee8ce-2a5f-45ab-8697-2901b9702893"). InnerVolumeSpecName "kube-api-access-wj4dm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:29:43.565414 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.565348    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b80ee8ce-2a5f-45ab-8697-2901b9702893-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b80ee8ce-2a5f-45ab-8697-2901b9702893" (UID: "b80ee8ce-2a5f-45ab-8697-2901b9702893"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:29:43.664857 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.664813    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b80ee8ce-2a5f-45ab-8697-2901b9702893-openshift-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:29:43.664857 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.664851    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b80ee8ce-2a5f-45ab-8697-2901b9702893-maas-api-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:29:43.664857 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:43.664861    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wj4dm\" (UniqueName: \"kubernetes.io/projected/b80ee8ce-2a5f-45ab-8697-2901b9702893-kube-api-access-wj4dm\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:29:44.308738 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:44.308703    2570 generic.go:356] "Generic (PLEG): container finished" podID="b80ee8ce-2a5f-45ab-8697-2901b9702893" containerID="c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab" exitCode=0
Jul 23 16:29:44.309157 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:44.308742    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"
Jul 23 16:29:44.309157 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:44.308786    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72" event={"ID":"b80ee8ce-2a5f-45ab-8697-2901b9702893","Type":"ContainerDied","Data":"c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab"}
Jul 23 16:29:44.309157 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:44.308845    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72" event={"ID":"b80ee8ce-2a5f-45ab-8697-2901b9702893","Type":"ContainerDied","Data":"96070dc148721f8a08260fd142d07670d3a1360122acc9d7d3ccdd28b5abd4e9"}
Jul 23 16:29:44.309157 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:44.308870    2570 scope.go:117] "RemoveContainer" containerID="c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab"
Jul 23 16:29:44.318875 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:44.318855    2570 scope.go:117] "RemoveContainer" containerID="c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab"
Jul 23 16:29:44.319228 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:29:44.319206    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab\": container with ID starting with c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab not found: ID does not exist" containerID="c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab"
Jul 23 16:29:44.319309 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:44.319240    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab"} err="failed to get container status \"c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab\": rpc error: code = NotFound desc = could not find container \"c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab\": container with ID starting with c4cda28e4b4febd443a0760faea7b86d300175843ce8bfeeac6733d48fb0e6ab not found: ID does not exist"
Jul 23 16:29:44.333458 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:44.333414    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"]
Jul 23 16:29:44.336080 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:44.336052    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-652934-b4648df96-wdk72"]
Jul 23 16:29:44.605068 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:44.604962    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b80ee8ce-2a5f-45ab-8697-2901b9702893" path="/var/lib/kubelet/pods/b80ee8ce-2a5f-45ab-8697-2901b9702893/volumes"
Jul 23 16:29:47.887481 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:47.887442    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:47.896381 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:47.896343    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59"]
Jul 23 16:29:47.899872 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:47.899846    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-652934-nfp59"]
Jul 23 16:29:48.302463 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:48.302422    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:48.603975 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:48.603891    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5" path="/var/lib/kubelet/pods/a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5/volumes"
Jul 23 16:29:54.015951 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.015910    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:54.082929 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.082889    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:54.391629 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.391523    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:54.560635 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.560593    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:54.682436 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.682350    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p"]
Jul 23 16:29:54.682833 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.682804    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80ee8ce-2a5f-45ab-8697-2901b9702893" containerName="maas-api"
Jul 23 16:29:54.682833 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.682825    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80ee8ce-2a5f-45ab-8697-2901b9702893" containerName="maas-api"
Jul 23 16:29:54.682833 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.682839    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5" containerName="revoke-keys"
Jul 23 16:29:54.683102 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.682846    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5" containerName="revoke-keys"
Jul 23 16:29:54.683102 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.682930    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80ee8ce-2a5f-45ab-8697-2901b9702893" containerName="maas-api"
Jul 23 16:29:54.683102 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.682939    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a19a9dd6-6488-4ab4-ac1b-da0fc86d68a5" containerName="revoke-keys"
Jul 23 16:29:54.686113 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.686094    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p"
Jul 23 16:29:54.689418 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.689170    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:29:54.693412 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.693387    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p"]
Jul 23 16:29:54.775102 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.775064    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29605c87-0987-472d-ad17-de94f82e533c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p\" (UID: \"29605c87-0987-472d-ad17-de94f82e533c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p"
Jul 23 16:29:54.876597 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.876559    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29605c87-0987-472d-ad17-de94f82e533c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p\" (UID: \"29605c87-0987-472d-ad17-de94f82e533c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p"
Jul 23 16:29:54.877242 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.877223    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29605c87-0987-472d-ad17-de94f82e533c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p\" (UID: \"29605c87-0987-472d-ad17-de94f82e533c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p"
Jul 23 16:29:54.998918 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:54.998863    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p"
Jul 23 16:29:55.148524 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:55.148492    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p"]
Jul 23 16:29:55.151620 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:29:55.151593    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29605c87_0987_472d_ad17_de94f82e533c.slice/crio-77e4b65728c1a089cfe1384d9a9889c3a2df84dc916fa4d86c6d6d103ed18cb5 WatchSource:0}: Error finding container 77e4b65728c1a089cfe1384d9a9889c3a2df84dc916fa4d86c6d6d103ed18cb5: Status 404 returned error can't find the container with id 77e4b65728c1a089cfe1384d9a9889c3a2df84dc916fa4d86c6d6d103ed18cb5
Jul 23 16:29:55.387782 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:55.387740    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p" event={"ID":"29605c87-0987-472d-ad17-de94f82e533c","Type":"ContainerStarted","Data":"77e4b65728c1a089cfe1384d9a9889c3a2df84dc916fa4d86c6d6d103ed18cb5"}
Jul 23 16:29:55.465320 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:55.465288    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:55.564101 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:55.564063    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:29:56.395676 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:56.395631    2570 generic.go:356] "Generic (PLEG): container finished" podID="29605c87-0987-472d-ad17-de94f82e533c" containerID="69074f8d592976ddcd753edb3a1fb0991d5a0325acb5fc76dbacb27ad263435c" exitCode=0
Jul 23 16:29:56.395676 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:56.395679    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p" event={"ID":"29605c87-0987-472d-ad17-de94f82e533c","Type":"ContainerDied","Data":"69074f8d592976ddcd753edb3a1fb0991d5a0325acb5fc76dbacb27ad263435c"}
Jul 23 16:29:57.550362 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:57.550329    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p"
Jul 23 16:29:57.703216 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:57.703168    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29605c87-0987-472d-ad17-de94f82e533c-maas-api-service-ca\") pod \"29605c87-0987-472d-ad17-de94f82e533c\" (UID: \"29605c87-0987-472d-ad17-de94f82e533c\") "
Jul 23 16:29:57.703556 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:57.703530    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29605c87-0987-472d-ad17-de94f82e533c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "29605c87-0987-472d-ad17-de94f82e533c" (UID: "29605c87-0987-472d-ad17-de94f82e533c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:29:57.804863 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:57.804784    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29605c87-0987-472d-ad17-de94f82e533c-maas-api-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:29:58.408381 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:58.408340    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p" event={"ID":"29605c87-0987-472d-ad17-de94f82e533c","Type":"ContainerDied","Data":"77e4b65728c1a089cfe1384d9a9889c3a2df84dc916fa4d86c6d6d103ed18cb5"}
Jul 23 16:29:58.408563 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:58.408403    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="77e4b65728c1a089cfe1384d9a9889c3a2df84dc916fa4d86c6d6d103ed18cb5"
Jul 23 16:29:58.408563 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:29:58.408352    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p"
Jul 23 16:30:00.141231 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.141187    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d1deea-29747070-wf8cb"]
Jul 23 16:30:00.141852 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.141830    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29605c87-0987-472d-ad17-de94f82e533c" containerName="revoke-keys"
Jul 23 16:30:00.141940 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.141855    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="29605c87-0987-472d-ad17-de94f82e533c" containerName="revoke-keys"
Jul 23 16:30:00.141998 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.141968    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="29605c87-0987-472d-ad17-de94f82e533c" containerName="revoke-keys"
Jul 23 16:30:00.145357 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.145329    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d1deea-29747070-wf8cb"
Jul 23 16:30:00.147539 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.147515    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747070-qr6db"]
Jul 23 16:30:00.148449 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.148425    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:30:00.151298 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.151275    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-qr6db"
Jul 23 16:30:00.155676 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.155643    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d1deea-29747070-wf8cb"]
Jul 23 16:30:00.159643 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.159433    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d1deea-29747070-wf8cb"
Jul 23 16:30:00.160809 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.160783    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747070-qr6db"]
Jul 23 16:30:00.167933 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.167913    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-qr6db"
Jul 23 16:30:00.316699 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.316652    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d1deea-29747070-wf8cb"]
Jul 23 16:30:00.421078 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.420984    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d1deea-29747070-wf8cb" event={"ID":"6645acd1-b474-4d6c-8739-6be861118adc","Type":"ContainerStarted","Data":"737354232bd8d78fbafc9956c9aa47a3d49b0fe5530c770e1a9460c46de9443d"}
Jul 23 16:30:00.549860 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:00.549831    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29747070-qr6db"]
Jul 23 16:30:00.550836 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:30:00.550795    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e393eb_88c9_4cda_b9f5_fe646ba533b1.slice/crio-de6bc295ab4d610dd4ca0e721b00c9685a17d254145de2aa35cdec3f1023a98a WatchSource:0}: Error finding container de6bc295ab4d610dd4ca0e721b00c9685a17d254145de2aa35cdec3f1023a98a: Status 404 returned error can't find the container with id de6bc295ab4d610dd4ca0e721b00c9685a17d254145de2aa35cdec3f1023a98a
Jul 23 16:30:01.428955 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:01.428919    2570 generic.go:356] "Generic (PLEG): container finished" podID="6645acd1-b474-4d6c-8739-6be861118adc" containerID="f2828d10084a2f84630c5a8058f850a05e5ac97a3caf5119de95738e0a481e79" exitCode=0
Jul 23 16:30:01.429439 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:01.428995    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d1deea-29747070-wf8cb" event={"ID":"6645acd1-b474-4d6c-8739-6be861118adc","Type":"ContainerDied","Data":"f2828d10084a2f84630c5a8058f850a05e5ac97a3caf5119de95738e0a481e79"}
Jul 23 16:30:01.430744 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:01.430719    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-qr6db" event={"ID":"b8e393eb-88c9-4cda-b9f5-fe646ba533b1","Type":"ContainerStarted","Data":"328d988d456e4faf7d866dcdaa67e0c26990643b00c93c99b484de99f6537e00"}
Jul 23 16:30:01.430842 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:01.430769    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-qr6db" event={"ID":"b8e393eb-88c9-4cda-b9f5-fe646ba533b1","Type":"ContainerStarted","Data":"de6bc295ab4d610dd4ca0e721b00c9685a17d254145de2aa35cdec3f1023a98a"}
Jul 23 16:30:01.458506 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:01.458452    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-qr6db" podStartSLOduration=1.458434172 podStartE2EDuration="1.458434172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:30:01.456983042 +0000 UTC m=+2387.380837677" watchObservedRunningTime="2026-07-23 16:30:01.458434172 +0000 UTC m=+2387.382288804"
Jul 23 16:30:02.440071 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:02.440029    2570 generic.go:356] "Generic (PLEG): container finished" podID="b8e393eb-88c9-4cda-b9f5-fe646ba533b1" containerID="328d988d456e4faf7d866dcdaa67e0c26990643b00c93c99b484de99f6537e00" exitCode=0
Jul 23 16:30:02.440071 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:02.440041    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-qr6db" event={"ID":"b8e393eb-88c9-4cda-b9f5-fe646ba533b1","Type":"ContainerDied","Data":"328d988d456e4faf7d866dcdaa67e0c26990643b00c93c99b484de99f6537e00"}
Jul 23 16:30:02.584843 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:02.584813    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d1deea-29747070-wf8cb"
Jul 23 16:30:03.448140 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:03.448109    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d1deea-29747070-wf8cb"
Jul 23 16:30:03.448660 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:03.448154    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d1deea-29747070-wf8cb" event={"ID":"6645acd1-b474-4d6c-8739-6be861118adc","Type":"ContainerDied","Data":"737354232bd8d78fbafc9956c9aa47a3d49b0fe5530c770e1a9460c46de9443d"}
Jul 23 16:30:03.448660 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:03.448216    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="737354232bd8d78fbafc9956c9aa47a3d49b0fe5530c770e1a9460c46de9443d"
Jul 23 16:30:03.593083 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:03.593057    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-qr6db"
Jul 23 16:30:04.456144 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:04.456110    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-qr6db"
Jul 23 16:30:04.456625 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:04.456150    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29747070-qr6db" event={"ID":"b8e393eb-88c9-4cda-b9f5-fe646ba533b1","Type":"ContainerDied","Data":"de6bc295ab4d610dd4ca0e721b00c9685a17d254145de2aa35cdec3f1023a98a"}
Jul 23 16:30:04.456625 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:04.456208    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="de6bc295ab4d610dd4ca0e721b00c9685a17d254145de2aa35cdec3f1023a98a"
Jul 23 16:30:05.118299 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.118265    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"]
Jul 23 16:30:05.118758 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.118728    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg" podUID="f52637a3-f331-4276-bf6b-1ead20e7513b" containerName="maas-api" containerID="cri-o://9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806" gracePeriod=30
Jul 23 16:30:05.146590 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.146553    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d1deea-29747070-wf8cb"]
Jul 23 16:30:05.146913 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.146884    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:05.149438 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.149409    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-d1deea-29747070-wf8cb"]
Jul 23 16:30:05.388220 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.388195    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:30:05.467982 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.464349    2570 generic.go:356] "Generic (PLEG): container finished" podID="f52637a3-f331-4276-bf6b-1ead20e7513b" containerID="9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806" exitCode=0
Jul 23 16:30:05.467982 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.464639    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg" event={"ID":"f52637a3-f331-4276-bf6b-1ead20e7513b","Type":"ContainerDied","Data":"9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806"}
Jul 23 16:30:05.467982 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.464734    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg" event={"ID":"f52637a3-f331-4276-bf6b-1ead20e7513b","Type":"ContainerDied","Data":"e735233914fa0233056ef9b3c53b09ae67a6dc24b979acd5fdf41ad011eb26d2"}
Jul 23 16:30:05.467982 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.464776    2570 scope.go:117] "RemoveContainer" containerID="9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806"
Jul 23 16:30:05.467982 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.464996    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"
Jul 23 16:30:05.480165 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.480137    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f52637a3-f331-4276-bf6b-1ead20e7513b-openshift-service-ca\") pod \"f52637a3-f331-4276-bf6b-1ead20e7513b\" (UID: \"f52637a3-f331-4276-bf6b-1ead20e7513b\") "
Jul 23 16:30:05.480325 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.480248    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f52637a3-f331-4276-bf6b-1ead20e7513b-maas-api-tls\") pod \"f52637a3-f331-4276-bf6b-1ead20e7513b\" (UID: \"f52637a3-f331-4276-bf6b-1ead20e7513b\") "
Jul 23 16:30:05.480325 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.480284    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsn9f\" (UniqueName: \"kubernetes.io/projected/f52637a3-f331-4276-bf6b-1ead20e7513b-kube-api-access-hsn9f\") pod \"f52637a3-f331-4276-bf6b-1ead20e7513b\" (UID: \"f52637a3-f331-4276-bf6b-1ead20e7513b\") "
Jul 23 16:30:05.480567 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.480536    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f52637a3-f331-4276-bf6b-1ead20e7513b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f52637a3-f331-4276-bf6b-1ead20e7513b" (UID: "f52637a3-f331-4276-bf6b-1ead20e7513b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:30:05.480766 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.480750    2570 scope.go:117] "RemoveContainer" containerID="9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806"
Jul 23 16:30:05.481086 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:30:05.481066    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806\": container with ID starting with 9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806 not found: ID does not exist" containerID="9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806"
Jul 23 16:30:05.481155 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.481095    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806"} err="failed to get container status \"9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806\": rpc error: code = NotFound desc = could not find container \"9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806\": container with ID starting with 9feb57b9b7861a7072db1178c45a91a7aede8c356353e706b78042a751aec806 not found: ID does not exist"
Jul 23 16:30:05.482453 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.482420    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f52637a3-f331-4276-bf6b-1ead20e7513b-kube-api-access-hsn9f" (OuterVolumeSpecName: "kube-api-access-hsn9f") pod "f52637a3-f331-4276-bf6b-1ead20e7513b" (UID: "f52637a3-f331-4276-bf6b-1ead20e7513b"). InnerVolumeSpecName "kube-api-access-hsn9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:30:05.482567 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.482455    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f52637a3-f331-4276-bf6b-1ead20e7513b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f52637a3-f331-4276-bf6b-1ead20e7513b" (UID: "f52637a3-f331-4276-bf6b-1ead20e7513b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:30:05.581383 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.581344    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f52637a3-f331-4276-bf6b-1ead20e7513b-maas-api-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:30:05.581383 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.581376    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsn9f\" (UniqueName: \"kubernetes.io/projected/f52637a3-f331-4276-bf6b-1ead20e7513b-kube-api-access-hsn9f\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:30:05.581383 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.581386    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f52637a3-f331-4276-bf6b-1ead20e7513b-openshift-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:30:05.787768 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.787731    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"]
Jul 23 16:30:05.790207 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:05.790185    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d1deea-5c68c8976b-mdcjg"]
Jul 23 16:30:06.603339 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:06.603305    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6645acd1-b474-4d6c-8739-6be861118adc" path="/var/lib/kubelet/pods/6645acd1-b474-4d6c-8739-6be861118adc/volumes"
Jul 23 16:30:06.603700 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:06.603669    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f52637a3-f331-4276-bf6b-1ead20e7513b" path="/var/lib/kubelet/pods/f52637a3-f331-4276-bf6b-1ead20e7513b/volumes"
Jul 23 16:30:09.762838 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:09.762803    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p"]
Jul 23 16:30:09.765816 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:09.765775    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:09.766637 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:09.766618    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-d1deea-sf68p"]
Jul 23 16:30:10.217231 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:10.217196    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:10.603682 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:10.603601    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29605c87-0987-472d-ad17-de94f82e533c" path="/var/lib/kubelet/pods/29605c87-0987-472d-ad17-de94f82e533c/volumes"
Jul 23 16:30:15.002608 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:15.002571    2570 scope.go:117] "RemoveContainer" containerID="dc4796185f52dba46f5c3562309254541cd8a1868b10175ac9860dbd4944dfda"
Jul 23 16:30:15.957666 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:15.957608    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:16.024065 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:16.024034    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:16.282225 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:16.282193    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:16.509898 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:16.509865    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:16.878878 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:16.878846    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:17.231518 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:17.231482    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:17.331472 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:17.331431    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:19.858915 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:19.858864    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:19.955467 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:19.955435    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:20.124233 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.124141    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"]
Jul 23 16:30:20.124707 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.124687    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6645acd1-b474-4d6c-8739-6be861118adc" containerName="cleanup"
Jul 23 16:30:20.124812 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.124709    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6645acd1-b474-4d6c-8739-6be861118adc" containerName="cleanup"
Jul 23 16:30:20.124812 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.124728    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8e393eb-88c9-4cda-b9f5-fe646ba533b1" containerName="cleanup"
Jul 23 16:30:20.124812 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.124738    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8e393eb-88c9-4cda-b9f5-fe646ba533b1" containerName="cleanup"
Jul 23 16:30:20.124812 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.124760    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f52637a3-f331-4276-bf6b-1ead20e7513b" containerName="maas-api"
Jul 23 16:30:20.124812 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.124769    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f52637a3-f331-4276-bf6b-1ead20e7513b" containerName="maas-api"
Jul 23 16:30:20.125109 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.124910    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f52637a3-f331-4276-bf6b-1ead20e7513b" containerName="maas-api"
Jul 23 16:30:20.125109 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.124926    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6645acd1-b474-4d6c-8739-6be861118adc" containerName="cleanup"
Jul 23 16:30:20.125109 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.124939    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8e393eb-88c9-4cda-b9f5-fe646ba533b1" containerName="cleanup"
Jul 23 16:30:20.128467 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.128444    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:20.131333 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.131310    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-dbc842-serving-cert\""
Jul 23 16:30:20.140727 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.140701    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"]
Jul 23 16:30:20.166847 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.166807    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:20.215870 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.215827    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7a5dde6-f4a5-4a68-a17c-fed398487c43-maas-api-tls\") pod \"maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc\" (UID: \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:20.216096 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.215891    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7a5dde6-f4a5-4a68-a17c-fed398487c43-openshift-service-ca\") pod \"maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc\" (UID: \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:20.216096 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.215976    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6bsm\" (UniqueName: \"kubernetes.io/projected/d7a5dde6-f4a5-4a68-a17c-fed398487c43-kube-api-access-t6bsm\") pod \"maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc\" (UID: \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:20.294927 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.294884    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:20.317448 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.317419    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6bsm\" (UniqueName: \"kubernetes.io/projected/d7a5dde6-f4a5-4a68-a17c-fed398487c43-kube-api-access-t6bsm\") pod \"maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc\" (UID: \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:20.317619 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.317485    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7a5dde6-f4a5-4a68-a17c-fed398487c43-maas-api-tls\") pod \"maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc\" (UID: \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:20.317619 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.317526    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7a5dde6-f4a5-4a68-a17c-fed398487c43-openshift-service-ca\") pod \"maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc\" (UID: \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:20.318135 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.318117    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7a5dde6-f4a5-4a68-a17c-fed398487c43-openshift-service-ca\") pod \"maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc\" (UID: \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:20.319959 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.319941    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7a5dde6-f4a5-4a68-a17c-fed398487c43-maas-api-tls\") pod \"maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc\" (UID: \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:20.325993 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.325967    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6bsm\" (UniqueName: \"kubernetes.io/projected/d7a5dde6-f4a5-4a68-a17c-fed398487c43-kube-api-access-t6bsm\") pod \"maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc\" (UID: \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:20.440684 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.440579    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:20.604641 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:30:20.604589    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7a5dde6_f4a5_4a68_a17c_fed398487c43.slice/crio-08a99ceeb2f3583cf23697d3ba7946acb22bbe1af0eaa049ed8aa819979b0f85 WatchSource:0}: Error finding container 08a99ceeb2f3583cf23697d3ba7946acb22bbe1af0eaa049ed8aa819979b0f85: Status 404 returned error can't find the container with id 08a99ceeb2f3583cf23697d3ba7946acb22bbe1af0eaa049ed8aa819979b0f85
Jul 23 16:30:20.619184 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.619153    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"]
Jul 23 16:30:20.637942 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.637908    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:20.738335 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:20.738298    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:21.568643 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:21.568604    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc" event={"ID":"d7a5dde6-f4a5-4a68-a17c-fed398487c43","Type":"ContainerStarted","Data":"08a99ceeb2f3583cf23697d3ba7946acb22bbe1af0eaa049ed8aa819979b0f85"}
Jul 23 16:30:22.582636 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:22.582596    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc" event={"ID":"d7a5dde6-f4a5-4a68-a17c-fed398487c43","Type":"ContainerStarted","Data":"c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c"}
Jul 23 16:30:22.583053 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:22.582701    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:24.304869 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:24.304831    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:24.833115 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:24.833075    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:25.153051 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:25.152922    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:25.542860 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:25.542820    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:27.789696 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:27.789620    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:27.889464 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:27.889429    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:28.009235 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.009176    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc" podStartSLOduration=6.902160684 podStartE2EDuration="8.009156625s" totalImagesPullingTime="1.106995941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:30:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:30:22.599199616 +0000 UTC m=+2408.523054249" watchObservedRunningTime="2026-07-23 16:30:28.009156625 +0000 UTC m=+2413.933011265"
Jul 23 16:30:28.009528 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.009510    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"]
Jul 23 16:30:28.013537 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.013510    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:28.016037 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.016001    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-6fc9aa-serving-cert\""
Jul 23 16:30:28.025361 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.025332    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"]
Jul 23 16:30:28.035279 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.035235    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:28.094532 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.094447    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfhxk\" (UniqueName: \"kubernetes.io/projected/9a59df3a-4508-4f47-9b4f-e583023bfe26-kube-api-access-wfhxk\") pod \"maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5\" (UID: \"9a59df3a-4508-4f47-9b4f-e583023bfe26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:28.094532 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.094490    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a59df3a-4508-4f47-9b4f-e583023bfe26-openshift-service-ca\") pod \"maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5\" (UID: \"9a59df3a-4508-4f47-9b4f-e583023bfe26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:28.094717 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.094604    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a59df3a-4508-4f47-9b4f-e583023bfe26-maas-api-tls\") pod \"maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5\" (UID: \"9a59df3a-4508-4f47-9b4f-e583023bfe26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:28.195827 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.195785    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a59df3a-4508-4f47-9b4f-e583023bfe26-maas-api-tls\") pod \"maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5\" (UID: \"9a59df3a-4508-4f47-9b4f-e583023bfe26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:28.196051 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.195884    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfhxk\" (UniqueName: \"kubernetes.io/projected/9a59df3a-4508-4f47-9b4f-e583023bfe26-kube-api-access-wfhxk\") pod \"maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5\" (UID: \"9a59df3a-4508-4f47-9b4f-e583023bfe26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:28.196051 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.195920    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a59df3a-4508-4f47-9b4f-e583023bfe26-openshift-service-ca\") pod \"maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5\" (UID: \"9a59df3a-4508-4f47-9b4f-e583023bfe26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:28.196621 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.196594    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a59df3a-4508-4f47-9b4f-e583023bfe26-openshift-service-ca\") pod \"maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5\" (UID: \"9a59df3a-4508-4f47-9b4f-e583023bfe26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:28.198443 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.198421    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a59df3a-4508-4f47-9b4f-e583023bfe26-maas-api-tls\") pod \"maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5\" (UID: \"9a59df3a-4508-4f47-9b4f-e583023bfe26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:28.212747 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.212717    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfhxk\" (UniqueName: \"kubernetes.io/projected/9a59df3a-4508-4f47-9b4f-e583023bfe26-kube-api-access-wfhxk\") pod \"maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5\" (UID: \"9a59df3a-4508-4f47-9b4f-e583023bfe26\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:28.252688 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.252657    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:28.326595 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.326564    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:28.475530 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.475500    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"]
Jul 23 16:30:28.476254 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:30:28.476229    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a59df3a_4508_4f47_9b4f_e583023bfe26.slice/crio-8e9d2b436b49fd54f4ce6770fcedfedfd388a3cd36a6f16dc0f50c3e94e1e45a WatchSource:0}: Error finding container 8e9d2b436b49fd54f4ce6770fcedfedfd388a3cd36a6f16dc0f50c3e94e1e45a: Status 404 returned error can't find the container with id 8e9d2b436b49fd54f4ce6770fcedfedfd388a3cd36a6f16dc0f50c3e94e1e45a
Jul 23 16:30:28.573536 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.573495    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:28.594464 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.594442    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:28.620121 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.620092    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5" event={"ID":"9a59df3a-4508-4f47-9b4f-e583023bfe26","Type":"ContainerStarted","Data":"8e9d2b436b49fd54f4ce6770fcedfedfd388a3cd36a6f16dc0f50c3e94e1e45a"}
Jul 23 16:30:28.674125 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:28.673994    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:29.627330 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:29.627296    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5" event={"ID":"9a59df3a-4508-4f47-9b4f-e583023bfe26","Type":"ContainerStarted","Data":"e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a"}
Jul 23 16:30:29.627735 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:29.627375    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:29.647877 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:29.647820    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5" podStartSLOduration=2.313729564 podStartE2EDuration="2.647804994s" totalImagesPullingTime="334.07543ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:30:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:30:29.6461693 +0000 UTC m=+2415.570023935" watchObservedRunningTime="2026-07-23 16:30:29.647804994 +0000 UTC m=+2415.571659627"
Jul 23 16:30:32.309038 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:32.308974    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:34.179442 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:34.179393    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:34.279758 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:34.279723    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:35.639826 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:35.639796    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:30:40.561601 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:40.561562    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq"]
Jul 23 16:30:40.567389 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:40.567358    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq"
Jul 23 16:30:40.570358 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:40.570336    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:30:40.571515 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:40.571483    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq"]
Jul 23 16:30:40.714461 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:40.714426    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c79d77fe-adee-4807-9d91-1ad0caf97bb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq\" (UID: \"c79d77fe-adee-4807-9d91-1ad0caf97bb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq"
Jul 23 16:30:40.816078 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:40.815972    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c79d77fe-adee-4807-9d91-1ad0caf97bb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq\" (UID: \"c79d77fe-adee-4807-9d91-1ad0caf97bb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq"
Jul 23 16:30:40.816657 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:40.816635    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c79d77fe-adee-4807-9d91-1ad0caf97bb6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq\" (UID: \"c79d77fe-adee-4807-9d91-1ad0caf97bb6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq"
Jul 23 16:30:40.881982 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:40.881936    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq"
Jul 23 16:30:41.024625 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:41.024591    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq"]
Jul 23 16:30:41.025832 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:30:41.025806    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79d77fe_adee_4807_9d91_1ad0caf97bb6.slice/crio-db5944d052aa902bd6008cfec1686494c10e1e9c7dc260d63e495c8424a21f9d WatchSource:0}: Error finding container db5944d052aa902bd6008cfec1686494c10e1e9c7dc260d63e495c8424a21f9d: Status 404 returned error can't find the container with id db5944d052aa902bd6008cfec1686494c10e1e9c7dc260d63e495c8424a21f9d
Jul 23 16:30:41.236229 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:41.236190    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:41.411430 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:41.411398    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:41.702040 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:41.701918    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq" event={"ID":"c79d77fe-adee-4807-9d91-1ad0caf97bb6","Type":"ContainerStarted","Data":"04ae1abe45d12e78a124d645526fa8d65e75392a27e82231f00331d425bb035f"}
Jul 23 16:30:41.702040 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:41.701983    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq" event={"ID":"c79d77fe-adee-4807-9d91-1ad0caf97bb6","Type":"ContainerStarted","Data":"db5944d052aa902bd6008cfec1686494c10e1e9c7dc260d63e495c8424a21f9d"}
Jul 23 16:30:41.718660 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:41.718602    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq" podStartSLOduration=1.7185874349999999 podStartE2EDuration="1.718587435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:30:41.715352063 +0000 UTC m=+2427.639206695" watchObservedRunningTime="2026-07-23 16:30:41.718587435 +0000 UTC m=+2427.642442067"
Jul 23 16:30:42.709755 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:42.709719    2570 generic.go:356] "Generic (PLEG): container finished" podID="c79d77fe-adee-4807-9d91-1ad0caf97bb6" containerID="04ae1abe45d12e78a124d645526fa8d65e75392a27e82231f00331d425bb035f" exitCode=0
Jul 23 16:30:42.710205 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:42.709800    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq" event={"ID":"c79d77fe-adee-4807-9d91-1ad0caf97bb6","Type":"ContainerDied","Data":"04ae1abe45d12e78a124d645526fa8d65e75392a27e82231f00331d425bb035f"}
Jul 23 16:30:43.854942 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:43.854918    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq"
Jul 23 16:30:43.949283 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:43.949247    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c79d77fe-adee-4807-9d91-1ad0caf97bb6-maas-api-service-ca\") pod \"c79d77fe-adee-4807-9d91-1ad0caf97bb6\" (UID: \"c79d77fe-adee-4807-9d91-1ad0caf97bb6\") "
Jul 23 16:30:43.949671 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:43.949644    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c79d77fe-adee-4807-9d91-1ad0caf97bb6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c79d77fe-adee-4807-9d91-1ad0caf97bb6" (UID: "c79d77fe-adee-4807-9d91-1ad0caf97bb6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:30:44.050983 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:44.050890    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c79d77fe-adee-4807-9d91-1ad0caf97bb6-maas-api-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:30:44.724310 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:44.724279    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq"
Jul 23 16:30:44.724517 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:44.724316    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq" event={"ID":"c79d77fe-adee-4807-9d91-1ad0caf97bb6","Type":"ContainerDied","Data":"db5944d052aa902bd6008cfec1686494c10e1e9c7dc260d63e495c8424a21f9d"}
Jul 23 16:30:44.724517 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:44.724385    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db5944d052aa902bd6008cfec1686494c10e1e9c7dc260d63e495c8424a21f9d"
Jul 23 16:30:49.450274 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:49.450234    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:49.549587 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:49.549543    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:51.191975 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:51.191940    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:51.290748 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:51.290716    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:56.460149 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.460103    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"]
Jul 23 16:30:56.460675 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.460401    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc" podUID="d7a5dde6-f4a5-4a68-a17c-fed398487c43" containerName="maas-api" containerID="cri-o://c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c" gracePeriod=30
Jul 23 16:30:56.471896 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.471867    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:30:56.729069 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.729041    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:56.772736 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.772696    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7a5dde6-f4a5-4a68-a17c-fed398487c43-maas-api-tls\") pod \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\" (UID: \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\") "
Jul 23 16:30:56.772736 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.772744    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7a5dde6-f4a5-4a68-a17c-fed398487c43-openshift-service-ca\") pod \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\" (UID: \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\") "
Jul 23 16:30:56.772994 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.772794    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6bsm\" (UniqueName: \"kubernetes.io/projected/d7a5dde6-f4a5-4a68-a17c-fed398487c43-kube-api-access-t6bsm\") pod \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\" (UID: \"d7a5dde6-f4a5-4a68-a17c-fed398487c43\") "
Jul 23 16:30:56.773199 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.773172    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7a5dde6-f4a5-4a68-a17c-fed398487c43-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d7a5dde6-f4a5-4a68-a17c-fed398487c43" (UID: "d7a5dde6-f4a5-4a68-a17c-fed398487c43"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:30:56.775032 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.774992    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7a5dde6-f4a5-4a68-a17c-fed398487c43-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d7a5dde6-f4a5-4a68-a17c-fed398487c43" (UID: "d7a5dde6-f4a5-4a68-a17c-fed398487c43"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:30:56.775152 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.775094    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7a5dde6-f4a5-4a68-a17c-fed398487c43-kube-api-access-t6bsm" (OuterVolumeSpecName: "kube-api-access-t6bsm") pod "d7a5dde6-f4a5-4a68-a17c-fed398487c43" (UID: "d7a5dde6-f4a5-4a68-a17c-fed398487c43"). InnerVolumeSpecName "kube-api-access-t6bsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:30:56.800920 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.800887    2570 generic.go:356] "Generic (PLEG): container finished" podID="d7a5dde6-f4a5-4a68-a17c-fed398487c43" containerID="c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c" exitCode=0
Jul 23 16:30:56.801114 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.800932    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"
Jul 23 16:30:56.801114 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.800966    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc" event={"ID":"d7a5dde6-f4a5-4a68-a17c-fed398487c43","Type":"ContainerDied","Data":"c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c"}
Jul 23 16:30:56.801114 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.801029    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc" event={"ID":"d7a5dde6-f4a5-4a68-a17c-fed398487c43","Type":"ContainerDied","Data":"08a99ceeb2f3583cf23697d3ba7946acb22bbe1af0eaa049ed8aa819979b0f85"}
Jul 23 16:30:56.801114 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.801053    2570 scope.go:117] "RemoveContainer" containerID="c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c"
Jul 23 16:30:56.811578 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.811557    2570 scope.go:117] "RemoveContainer" containerID="c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c"
Jul 23 16:30:56.811871 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:30:56.811852    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c\": container with ID starting with c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c not found: ID does not exist" containerID="c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c"
Jul 23 16:30:56.811939 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.811886    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c"} err="failed to get container status \"c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c\": rpc error: code = NotFound desc = could not find container \"c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c\": container with ID starting with c9a3c32cb9278388dabf8f21c2408e59a0111c536e9603e2d6e93d38ab89978c not found: ID does not exist"
Jul 23 16:30:56.823205 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.823178    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"]
Jul 23 16:30:56.826487 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.826459    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-dbc842-78d74b8c8f-t7stc"]
Jul 23 16:30:56.874089 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.874045    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d7a5dde6-f4a5-4a68-a17c-fed398487c43-openshift-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:30:56.874089 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.874085    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6bsm\" (UniqueName: \"kubernetes.io/projected/d7a5dde6-f4a5-4a68-a17c-fed398487c43-kube-api-access-t6bsm\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:30:56.874089 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:56.874099    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d7a5dde6-f4a5-4a68-a17c-fed398487c43-maas-api-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:30:58.603698 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:30:58.603650    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7a5dde6-f4a5-4a68-a17c-fed398487c43" path="/var/lib/kubelet/pods/d7a5dde6-f4a5-4a68-a17c-fed398487c43/volumes"
Jul 23 16:31:00.640571 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:00.640539    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq"]
Jul 23 16:31:00.646810 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:00.646776    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-dbc842-dgpwq"]
Jul 23 16:31:00.647405 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:00.647384    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:01.047173 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:01.047134    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:02.603483 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:02.603446    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c79d77fe-adee-4807-9d91-1ad0caf97bb6" path="/var/lib/kubelet/pods/c79d77fe-adee-4807-9d91-1ad0caf97bb6/volumes"
Jul 23 16:31:06.913366 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:06.913322    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:07.015616 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.015583    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:07.568262 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.568224    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:07.576555 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.576512    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj"]
Jul 23 16:31:07.576962 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.576939    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7a5dde6-f4a5-4a68-a17c-fed398487c43" containerName="maas-api"
Jul 23 16:31:07.576962 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.576956    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7a5dde6-f4a5-4a68-a17c-fed398487c43" containerName="maas-api"
Jul 23 16:31:07.577162 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.576975    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c79d77fe-adee-4807-9d91-1ad0caf97bb6" containerName="revoke-keys"
Jul 23 16:31:07.577162 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.576982    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c79d77fe-adee-4807-9d91-1ad0caf97bb6" containerName="revoke-keys"
Jul 23 16:31:07.577162 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.577089    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7a5dde6-f4a5-4a68-a17c-fed398487c43" containerName="maas-api"
Jul 23 16:31:07.577162 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.577099    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c79d77fe-adee-4807-9d91-1ad0caf97bb6" containerName="revoke-keys"
Jul 23 16:31:07.582157 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.582134    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj"
Jul 23 16:31:07.585402 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.585377    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:31:07.589617 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.589586    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj"]
Jul 23 16:31:07.660165 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.660129    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:07.675447 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.675415    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc30f26-200a-47f5-989a-cb6c5ae70985-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj\" (UID: \"0bc30f26-200a-47f5-989a-cb6c5ae70985\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj"
Jul 23 16:31:07.775982 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.775941    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc30f26-200a-47f5-989a-cb6c5ae70985-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj\" (UID: \"0bc30f26-200a-47f5-989a-cb6c5ae70985\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj"
Jul 23 16:31:07.776652 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.776630    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc30f26-200a-47f5-989a-cb6c5ae70985-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj\" (UID: \"0bc30f26-200a-47f5-989a-cb6c5ae70985\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj"
Jul 23 16:31:07.894608 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:07.894519    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj"
Jul 23 16:31:08.048563 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:08.048536    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj"]
Jul 23 16:31:08.050109 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:31:08.050078    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bc30f26_200a_47f5_989a_cb6c5ae70985.slice/crio-c2bb72c4705d4314f22ab444c38321838dd00304b783296b467612b522ea6369 WatchSource:0}: Error finding container c2bb72c4705d4314f22ab444c38321838dd00304b783296b467612b522ea6369: Status 404 returned error can't find the container with id c2bb72c4705d4314f22ab444c38321838dd00304b783296b467612b522ea6369
Jul 23 16:31:08.289682 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:08.289646    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:08.388077 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:08.388042    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:08.876738 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:08.876707    2570 generic.go:356] "Generic (PLEG): container finished" podID="0bc30f26-200a-47f5-989a-cb6c5ae70985" containerID="b7b77173b1c17830100bb766ff284d1f551150039642776656dc34a241c029c9" exitCode=0
Jul 23 16:31:08.876922 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:08.876801    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj" event={"ID":"0bc30f26-200a-47f5-989a-cb6c5ae70985","Type":"ContainerDied","Data":"b7b77173b1c17830100bb766ff284d1f551150039642776656dc34a241c029c9"}
Jul 23 16:31:08.876922 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:08.876862    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj" event={"ID":"0bc30f26-200a-47f5-989a-cb6c5ae70985","Type":"ContainerStarted","Data":"c2bb72c4705d4314f22ab444c38321838dd00304b783296b467612b522ea6369"}
Jul 23 16:31:09.665929 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:09.665890    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:09.767622 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:09.767577    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:10.038434 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:10.038399    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj"
Jul 23 16:31:10.101485 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:10.101443    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc30f26-200a-47f5-989a-cb6c5ae70985-maas-api-service-ca\") pod \"0bc30f26-200a-47f5-989a-cb6c5ae70985\" (UID: \"0bc30f26-200a-47f5-989a-cb6c5ae70985\") "
Jul 23 16:31:10.101837 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:10.101814    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bc30f26-200a-47f5-989a-cb6c5ae70985-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0bc30f26-200a-47f5-989a-cb6c5ae70985" (UID: "0bc30f26-200a-47f5-989a-cb6c5ae70985"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:31:10.203311 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:10.203217    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bc30f26-200a-47f5-989a-cb6c5ae70985-maas-api-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:31:10.890475 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:10.890387    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj" event={"ID":"0bc30f26-200a-47f5-989a-cb6c5ae70985","Type":"ContainerDied","Data":"c2bb72c4705d4314f22ab444c38321838dd00304b783296b467612b522ea6369"}
Jul 23 16:31:10.890475 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:10.890412    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj"
Jul 23 16:31:10.890475 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:10.890465    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2bb72c4705d4314f22ab444c38321838dd00304b783296b467612b522ea6369"
Jul 23 16:31:18.121755 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:18.121721    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:18.229610 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:18.229571    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:23.363230 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.363165    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"]
Jul 23 16:31:23.363696 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.363440    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5" podUID="9a59df3a-4508-4f47-9b4f-e583023bfe26" containerName="maas-api" containerID="cri-o://e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a" gracePeriod=30
Jul 23 16:31:23.392693 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.392656    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:23.631982 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.631941    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:31:23.730156 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.730113    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a59df3a-4508-4f47-9b4f-e583023bfe26-openshift-service-ca\") pod \"9a59df3a-4508-4f47-9b4f-e583023bfe26\" (UID: \"9a59df3a-4508-4f47-9b4f-e583023bfe26\") "
Jul 23 16:31:23.730344 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.730177    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfhxk\" (UniqueName: \"kubernetes.io/projected/9a59df3a-4508-4f47-9b4f-e583023bfe26-kube-api-access-wfhxk\") pod \"9a59df3a-4508-4f47-9b4f-e583023bfe26\" (UID: \"9a59df3a-4508-4f47-9b4f-e583023bfe26\") "
Jul 23 16:31:23.730344 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.730339    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a59df3a-4508-4f47-9b4f-e583023bfe26-maas-api-tls\") pod \"9a59df3a-4508-4f47-9b4f-e583023bfe26\" (UID: \"9a59df3a-4508-4f47-9b4f-e583023bfe26\") "
Jul 23 16:31:23.730567 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.730542    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a59df3a-4508-4f47-9b4f-e583023bfe26-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9a59df3a-4508-4f47-9b4f-e583023bfe26" (UID: "9a59df3a-4508-4f47-9b4f-e583023bfe26"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:31:23.731146 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.731124    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a59df3a-4508-4f47-9b4f-e583023bfe26-openshift-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:31:23.732602 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.732571    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a59df3a-4508-4f47-9b4f-e583023bfe26-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9a59df3a-4508-4f47-9b4f-e583023bfe26" (UID: "9a59df3a-4508-4f47-9b4f-e583023bfe26"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:31:23.732866 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.732833    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a59df3a-4508-4f47-9b4f-e583023bfe26-kube-api-access-wfhxk" (OuterVolumeSpecName: "kube-api-access-wfhxk") pod "9a59df3a-4508-4f47-9b4f-e583023bfe26" (UID: "9a59df3a-4508-4f47-9b4f-e583023bfe26"). InnerVolumeSpecName "kube-api-access-wfhxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:31:23.832865 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.832819    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9a59df3a-4508-4f47-9b4f-e583023bfe26-maas-api-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:31:23.832865 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.832855    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfhxk\" (UniqueName: \"kubernetes.io/projected/9a59df3a-4508-4f47-9b4f-e583023bfe26-kube-api-access-wfhxk\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:31:23.966451 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.966415    2570 generic.go:356] "Generic (PLEG): container finished" podID="9a59df3a-4508-4f47-9b4f-e583023bfe26" containerID="e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a" exitCode=0
Jul 23 16:31:23.966624 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.966464    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"
Jul 23 16:31:23.966624 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.966513    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5" event={"ID":"9a59df3a-4508-4f47-9b4f-e583023bfe26","Type":"ContainerDied","Data":"e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a"}
Jul 23 16:31:23.966624 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.966574    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5" event={"ID":"9a59df3a-4508-4f47-9b4f-e583023bfe26","Type":"ContainerDied","Data":"8e9d2b436b49fd54f4ce6770fcedfedfd388a3cd36a6f16dc0f50c3e94e1e45a"}
Jul 23 16:31:23.966624 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.966597    2570 scope.go:117] "RemoveContainer" containerID="e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a"
Jul 23 16:31:23.976226 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.976206    2570 scope.go:117] "RemoveContainer" containerID="e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a"
Jul 23 16:31:23.976524 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:31:23.976499    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a\": container with ID starting with e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a not found: ID does not exist" containerID="e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a"
Jul 23 16:31:23.976635 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.976529    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a"} err="failed to get container status \"e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a\": rpc error: code = NotFound desc = could not find container \"e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a\": container with ID starting with e0af9edbe5ea62f9df8daea2534d70521bf2afd5c27caee654fb455e104e566a not found: ID does not exist"
Jul 23 16:31:23.988657 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.988629    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"]
Jul 23 16:31:23.992120 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:23.992096    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-6fc9aa-5b7956bdc9-gz4z5"]
Jul 23 16:31:24.604213 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:24.604179    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a59df3a-4508-4f47-9b4f-e583023bfe26" path="/var/lib/kubelet/pods/9a59df3a-4508-4f47-9b4f-e583023bfe26/volumes"
Jul 23 16:31:27.644523 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:27.644476    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:27.656366 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:27.656335    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj"]
Jul 23 16:31:27.659715 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:27.659688    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-6fc9aa-xpvwj"]
Jul 23 16:31:28.060019 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:28.059986    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:28.603850 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:28.603803    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bc30f26-200a-47f5-989a-cb6c5ae70985" path="/var/lib/kubelet/pods/0bc30f26-200a-47f5-989a-cb6c5ae70985/volumes"
Jul 23 16:31:33.820351 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:33.820312    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:33.922082 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:33.922040    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:34.111371 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:34.111287    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:34.356081 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:34.356038    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:34.708198 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:34.708158    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:35.022248 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:35.022208    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:35.252356 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:35.252316    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:38.286959 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.286919    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"]
Jul 23 16:31:38.287658 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.287628    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a59df3a-4508-4f47-9b4f-e583023bfe26" containerName="maas-api"
Jul 23 16:31:38.287658 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.287654    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a59df3a-4508-4f47-9b4f-e583023bfe26" containerName="maas-api"
Jul 23 16:31:38.287822 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.287682    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bc30f26-200a-47f5-989a-cb6c5ae70985" containerName="revoke-keys"
Jul 23 16:31:38.287822 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.287692    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bc30f26-200a-47f5-989a-cb6c5ae70985" containerName="revoke-keys"
Jul 23 16:31:38.287822 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.287791    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a59df3a-4508-4f47-9b4f-e583023bfe26" containerName="maas-api"
Jul 23 16:31:38.287822 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.287806    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bc30f26-200a-47f5-989a-cb6c5ae70985" containerName="revoke-keys"
Jul 23 16:31:38.292303 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.292282    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:38.294956 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.294939    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-9d26cd-serving-cert\""
Jul 23 16:31:38.300468 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.300027    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"]
Jul 23 16:31:38.316813 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.316780    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:38.371603 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.371562    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84928166-6220-4ade-90c3-abc19724c22d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck\" (UID: \"84928166-6220-4ade-90c3-abc19724c22d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:38.371603 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.371607    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84928166-6220-4ade-90c3-abc19724c22d-maas-api-tls\") pod \"maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck\" (UID: \"84928166-6220-4ade-90c3-abc19724c22d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:38.371823 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.371672    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs7wf\" (UniqueName: \"kubernetes.io/projected/84928166-6220-4ade-90c3-abc19724c22d-kube-api-access-zs7wf\") pod \"maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck\" (UID: \"84928166-6220-4ade-90c3-abc19724c22d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:38.417031 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.416979    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:38.472510 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.472470    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84928166-6220-4ade-90c3-abc19724c22d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck\" (UID: \"84928166-6220-4ade-90c3-abc19724c22d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:38.472510 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.472518    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84928166-6220-4ade-90c3-abc19724c22d-maas-api-tls\") pod \"maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck\" (UID: \"84928166-6220-4ade-90c3-abc19724c22d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:38.472787 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.472564    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs7wf\" (UniqueName: \"kubernetes.io/projected/84928166-6220-4ade-90c3-abc19724c22d-kube-api-access-zs7wf\") pod \"maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck\" (UID: \"84928166-6220-4ade-90c3-abc19724c22d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:38.473208 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.473186    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84928166-6220-4ade-90c3-abc19724c22d-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck\" (UID: \"84928166-6220-4ade-90c3-abc19724c22d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:38.475127 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.475105    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84928166-6220-4ade-90c3-abc19724c22d-maas-api-tls\") pod \"maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck\" (UID: \"84928166-6220-4ade-90c3-abc19724c22d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:38.483407 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.483385    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs7wf\" (UniqueName: \"kubernetes.io/projected/84928166-6220-4ade-90c3-abc19724c22d-kube-api-access-zs7wf\") pod \"maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck\" (UID: \"84928166-6220-4ade-90c3-abc19724c22d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:38.518505 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.518472    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:38.604262 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.604182    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:38.794207 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.794177    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"]
Jul 23 16:31:38.795655 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:31:38.795629    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84928166_6220_4ade_90c3_abc19724c22d.slice/crio-4ad7dfb8551eb67e6753496c2cfe87e4107aaffa38b3bf06c157d2596f2232c9 WatchSource:0}: Error finding container 4ad7dfb8551eb67e6753496c2cfe87e4107aaffa38b3bf06c157d2596f2232c9: Status 404 returned error can't find the container with id 4ad7dfb8551eb67e6753496c2cfe87e4107aaffa38b3bf06c157d2596f2232c9
Jul 23 16:31:38.869896 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.869793    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:38.971137 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:38.971103    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:39.062955 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:39.062912    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck" event={"ID":"84928166-6220-4ade-90c3-abc19724c22d","Type":"ContainerStarted","Data":"4ad7dfb8551eb67e6753496c2cfe87e4107aaffa38b3bf06c157d2596f2232c9"}
Jul 23 16:31:40.071046 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:40.070990    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck" event={"ID":"84928166-6220-4ade-90c3-abc19724c22d","Type":"ContainerStarted","Data":"8e794a63913ec988acd7fc7e2c58e261af96d69e484bf3a2048163812e432103"}
Jul 23 16:31:40.071442 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:40.071083    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:40.090813 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:40.090761    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck" podStartSLOduration=1.630684686 podStartE2EDuration="2.090745169s" totalImagesPullingTime="460.060483ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:31:40.089567934 +0000 UTC m=+2486.013422593" watchObservedRunningTime="2026-07-23 16:31:40.090745169 +0000 UTC m=+2486.014599802"
Jul 23 16:31:42.709251 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:42.709216    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:43.100122 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:43.100088    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:43.421568 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:43.421471    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:43.580251 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:43.580214    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:46.083160 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.083129    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:31:46.218430 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.218397    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:46.317676 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.317639    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:46.406355 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.406264    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"]
Jul 23 16:31:46.410312 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.410288    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:31:46.412973 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.412945    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-ebb72a-serving-cert\""
Jul 23 16:31:46.419080 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.419047    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"]
Jul 23 16:31:46.442134 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.442093    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:46.455931 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.455900    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts82l\" (UniqueName: \"kubernetes.io/projected/36683594-e009-4b9d-92d6-e20927cad4c7-kube-api-access-ts82l\") pod \"maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz\" (UID: \"36683594-e009-4b9d-92d6-e20927cad4c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:31:46.456144 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.456051    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36683594-e009-4b9d-92d6-e20927cad4c7-maas-api-tls\") pod \"maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz\" (UID: \"36683594-e009-4b9d-92d6-e20927cad4c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:31:46.456144 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.456097    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36683594-e009-4b9d-92d6-e20927cad4c7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz\" (UID: \"36683594-e009-4b9d-92d6-e20927cad4c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:31:46.556937 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.556889    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36683594-e009-4b9d-92d6-e20927cad4c7-maas-api-tls\") pod \"maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz\" (UID: \"36683594-e009-4b9d-92d6-e20927cad4c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:31:46.556937 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.556940    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36683594-e009-4b9d-92d6-e20927cad4c7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz\" (UID: \"36683594-e009-4b9d-92d6-e20927cad4c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:31:46.557214 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.556993    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts82l\" (UniqueName: \"kubernetes.io/projected/36683594-e009-4b9d-92d6-e20927cad4c7-kube-api-access-ts82l\") pod \"maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz\" (UID: \"36683594-e009-4b9d-92d6-e20927cad4c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:31:46.557616 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.557588    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36683594-e009-4b9d-92d6-e20927cad4c7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz\" (UID: \"36683594-e009-4b9d-92d6-e20927cad4c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:31:46.559462 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.559436    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36683594-e009-4b9d-92d6-e20927cad4c7-maas-api-tls\") pod \"maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz\" (UID: \"36683594-e009-4b9d-92d6-e20927cad4c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:31:46.567771 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.567718    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts82l\" (UniqueName: \"kubernetes.io/projected/36683594-e009-4b9d-92d6-e20927cad4c7-kube-api-access-ts82l\") pod \"maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz\" (UID: \"36683594-e009-4b9d-92d6-e20927cad4c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:31:46.568221 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.568177    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:46.724708 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.724679    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:31:46.876521 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:46.876478    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"]
Jul 23 16:31:46.877946 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:31:46.877921    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36683594_e009_4b9d_92d6_e20927cad4c7.slice/crio-16b64f82d43227e4db9b19dcde561e481a3d92fe453facc483985b6fc8745619 WatchSource:0}: Error finding container 16b64f82d43227e4db9b19dcde561e481a3d92fe453facc483985b6fc8745619: Status 404 returned error can't find the container with id 16b64f82d43227e4db9b19dcde561e481a3d92fe453facc483985b6fc8745619
Jul 23 16:31:47.025828 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:47.025727    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:47.113988 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:47.113952    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz" event={"ID":"36683594-e009-4b9d-92d6-e20927cad4c7","Type":"ContainerStarted","Data":"16b64f82d43227e4db9b19dcde561e481a3d92fe453facc483985b6fc8745619"}
Jul 23 16:31:47.128389 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:47.128345    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:48.122248 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:48.122207    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz" event={"ID":"36683594-e009-4b9d-92d6-e20927cad4c7","Type":"ContainerStarted","Data":"f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95"}
Jul 23 16:31:48.122619 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:48.122273    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:31:48.142752 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:48.142694    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz" podStartSLOduration=1.621077213 podStartE2EDuration="2.142677433s" totalImagesPullingTime="521.60022ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:31:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:31:48.140234319 +0000 UTC m=+2494.064088952" watchObservedRunningTime="2026-07-23 16:31:48.142677433 +0000 UTC m=+2494.066532067"
Jul 23 16:31:48.243809 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:48.243771    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:50.774719 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:50.774678    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:31:54.135129 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:31:54.135098    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:32:00.512713 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:32:00.512670    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:32:00.613311 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:32:00.613283    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:32:08.149547 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:32:08.149449    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:32:08.252005 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:32:08.251962    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:32:11.819185 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:32:11.819125    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:32:15.053559 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:32:15.053525    2570 scope.go:117] "RemoveContainer" containerID="34a20c13da43b18ad7e140fb6381a30f96e282e46bf15dff314df1fb88ec3728"
Jul 23 16:32:21.188278 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:32:21.188231    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:32:21.289191 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:32:21.289147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:32:33.256842 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:32:33.256804    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:33:15.640871 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:33:15.640835    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:33:15.701573 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:33:15.701534    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:34:44.753286 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:34:44.753241    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:34:48.555830 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:34:48.555794    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:34:48.624256 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:34:48.624226    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:34:57.524875 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:34:57.524840    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:35:16.641481 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:35:16.641380    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:35:59.127576 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:35:59.127531    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:36:00.098090 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:36:00.098057    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:36:09.425987 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:36:09.425949    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:36:10.514874 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:36:10.514845    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:36:10.615414 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:36:10.615370    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:36:15.110342 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:36:15.110309    2570 scope.go:117] "RemoveContainer" containerID="f2828d10084a2f84630c5a8058f850a05e5ac97a3caf5119de95738e0a481e79"
Jul 23 16:36:15.119441 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:36:15.119416    2570 scope.go:117] "RemoveContainer" containerID="69074f8d592976ddcd753edb3a1fb0991d5a0325acb5fc76dbacb27ad263435c"
Jul 23 16:36:15.128132 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:36:15.128108    2570 scope.go:117] "RemoveContainer" containerID="fa3925a06e53b1badf5429c45857b82458c6f9ae4588f24114e8bb901c2fdd63"
Jul 23 16:36:44.928319 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:36:44.928229    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:01.259192 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:01.259151    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:01.360117 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:01.360075    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:08.923800 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:08.923762    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:09.023563 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:09.023530    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:15.161304 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:15.161262    2570 scope.go:117] "RemoveContainer" containerID="04ae1abe45d12e78a124d645526fa8d65e75392a27e82231f00331d425bb035f"
Jul 23 16:37:15.170646 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:15.170624    2570 scope.go:117] "RemoveContainer" containerID="b7b77173b1c17830100bb766ff284d1f551150039642776656dc34a241c029c9"
Jul 23 16:37:27.295611 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:27.295577    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:28.207352 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:28.207308    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:29.201125 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:29.201091    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7433-139871946296112"]
Jul 23 16:37:29.204742 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:29.204715    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946296112"
Jul 23 16:37:29.208122 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:29.208093    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-h4dkf\""
Jul 23 16:37:29.211508 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:29.211480    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7433-139871946296112"]
Jul 23 16:37:29.250971 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:29.250931    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8l8n\" (UniqueName: \"kubernetes.io/projected/936926dd-c781-4857-934e-faf6f63922c3-kube-api-access-f8l8n\") pod \"test-curl-7433-139871946296112\" (UID: \"936926dd-c781-4857-934e-faf6f63922c3\") " pod="opendatahub/test-curl-7433-139871946296112"
Jul 23 16:37:29.352254 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:29.352209    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8l8n\" (UniqueName: \"kubernetes.io/projected/936926dd-c781-4857-934e-faf6f63922c3-kube-api-access-f8l8n\") pod \"test-curl-7433-139871946296112\" (UID: \"936926dd-c781-4857-934e-faf6f63922c3\") " pod="opendatahub/test-curl-7433-139871946296112"
Jul 23 16:37:29.361498 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:29.361469    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8l8n\" (UniqueName: \"kubernetes.io/projected/936926dd-c781-4857-934e-faf6f63922c3-kube-api-access-f8l8n\") pod \"test-curl-7433-139871946296112\" (UID: \"936926dd-c781-4857-934e-faf6f63922c3\") " pod="opendatahub/test-curl-7433-139871946296112"
Jul 23 16:37:29.516086 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:29.516053    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946296112"
Jul 23 16:37:29.659940 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:29.659912    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7433-139871946296112"]
Jul 23 16:37:29.661551 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:37:29.661522    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod936926dd_c781_4857_934e_faf6f63922c3.slice/crio-7fbe3fa7ee64c884f2cc342c1a011d92aed9e617ed7223a50a664275cd87e371 WatchSource:0}: Error finding container 7fbe3fa7ee64c884f2cc342c1a011d92aed9e617ed7223a50a664275cd87e371: Status 404 returned error can't find the container with id 7fbe3fa7ee64c884f2cc342c1a011d92aed9e617ed7223a50a664275cd87e371
Jul 23 16:37:29.663238 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:29.663216    2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 23 16:37:30.270573 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:30.270535    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7433-139871946296112" event={"ID":"936926dd-c781-4857-934e-faf6f63922c3","Type":"ContainerStarted","Data":"7fbe3fa7ee64c884f2cc342c1a011d92aed9e617ed7223a50a664275cd87e371"}
Jul 23 16:37:31.278211 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:31.278167    2570 generic.go:356] "Generic (PLEG): container finished" podID="936926dd-c781-4857-934e-faf6f63922c3" containerID="1c9f1efb6bbbed4174fcaa2775e255c2687152714eaad9f3784179deddb6b436" exitCode=0
Jul 23 16:37:31.278622 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:31.278257    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7433-139871946296112" event={"ID":"936926dd-c781-4857-934e-faf6f63922c3","Type":"ContainerDied","Data":"1c9f1efb6bbbed4174fcaa2775e255c2687152714eaad9f3784179deddb6b436"}
Jul 23 16:37:32.443330 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.443302    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946296112"
Jul 23 16:37:32.463685 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.463622    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7433-139871946296112_936926dd-c781-4857-934e-faf6f63922c3/test-curl-7433-139871946296112/0.log"
Jul 23 16:37:32.483036 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.482997    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8l8n\" (UniqueName: \"kubernetes.io/projected/936926dd-c781-4857-934e-faf6f63922c3-kube-api-access-f8l8n\") pod \"936926dd-c781-4857-934e-faf6f63922c3\" (UID: \"936926dd-c781-4857-934e-faf6f63922c3\") "
Jul 23 16:37:32.485384 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.485321    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/936926dd-c781-4857-934e-faf6f63922c3-kube-api-access-f8l8n" (OuterVolumeSpecName: "kube-api-access-f8l8n") pod "936926dd-c781-4857-934e-faf6f63922c3" (UID: "936926dd-c781-4857-934e-faf6f63922c3"). InnerVolumeSpecName "kube-api-access-f8l8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:37:32.488547 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.488518    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7433-139871946296112"]
Jul 23 16:37:32.492276 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.492252    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7433-139871946296112"]
Jul 23 16:37:32.584347 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.584248    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8l8n\" (UniqueName: \"kubernetes.io/projected/936926dd-c781-4857-934e-faf6f63922c3-kube-api-access-f8l8n\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:37:32.603824 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.603790    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="936926dd-c781-4857-934e-faf6f63922c3" path="/var/lib/kubelet/pods/936926dd-c781-4857-934e-faf6f63922c3/volumes"
Jul 23 16:37:32.625625 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.625596    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7433-139871946170416"]
Jul 23 16:37:32.626064 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.626050    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="936926dd-c781-4857-934e-faf6f63922c3" containerName="test-curl-7433-139871946296112"
Jul 23 16:37:32.626111 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.626066    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="936926dd-c781-4857-934e-faf6f63922c3" containerName="test-curl-7433-139871946296112"
Jul 23 16:37:32.626150 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.626137    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="936926dd-c781-4857-934e-faf6f63922c3" containerName="test-curl-7433-139871946296112"
Jul 23 16:37:32.629413 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.629393    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946170416"
Jul 23 16:37:32.639624 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.639598    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7433-139871946170416"]
Jul 23 16:37:32.685144 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.685100    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slmqs\" (UniqueName: \"kubernetes.io/projected/231eb0c8-5ea4-490e-a730-21deb6d1caf9-kube-api-access-slmqs\") pod \"test-curl-7433-139871946170416\" (UID: \"231eb0c8-5ea4-490e-a730-21deb6d1caf9\") " pod="opendatahub/test-curl-7433-139871946170416"
Jul 23 16:37:32.785901 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.785867    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slmqs\" (UniqueName: \"kubernetes.io/projected/231eb0c8-5ea4-490e-a730-21deb6d1caf9-kube-api-access-slmqs\") pod \"test-curl-7433-139871946170416\" (UID: \"231eb0c8-5ea4-490e-a730-21deb6d1caf9\") " pod="opendatahub/test-curl-7433-139871946170416"
Jul 23 16:37:32.794711 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.794678    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slmqs\" (UniqueName: \"kubernetes.io/projected/231eb0c8-5ea4-490e-a730-21deb6d1caf9-kube-api-access-slmqs\") pod \"test-curl-7433-139871946170416\" (UID: \"231eb0c8-5ea4-490e-a730-21deb6d1caf9\") " pod="opendatahub/test-curl-7433-139871946170416"
Jul 23 16:37:32.940991 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:32.940895    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946170416"
Jul 23 16:37:33.086067 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:33.086039    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7433-139871946170416"]
Jul 23 16:37:33.087480 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:37:33.087457    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod231eb0c8_5ea4_490e_a730_21deb6d1caf9.slice/crio-1c475b64a5f30154e0b3669a43362dd48efe1d37c89f5249e0439bc40bd307c1 WatchSource:0}: Error finding container 1c475b64a5f30154e0b3669a43362dd48efe1d37c89f5249e0439bc40bd307c1: Status 404 returned error can't find the container with id 1c475b64a5f30154e0b3669a43362dd48efe1d37c89f5249e0439bc40bd307c1
Jul 23 16:37:33.291866 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:33.291832    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946296112"
Jul 23 16:37:33.292102 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:33.291885    2570 scope.go:117] "RemoveContainer" containerID="1c9f1efb6bbbed4174fcaa2775e255c2687152714eaad9f3784179deddb6b436"
Jul 23 16:37:33.293322 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:33.293296    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7433-139871946170416" event={"ID":"231eb0c8-5ea4-490e-a730-21deb6d1caf9","Type":"ContainerStarted","Data":"1c475b64a5f30154e0b3669a43362dd48efe1d37c89f5249e0439bc40bd307c1"}
Jul 23 16:37:34.302344 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:34.302298    2570 generic.go:356] "Generic (PLEG): container finished" podID="231eb0c8-5ea4-490e-a730-21deb6d1caf9" containerID="44a7cd7725ed5020c9425edc4204392cb89f023555a2a6dddeef16c869d9014d" exitCode=0
Jul 23 16:37:34.302760 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:34.302386    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7433-139871946170416" event={"ID":"231eb0c8-5ea4-490e-a730-21deb6d1caf9","Type":"ContainerDied","Data":"44a7cd7725ed5020c9425edc4204392cb89f023555a2a6dddeef16c869d9014d"}
Jul 23 16:37:35.462843 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.462813    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946170416"
Jul 23 16:37:35.484670 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.484640    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7433-139871946170416_231eb0c8-5ea4-490e-a730-21deb6d1caf9/test-curl-7433-139871946170416/0.log"
Jul 23 16:37:35.509959 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.509927    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slmqs\" (UniqueName: \"kubernetes.io/projected/231eb0c8-5ea4-490e-a730-21deb6d1caf9-kube-api-access-slmqs\") pod \"231eb0c8-5ea4-490e-a730-21deb6d1caf9\" (UID: \"231eb0c8-5ea4-490e-a730-21deb6d1caf9\") "
Jul 23 16:37:35.510790 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.510764    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7433-139871946170416"]
Jul 23 16:37:35.512469 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.512440    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/231eb0c8-5ea4-490e-a730-21deb6d1caf9-kube-api-access-slmqs" (OuterVolumeSpecName: "kube-api-access-slmqs") pod "231eb0c8-5ea4-490e-a730-21deb6d1caf9" (UID: "231eb0c8-5ea4-490e-a730-21deb6d1caf9"). InnerVolumeSpecName "kube-api-access-slmqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:37:35.514952 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.514925    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7433-139871946170416"]
Jul 23 16:37:35.611401 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.611308    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slmqs\" (UniqueName: \"kubernetes.io/projected/231eb0c8-5ea4-490e-a730-21deb6d1caf9-kube-api-access-slmqs\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:37:35.699874 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.699835    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7433-139871946146848"]
Jul 23 16:37:35.700310 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.700295    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="231eb0c8-5ea4-490e-a730-21deb6d1caf9" containerName="test-curl-7433-139871946170416"
Jul 23 16:37:35.700365 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.700311    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="231eb0c8-5ea4-490e-a730-21deb6d1caf9" containerName="test-curl-7433-139871946170416"
Jul 23 16:37:35.700409 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.700371    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="231eb0c8-5ea4-490e-a730-21deb6d1caf9" containerName="test-curl-7433-139871946170416"
Jul 23 16:37:35.703445 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.703427    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:35.714845 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.714815    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7433-139871946146848"]
Jul 23 16:37:35.813426 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.813386    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnr5r\" (UniqueName: \"kubernetes.io/projected/d7836574-17fd-41c9-b7c5-2a5194131f99-kube-api-access-lnr5r\") pod \"test-curl-7433-139871946146848\" (UID: \"d7836574-17fd-41c9-b7c5-2a5194131f99\") " pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:35.914409 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.914309    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnr5r\" (UniqueName: \"kubernetes.io/projected/d7836574-17fd-41c9-b7c5-2a5194131f99-kube-api-access-lnr5r\") pod \"test-curl-7433-139871946146848\" (UID: \"d7836574-17fd-41c9-b7c5-2a5194131f99\") " pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:35.922998 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:35.922967    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnr5r\" (UniqueName: \"kubernetes.io/projected/d7836574-17fd-41c9-b7c5-2a5194131f99-kube-api-access-lnr5r\") pod \"test-curl-7433-139871946146848\" (UID: \"d7836574-17fd-41c9-b7c5-2a5194131f99\") " pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:36.012718 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:36.012684    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:36.316417 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:36.316378    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946170416"
Jul 23 16:37:36.316616 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:36.316428    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c475b64a5f30154e0b3669a43362dd48efe1d37c89f5249e0439bc40bd307c1"
Jul 23 16:37:36.327062 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:37:36.327028    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7433-139871946170416\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="231eb0c8-5ea4-490e-a730-21deb6d1caf9" pod="opendatahub/test-curl-7433-139871946170416"
Jul 23 16:37:36.328623 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:36.328598    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:36.379496 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:36.379465    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7433-139871946146848"]
Jul 23 16:37:36.380647 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:37:36.380622    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7836574_17fd_41c9_b7c5_2a5194131f99.slice/crio-320140addcd8eecc9dc6782f496ab38159e6bc4ca36e64df0435b43923a4ffb2 WatchSource:0}: Error finding container 320140addcd8eecc9dc6782f496ab38159e6bc4ca36e64df0435b43923a4ffb2: Status 404 returned error can't find the container with id 320140addcd8eecc9dc6782f496ab38159e6bc4ca36e64df0435b43923a4ffb2
Jul 23 16:37:36.604644 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:36.604556    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="231eb0c8-5ea4-490e-a730-21deb6d1caf9" path="/var/lib/kubelet/pods/231eb0c8-5ea4-490e-a730-21deb6d1caf9/volumes"
Jul 23 16:37:37.324085 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:37.324003    2570 generic.go:356] "Generic (PLEG): container finished" podID="d7836574-17fd-41c9-b7c5-2a5194131f99" containerID="5aa53216625f3aad33cb6e470725ade407f3490f10dd0d2e7b66c133ea4b8ccb" exitCode=0
Jul 23 16:37:37.324288 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:37.324137    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7433-139871946146848" event={"ID":"d7836574-17fd-41c9-b7c5-2a5194131f99","Type":"ContainerDied","Data":"5aa53216625f3aad33cb6e470725ade407f3490f10dd0d2e7b66c133ea4b8ccb"}
Jul 23 16:37:37.324288 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:37.324181    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7433-139871946146848" event={"ID":"d7836574-17fd-41c9-b7c5-2a5194131f99","Type":"ContainerStarted","Data":"320140addcd8eecc9dc6782f496ab38159e6bc4ca36e64df0435b43923a4ffb2"}
Jul 23 16:37:38.479355 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.479324    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:38.499807 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.499723    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7433-139871946146848_d7836574-17fd-41c9-b7c5-2a5194131f99/test-curl-7433-139871946146848/0.log"
Jul 23 16:37:38.526896 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.526856    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7433-139871946146848"]
Jul 23 16:37:38.531905 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.531863    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7433-139871946146848"]
Jul 23 16:37:38.539362 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.539332    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnr5r\" (UniqueName: \"kubernetes.io/projected/d7836574-17fd-41c9-b7c5-2a5194131f99-kube-api-access-lnr5r\") pod \"d7836574-17fd-41c9-b7c5-2a5194131f99\" (UID: \"d7836574-17fd-41c9-b7c5-2a5194131f99\") "
Jul 23 16:37:38.541498 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.541465    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7836574-17fd-41c9-b7c5-2a5194131f99-kube-api-access-lnr5r" (OuterVolumeSpecName: "kube-api-access-lnr5r") pod "d7836574-17fd-41c9-b7c5-2a5194131f99" (UID: "d7836574-17fd-41c9-b7c5-2a5194131f99"). InnerVolumeSpecName "kube-api-access-lnr5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:37:38.603627 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.603535    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7836574-17fd-41c9-b7c5-2a5194131f99" path="/var/lib/kubelet/pods/d7836574-17fd-41c9-b7c5-2a5194131f99/volumes"
Jul 23 16:37:38.640412 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.640366    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnr5r\" (UniqueName: \"kubernetes.io/projected/d7836574-17fd-41c9-b7c5-2a5194131f99-kube-api-access-lnr5r\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:37:38.655201 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.655162    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7433-139871946146848"]
Jul 23 16:37:38.655636 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.655623    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7836574-17fd-41c9-b7c5-2a5194131f99" containerName="test-curl-7433-139871946146848"
Jul 23 16:37:38.655699 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.655638    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7836574-17fd-41c9-b7c5-2a5194131f99" containerName="test-curl-7433-139871946146848"
Jul 23 16:37:38.655737 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.655722    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7836574-17fd-41c9-b7c5-2a5194131f99" containerName="test-curl-7433-139871946146848"
Jul 23 16:37:38.659165 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.659143    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:38.667695 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.667608    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7433-139871946146848"]
Jul 23 16:37:38.741182 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.741132    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkx8c\" (UniqueName: \"kubernetes.io/projected/a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b-kube-api-access-qkx8c\") pod \"test-curl-7433-139871946146848\" (UID: \"a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b\") " pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:38.842371 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.842327    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkx8c\" (UniqueName: \"kubernetes.io/projected/a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b-kube-api-access-qkx8c\") pod \"test-curl-7433-139871946146848\" (UID: \"a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b\") " pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:38.850898 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.850858    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkx8c\" (UniqueName: \"kubernetes.io/projected/a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b-kube-api-access-qkx8c\") pod \"test-curl-7433-139871946146848\" (UID: \"a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b\") " pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:38.971329 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:38.971297    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:39.119033 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:39.118985    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7433-139871946146848"]
Jul 23 16:37:39.119851 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:37:39.119828    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda0b3d306_e168_43f4_8e5e_0fb7a5ae0d6b.slice/crio-6865b1f500407bf06726b2fc711451decdbbf3791f144339430551ae58128a03 WatchSource:0}: Error finding container 6865b1f500407bf06726b2fc711451decdbbf3791f144339430551ae58128a03: Status 404 returned error can't find the container with id 6865b1f500407bf06726b2fc711451decdbbf3791f144339430551ae58128a03
Jul 23 16:37:39.337270 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:39.337166    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7433-139871946146848" event={"ID":"a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b","Type":"ContainerStarted","Data":"6865b1f500407bf06726b2fc711451decdbbf3791f144339430551ae58128a03"}
Jul 23 16:37:39.338636 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:39.338608    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:39.338775 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:39.338659    2570 scope.go:117] "RemoveContainer" containerID="5aa53216625f3aad33cb6e470725ade407f3490f10dd0d2e7b66c133ea4b8ccb"
Jul 23 16:37:40.345977 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:40.345939    2570 generic.go:356] "Generic (PLEG): container finished" podID="a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b" containerID="477847d1dbefdf10ca84a86405c768231bead2441e55803d82e5a4f7de2dd378" exitCode=0
Jul 23 16:37:40.346429 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:40.345985    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7433-139871946146848" event={"ID":"a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b","Type":"ContainerDied","Data":"477847d1dbefdf10ca84a86405c768231bead2441e55803d82e5a4f7de2dd378"}
Jul 23 16:37:41.500962 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.500935    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:41.521769 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.521734    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7433-139871946146848_a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b/test-curl-7433-139871946146848/0.log"
Jul 23 16:37:41.549148 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.549095    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7433-139871946146848"]
Jul 23 16:37:41.552895 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.552866    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7433-139871946146848"]
Jul 23 16:37:41.570520 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.570484    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qkx8c\" (UniqueName: \"kubernetes.io/projected/a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b-kube-api-access-qkx8c\") pod \"a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b\" (UID: \"a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b\") "
Jul 23 16:37:41.572625 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.572599    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b-kube-api-access-qkx8c" (OuterVolumeSpecName: "kube-api-access-qkx8c") pod "a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b" (UID: "a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b"). InnerVolumeSpecName "kube-api-access-qkx8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:37:41.671354 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.671271    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qkx8c\" (UniqueName: \"kubernetes.io/projected/a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b-kube-api-access-qkx8c\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:37:41.671707 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.671685    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7433-139871946147856"]
Jul 23 16:37:41.672182 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.672167    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b" containerName="test-curl-7433-139871946146848"
Jul 23 16:37:41.672229 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.672184    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b" containerName="test-curl-7433-139871946146848"
Jul 23 16:37:41.672273 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.672264    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b" containerName="test-curl-7433-139871946146848"
Jul 23 16:37:41.675274 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.675258    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:41.689050 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.682942    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7433-139871946147856"]
Jul 23 16:37:41.772722 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.772685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzn6t\" (UniqueName: \"kubernetes.io/projected/edcb401c-dae1-46b3-851f-05382443289b-kube-api-access-nzn6t\") pod \"test-curl-7433-139871946147856\" (UID: \"edcb401c-dae1-46b3-851f-05382443289b\") " pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:41.873385 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.873344    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzn6t\" (UniqueName: \"kubernetes.io/projected/edcb401c-dae1-46b3-851f-05382443289b-kube-api-access-nzn6t\") pod \"test-curl-7433-139871946147856\" (UID: \"edcb401c-dae1-46b3-851f-05382443289b\") " pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:41.882336 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.882300    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzn6t\" (UniqueName: \"kubernetes.io/projected/edcb401c-dae1-46b3-851f-05382443289b-kube-api-access-nzn6t\") pod \"test-curl-7433-139871946147856\" (UID: \"edcb401c-dae1-46b3-851f-05382443289b\") " pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:41.998212 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:41.998154    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:42.147365 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:42.147334    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7433-139871946147856"]
Jul 23 16:37:42.149126 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:37:42.149098    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podedcb401c_dae1_46b3_851f_05382443289b.slice/crio-f341ed0787b459f521fcdc12bfe35a04496a70d53c57f1d327e00c0daf3a1640 WatchSource:0}: Error finding container f341ed0787b459f521fcdc12bfe35a04496a70d53c57f1d327e00c0daf3a1640: Status 404 returned error can't find the container with id f341ed0787b459f521fcdc12bfe35a04496a70d53c57f1d327e00c0daf3a1640
Jul 23 16:37:42.360847 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:42.360743    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7433-139871946147856" event={"ID":"edcb401c-dae1-46b3-851f-05382443289b","Type":"ContainerStarted","Data":"f341ed0787b459f521fcdc12bfe35a04496a70d53c57f1d327e00c0daf3a1640"}
Jul 23 16:37:42.361993 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:42.361970    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:42.361993 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:42.361989    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6865b1f500407bf06726b2fc711451decdbbf3791f144339430551ae58128a03"
Jul 23 16:37:42.372902 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:37:42.372869    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7433-139871946146848\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b" pod="opendatahub/test-curl-7433-139871946146848"
Jul 23 16:37:42.603485 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:42.603449    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b" path="/var/lib/kubelet/pods/a0b3d306-e168-43f4-8e5e-0fb7a5ae0d6b/volumes"
Jul 23 16:37:43.369350 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:43.369314    2570 generic.go:356] "Generic (PLEG): container finished" podID="edcb401c-dae1-46b3-851f-05382443289b" containerID="fb833f2c77c87f8d526816e5117fcf8ddaeb287cb65696aafb569731a0086647" exitCode=0
Jul 23 16:37:43.369536 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:43.369402    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7433-139871946147856" event={"ID":"edcb401c-dae1-46b3-851f-05382443289b","Type":"ContainerDied","Data":"fb833f2c77c87f8d526816e5117fcf8ddaeb287cb65696aafb569731a0086647"}
Jul 23 16:37:44.524931 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.524901    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:44.546352 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.546324    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7433-139871946147856_edcb401c-dae1-46b3-851f-05382443289b/test-curl-7433-139871946147856/0.log"
Jul 23 16:37:44.570749 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.570709    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7433-139871946147856"]
Jul 23 16:37:44.574470 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.574438    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7433-139871946147856"]
Jul 23 16:37:44.600168 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.600141    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzn6t\" (UniqueName: \"kubernetes.io/projected/edcb401c-dae1-46b3-851f-05382443289b-kube-api-access-nzn6t\") pod \"edcb401c-dae1-46b3-851f-05382443289b\" (UID: \"edcb401c-dae1-46b3-851f-05382443289b\") "
Jul 23 16:37:44.602327 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.602293    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edcb401c-dae1-46b3-851f-05382443289b-kube-api-access-nzn6t" (OuterVolumeSpecName: "kube-api-access-nzn6t") pod "edcb401c-dae1-46b3-851f-05382443289b" (UID: "edcb401c-dae1-46b3-851f-05382443289b"). InnerVolumeSpecName "kube-api-access-nzn6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:37:44.604990 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.604968    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edcb401c-dae1-46b3-851f-05382443289b" path="/var/lib/kubelet/pods/edcb401c-dae1-46b3-851f-05382443289b/volumes"
Jul 23 16:37:44.701558 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.701464    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzn6t\" (UniqueName: \"kubernetes.io/projected/edcb401c-dae1-46b3-851f-05382443289b-kube-api-access-nzn6t\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:37:44.721207 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.721169    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7433-139871946147856"]
Jul 23 16:37:44.721628 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.721614    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edcb401c-dae1-46b3-851f-05382443289b" containerName="test-curl-7433-139871946147856"
Jul 23 16:37:44.721667 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.721629    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="edcb401c-dae1-46b3-851f-05382443289b" containerName="test-curl-7433-139871946147856"
Jul 23 16:37:44.721711 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.721694    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="edcb401c-dae1-46b3-851f-05382443289b" containerName="test-curl-7433-139871946147856"
Jul 23 16:37:44.724427 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.724389    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:44.724902 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.724887    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:44.731544 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.731474    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7433-139871946147856"]
Jul 23 16:37:44.802717 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.802685    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s56w\" (UniqueName: \"kubernetes.io/projected/f155743d-867c-4954-ad93-b64ec6fa1924-kube-api-access-5s56w\") pod \"test-curl-7433-139871946147856\" (UID: \"f155743d-867c-4954-ad93-b64ec6fa1924\") " pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:44.903250 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.903210    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s56w\" (UniqueName: \"kubernetes.io/projected/f155743d-867c-4954-ad93-b64ec6fa1924-kube-api-access-5s56w\") pod \"test-curl-7433-139871946147856\" (UID: \"f155743d-867c-4954-ad93-b64ec6fa1924\") " pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:44.911768 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:44.911743    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s56w\" (UniqueName: \"kubernetes.io/projected/f155743d-867c-4954-ad93-b64ec6fa1924-kube-api-access-5s56w\") pod \"test-curl-7433-139871946147856\" (UID: \"f155743d-867c-4954-ad93-b64ec6fa1924\") " pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:45.035603 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:45.035557    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:45.184511 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:45.184483    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7433-139871946147856"]
Jul 23 16:37:45.185771 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:37:45.185740    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf155743d_867c_4954_ad93_b64ec6fa1924.slice/crio-b0d48f785215555fa675126c60e83e41ee064257ba91e6d257b93b43414c34bb WatchSource:0}: Error finding container b0d48f785215555fa675126c60e83e41ee064257ba91e6d257b93b43414c34bb: Status 404 returned error can't find the container with id b0d48f785215555fa675126c60e83e41ee064257ba91e6d257b93b43414c34bb
Jul 23 16:37:45.382700 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:45.382609    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:45.382700 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:45.382652    2570 scope.go:117] "RemoveContainer" containerID="fb833f2c77c87f8d526816e5117fcf8ddaeb287cb65696aafb569731a0086647"
Jul 23 16:37:45.384159 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:45.384039    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7433-139871946147856" event={"ID":"f155743d-867c-4954-ad93-b64ec6fa1924","Type":"ContainerStarted","Data":"b0d48f785215555fa675126c60e83e41ee064257ba91e6d257b93b43414c34bb"}
Jul 23 16:37:46.392365 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:46.392311    2570 generic.go:356] "Generic (PLEG): container finished" podID="f155743d-867c-4954-ad93-b64ec6fa1924" containerID="50d93a8eb34818911a443d23f417218c2d558b9d24c506c3d4ca709000f63260" exitCode=0
Jul 23 16:37:46.392769 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:46.392404    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7433-139871946147856" event={"ID":"f155743d-867c-4954-ad93-b64ec6fa1924","Type":"ContainerDied","Data":"50d93a8eb34818911a443d23f417218c2d558b9d24c506c3d4ca709000f63260"}
Jul 23 16:37:47.546975 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.546940    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:47.571436 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.571409    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7433-139871946147856_f155743d-867c-4954-ad93-b64ec6fa1924/test-curl-7433-139871946147856/0.log"
Jul 23 16:37:47.598130 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.598097    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7433-139871946147856"]
Jul 23 16:37:47.601906 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.601877    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7433-139871946147856"]
Jul 23 16:37:47.629473 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.629439    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s56w\" (UniqueName: \"kubernetes.io/projected/f155743d-867c-4954-ad93-b64ec6fa1924-kube-api-access-5s56w\") pod \"f155743d-867c-4954-ad93-b64ec6fa1924\" (UID: \"f155743d-867c-4954-ad93-b64ec6fa1924\") "
Jul 23 16:37:47.631573 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.631543    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f155743d-867c-4954-ad93-b64ec6fa1924-kube-api-access-5s56w" (OuterVolumeSpecName: "kube-api-access-5s56w") pod "f155743d-867c-4954-ad93-b64ec6fa1924" (UID: "f155743d-867c-4954-ad93-b64ec6fa1924"). InnerVolumeSpecName "kube-api-access-5s56w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:37:47.730976 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.730864    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s56w\" (UniqueName: \"kubernetes.io/projected/f155743d-867c-4954-ad93-b64ec6fa1924-kube-api-access-5s56w\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:37:47.804459 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.804422    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv"]
Jul 23 16:37:47.804949 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.804933    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f155743d-867c-4954-ad93-b64ec6fa1924" containerName="test-curl-7433-139871946147856"
Jul 23 16:37:47.804999 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.804953    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f155743d-867c-4954-ad93-b64ec6fa1924" containerName="test-curl-7433-139871946147856"
Jul 23 16:37:47.805071 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.805057    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f155743d-867c-4954-ad93-b64ec6fa1924" containerName="test-curl-7433-139871946147856"
Jul 23 16:37:47.808279 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.808259    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv"
Jul 23 16:37:47.810967 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.810947    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:37:47.816874 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.816845    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv"]
Jul 23 16:37:47.932995 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:47.932953    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f89b96be-47cd-4854-b655-b2465a8ec3ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv\" (UID: \"f89b96be-47cd-4854-b655-b2465a8ec3ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv"
Jul 23 16:37:48.034490 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:48.034396    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f89b96be-47cd-4854-b655-b2465a8ec3ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv\" (UID: \"f89b96be-47cd-4854-b655-b2465a8ec3ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv"
Jul 23 16:37:48.035076 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:48.035049    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f89b96be-47cd-4854-b655-b2465a8ec3ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv\" (UID: \"f89b96be-47cd-4854-b655-b2465a8ec3ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv"
Jul 23 16:37:48.122444 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:48.122401    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv"
Jul 23 16:37:48.274654 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:48.274623    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv"]
Jul 23 16:37:48.275575 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:37:48.275546    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89b96be_47cd_4854_b655_b2465a8ec3ff.slice/crio-8b0dfdf14c3bea1d97ec69d7ffa5bb31f3cf75564ca2ca9def41fee3fa634320 WatchSource:0}: Error finding container 8b0dfdf14c3bea1d97ec69d7ffa5bb31f3cf75564ca2ca9def41fee3fa634320: Status 404 returned error can't find the container with id 8b0dfdf14c3bea1d97ec69d7ffa5bb31f3cf75564ca2ca9def41fee3fa634320
Jul 23 16:37:48.341201 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:48.341171    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:48.405495 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:48.405464    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:48.405711 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:48.405511    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0d48f785215555fa675126c60e83e41ee064257ba91e6d257b93b43414c34bb"
Jul 23 16:37:48.406825 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:48.406797    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv" event={"ID":"f89b96be-47cd-4854-b655-b2465a8ec3ff","Type":"ContainerStarted","Data":"8b0dfdf14c3bea1d97ec69d7ffa5bb31f3cf75564ca2ca9def41fee3fa634320"}
Jul 23 16:37:48.417389 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:37:48.417359    2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7433-139871946147856\" is forbidden: User \"system:node:ip-10-0-135-218.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-218.ec2.internal' and this object" podUID="f155743d-867c-4954-ad93-b64ec6fa1924" pod="opendatahub/test-curl-7433-139871946147856"
Jul 23 16:37:48.442498 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:48.442462    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:48.605194 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:48.605085    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f155743d-867c-4954-ad93-b64ec6fa1924" path="/var/lib/kubelet/pods/f155743d-867c-4954-ad93-b64ec6fa1924/volumes"
Jul 23 16:37:49.415383 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:49.415275    2570 generic.go:356] "Generic (PLEG): container finished" podID="f89b96be-47cd-4854-b655-b2465a8ec3ff" containerID="02032a8f3566718813df49bfd83c6617b9c481ffff7c282bbd97dd00178659f9" exitCode=0
Jul 23 16:37:49.415383 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:49.415330    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv" event={"ID":"f89b96be-47cd-4854-b655-b2465a8ec3ff","Type":"ContainerDied","Data":"02032a8f3566718813df49bfd83c6617b9c481ffff7c282bbd97dd00178659f9"}
Jul 23 16:37:49.667248 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:49.667147    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:50.569902 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:50.569873    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv"
Jul 23 16:37:50.661991 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:50.661955    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f89b96be-47cd-4854-b655-b2465a8ec3ff-maas-api-service-ca\") pod \"f89b96be-47cd-4854-b655-b2465a8ec3ff\" (UID: \"f89b96be-47cd-4854-b655-b2465a8ec3ff\") "
Jul 23 16:37:50.662405 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:50.662378    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f89b96be-47cd-4854-b655-b2465a8ec3ff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f89b96be-47cd-4854-b655-b2465a8ec3ff" (UID: "f89b96be-47cd-4854-b655-b2465a8ec3ff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:37:50.763424 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:50.763384    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f89b96be-47cd-4854-b655-b2465a8ec3ff-maas-api-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:37:51.429483 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:51.429445    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv"
Jul 23 16:37:51.429483 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:51.429455    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv" event={"ID":"f89b96be-47cd-4854-b655-b2465a8ec3ff","Type":"ContainerDied","Data":"8b0dfdf14c3bea1d97ec69d7ffa5bb31f3cf75564ca2ca9def41fee3fa634320"}
Jul 23 16:37:51.429729 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:51.429505    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b0dfdf14c3bea1d97ec69d7ffa5bb31f3cf75564ca2ca9def41fee3fa634320"
Jul 23 16:37:58.281620 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.281582    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"]
Jul 23 16:37:58.282235 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.281853    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck" podUID="84928166-6220-4ade-90c3-abc19724c22d" containerName="maas-api" containerID="cri-o://8e794a63913ec988acd7fc7e2c58e261af96d69e484bf3a2048163812e432103" gracePeriod=30
Jul 23 16:37:58.309262 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.309222    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:37:58.484566 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.484526    2570 generic.go:356] "Generic (PLEG): container finished" podID="84928166-6220-4ade-90c3-abc19724c22d" containerID="8e794a63913ec988acd7fc7e2c58e261af96d69e484bf3a2048163812e432103" exitCode=0
Jul 23 16:37:58.484751 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.484596    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck" event={"ID":"84928166-6220-4ade-90c3-abc19724c22d","Type":"ContainerDied","Data":"8e794a63913ec988acd7fc7e2c58e261af96d69e484bf3a2048163812e432103"}
Jul 23 16:37:58.554876 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.554842    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:37:58.642150 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.642104    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs7wf\" (UniqueName: \"kubernetes.io/projected/84928166-6220-4ade-90c3-abc19724c22d-kube-api-access-zs7wf\") pod \"84928166-6220-4ade-90c3-abc19724c22d\" (UID: \"84928166-6220-4ade-90c3-abc19724c22d\") "
Jul 23 16:37:58.642350 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.642249    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84928166-6220-4ade-90c3-abc19724c22d-openshift-service-ca\") pod \"84928166-6220-4ade-90c3-abc19724c22d\" (UID: \"84928166-6220-4ade-90c3-abc19724c22d\") "
Jul 23 16:37:58.642350 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.642295    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84928166-6220-4ade-90c3-abc19724c22d-maas-api-tls\") pod \"84928166-6220-4ade-90c3-abc19724c22d\" (UID: \"84928166-6220-4ade-90c3-abc19724c22d\") "
Jul 23 16:37:58.642699 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.642669    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84928166-6220-4ade-90c3-abc19724c22d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "84928166-6220-4ade-90c3-abc19724c22d" (UID: "84928166-6220-4ade-90c3-abc19724c22d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:37:58.644456 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.644427    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84928166-6220-4ade-90c3-abc19724c22d-kube-api-access-zs7wf" (OuterVolumeSpecName: "kube-api-access-zs7wf") pod "84928166-6220-4ade-90c3-abc19724c22d" (UID: "84928166-6220-4ade-90c3-abc19724c22d"). InnerVolumeSpecName "kube-api-access-zs7wf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:37:58.644772 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.644746    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84928166-6220-4ade-90c3-abc19724c22d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "84928166-6220-4ade-90c3-abc19724c22d" (UID: "84928166-6220-4ade-90c3-abc19724c22d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:37:58.743365 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.743331    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/84928166-6220-4ade-90c3-abc19724c22d-openshift-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:37:58.743365 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.743362    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/84928166-6220-4ade-90c3-abc19724c22d-maas-api-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:37:58.743365 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:58.743371    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs7wf\" (UniqueName: \"kubernetes.io/projected/84928166-6220-4ade-90c3-abc19724c22d-kube-api-access-zs7wf\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:37:59.492134 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:59.492101    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"
Jul 23 16:37:59.492134 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:59.492127    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck" event={"ID":"84928166-6220-4ade-90c3-abc19724c22d","Type":"ContainerDied","Data":"4ad7dfb8551eb67e6753496c2cfe87e4107aaffa38b3bf06c157d2596f2232c9"}
Jul 23 16:37:59.492651 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:59.492189    2570 scope.go:117] "RemoveContainer" containerID="8e794a63913ec988acd7fc7e2c58e261af96d69e484bf3a2048163812e432103"
Jul 23 16:37:59.514676 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:59.514642    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"]
Jul 23 16:37:59.518627 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:37:59.518601    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-9d26cd-656fd4478f-nfdck"]
Jul 23 16:38:00.603874 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:00.603839    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84928166-6220-4ade-90c3-abc19724c22d" path="/var/lib/kubelet/pods/84928166-6220-4ade-90c3-abc19724c22d/volumes"
Jul 23 16:38:02.881425 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:02.881387    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:02.898497 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:02.898459    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv"]
Jul 23 16:38:02.902068 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:02.902033    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-9d26cd-wdlfv"]
Jul 23 16:38:03.316586 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:03.316551    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:04.603930 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:04.603897    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f89b96be-47cd-4854-b655-b2465a8ec3ff" path="/var/lib/kubelet/pods/f89b96be-47cd-4854-b655-b2465a8ec3ff/volumes"
Jul 23 16:38:09.373911 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:09.373804    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:09.475476 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:09.475431    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:09.668725 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:09.668634    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:09.914538 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:09.914510    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:10.038677 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.038630    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q"]
Jul 23 16:38:10.039331 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.039312    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89b96be-47cd-4854-b655-b2465a8ec3ff" containerName="revoke-keys"
Jul 23 16:38:10.039383 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.039335    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89b96be-47cd-4854-b655-b2465a8ec3ff" containerName="revoke-keys"
Jul 23 16:38:10.039383 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.039363    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84928166-6220-4ade-90c3-abc19724c22d" containerName="maas-api"
Jul 23 16:38:10.039383 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.039372    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="84928166-6220-4ade-90c3-abc19724c22d" containerName="maas-api"
Jul 23 16:38:10.039490 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.039478    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="84928166-6220-4ade-90c3-abc19724c22d" containerName="maas-api"
Jul 23 16:38:10.039525 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.039499    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="f89b96be-47cd-4854-b655-b2465a8ec3ff" containerName="revoke-keys"
Jul 23 16:38:10.043335 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.043314    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q"
Jul 23 16:38:10.045968 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.045950    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rglgz\""
Jul 23 16:38:10.049874 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.049845    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b33c02-c573-45bc-861f-a81b3d46bcf6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q\" (UID: \"c3b33c02-c573-45bc-861f-a81b3d46bcf6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q"
Jul 23 16:38:10.051901 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.051533    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q"]
Jul 23 16:38:10.151432 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.151393    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b33c02-c573-45bc-861f-a81b3d46bcf6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q\" (UID: \"c3b33c02-c573-45bc-861f-a81b3d46bcf6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q"
Jul 23 16:38:10.152070 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.152043    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b33c02-c573-45bc-861f-a81b3d46bcf6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q\" (UID: \"c3b33c02-c573-45bc-861f-a81b3d46bcf6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q"
Jul 23 16:38:10.356800 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.356678    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q"
Jul 23 16:38:10.506826 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.506793    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q"]
Jul 23 16:38:10.508347 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:38:10.508312    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3b33c02_c573_45bc_861f_a81b3d46bcf6.slice/crio-e3eeb77a47fbb28804300b6de016e9944c9204f7a1f01717a678a840c8625e42 WatchSource:0}: Error finding container e3eeb77a47fbb28804300b6de016e9944c9204f7a1f01717a678a840c8625e42: Status 404 returned error can't find the container with id e3eeb77a47fbb28804300b6de016e9944c9204f7a1f01717a678a840c8625e42
Jul 23 16:38:10.564802 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.564766    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q" event={"ID":"c3b33c02-c573-45bc-861f-a81b3d46bcf6","Type":"ContainerStarted","Data":"e3eeb77a47fbb28804300b6de016e9944c9204f7a1f01717a678a840c8625e42"}
Jul 23 16:38:10.569192 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.569151    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:10.669474 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:10.669383    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:11.572462 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:11.572429    2570 generic.go:356] "Generic (PLEG): container finished" podID="c3b33c02-c573-45bc-861f-a81b3d46bcf6" containerID="1ec14817c95eda174871900ae5f94331a603ac6e31cc9f00ccc7d26fd74ff65d" exitCode=0
Jul 23 16:38:11.572922 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:11.572528    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q" event={"ID":"c3b33c02-c573-45bc-861f-a81b3d46bcf6","Type":"ContainerDied","Data":"1ec14817c95eda174871900ae5f94331a603ac6e31cc9f00ccc7d26fd74ff65d"}
Jul 23 16:38:12.721460 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:12.721431    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q"
Jul 23 16:38:12.778213 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:12.778185    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b33c02-c573-45bc-861f-a81b3d46bcf6-maas-api-service-ca\") pod \"c3b33c02-c573-45bc-861f-a81b3d46bcf6\" (UID: \"c3b33c02-c573-45bc-861f-a81b3d46bcf6\") "
Jul 23 16:38:12.778581 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:12.778559    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3b33c02-c573-45bc-861f-a81b3d46bcf6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c3b33c02-c573-45bc-861f-a81b3d46bcf6" (UID: "c3b33c02-c573-45bc-861f-a81b3d46bcf6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:38:12.878977 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:12.878880    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b33c02-c573-45bc-861f-a81b3d46bcf6-maas-api-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:38:13.586528 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:13.586495    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q"
Jul 23 16:38:13.586715 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:13.586495    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q" event={"ID":"c3b33c02-c573-45bc-861f-a81b3d46bcf6","Type":"ContainerDied","Data":"e3eeb77a47fbb28804300b6de016e9944c9204f7a1f01717a678a840c8625e42"}
Jul 23 16:38:13.586715 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:13.586627    2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3eeb77a47fbb28804300b6de016e9944c9204f7a1f01717a678a840c8625e42"
Jul 23 16:38:20.517188 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.517149    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"]
Jul 23 16:38:20.517997 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.517940    2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz" podUID="36683594-e009-4b9d-92d6-e20927cad4c7" containerName="maas-api" containerID="cri-o://f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95" gracePeriod=30
Jul 23 16:38:20.552828 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.552791    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:20.801136 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.801099    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:38:20.852871 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.852827    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts82l\" (UniqueName: \"kubernetes.io/projected/36683594-e009-4b9d-92d6-e20927cad4c7-kube-api-access-ts82l\") pod \"36683594-e009-4b9d-92d6-e20927cad4c7\" (UID: \"36683594-e009-4b9d-92d6-e20927cad4c7\") "
Jul 23 16:38:20.853105 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.852955    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36683594-e009-4b9d-92d6-e20927cad4c7-maas-api-tls\") pod \"36683594-e009-4b9d-92d6-e20927cad4c7\" (UID: \"36683594-e009-4b9d-92d6-e20927cad4c7\") "
Jul 23 16:38:20.853196 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.853101    2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36683594-e009-4b9d-92d6-e20927cad4c7-openshift-service-ca\") pod \"36683594-e009-4b9d-92d6-e20927cad4c7\" (UID: \"36683594-e009-4b9d-92d6-e20927cad4c7\") "
Jul 23 16:38:20.853541 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.853510    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36683594-e009-4b9d-92d6-e20927cad4c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "36683594-e009-4b9d-92d6-e20927cad4c7" (UID: "36683594-e009-4b9d-92d6-e20927cad4c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 23 16:38:20.855220 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.855193    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36683594-e009-4b9d-92d6-e20927cad4c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "36683594-e009-4b9d-92d6-e20927cad4c7" (UID: "36683594-e009-4b9d-92d6-e20927cad4c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 23 16:38:20.855220 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.855207    2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36683594-e009-4b9d-92d6-e20927cad4c7-kube-api-access-ts82l" (OuterVolumeSpecName: "kube-api-access-ts82l") pod "36683594-e009-4b9d-92d6-e20927cad4c7" (UID: "36683594-e009-4b9d-92d6-e20927cad4c7"). InnerVolumeSpecName "kube-api-access-ts82l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 23 16:38:20.954338 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.954297    2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts82l\" (UniqueName: \"kubernetes.io/projected/36683594-e009-4b9d-92d6-e20927cad4c7-kube-api-access-ts82l\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:38:20.954338 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.954332    2570 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/36683594-e009-4b9d-92d6-e20927cad4c7-maas-api-tls\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:38:20.954338 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:20.954342    2570 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/36683594-e009-4b9d-92d6-e20927cad4c7-openshift-service-ca\") on node \"ip-10-0-135-218.ec2.internal\" DevicePath \"\""
Jul 23 16:38:21.640088 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:21.640037    2570 generic.go:356] "Generic (PLEG): container finished" podID="36683594-e009-4b9d-92d6-e20927cad4c7" containerID="f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95" exitCode=0
Jul 23 16:38:21.640594 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:21.640098    2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"
Jul 23 16:38:21.640594 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:21.640127    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz" event={"ID":"36683594-e009-4b9d-92d6-e20927cad4c7","Type":"ContainerDied","Data":"f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95"}
Jul 23 16:38:21.640594 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:21.640194    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz" event={"ID":"36683594-e009-4b9d-92d6-e20927cad4c7","Type":"ContainerDied","Data":"16b64f82d43227e4db9b19dcde561e481a3d92fe453facc483985b6fc8745619"}
Jul 23 16:38:21.640594 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:21.640217    2570 scope.go:117] "RemoveContainer" containerID="f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95"
Jul 23 16:38:21.650498 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:21.650477    2570 scope.go:117] "RemoveContainer" containerID="f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95"
Jul 23 16:38:21.650813 ip-10-0-135-218 kubenswrapper[2570]: E0723 16:38:21.650790    2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95\": container with ID starting with f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95 not found: ID does not exist" containerID="f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95"
Jul 23 16:38:21.650873 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:21.650825    2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95"} err="failed to get container status \"f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95\": rpc error: code = NotFound desc = could not find container \"f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95\": container with ID starting with f2648f20a37da900c72ea4c4016a4549fb5737269b8250de7d0aede93e6d4b95 not found: ID does not exist"
Jul 23 16:38:21.663716 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:21.663688    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"]
Jul 23 16:38:21.669554 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:21.669526    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-ebb72a-7f76d84f97-2dzpz"]
Jul 23 16:38:22.604133 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:22.604100    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36683594-e009-4b9d-92d6-e20927cad4c7" path="/var/lib/kubelet/pods/36683594-e009-4b9d-92d6-e20927cad4c7/volumes"
Jul 23 16:38:25.119713 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:25.119677    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:25.127949 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:25.127922    2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q"]
Jul 23 16:38:25.130376 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:25.130355    2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-ebb72a-z4c8q"]
Jul 23 16:38:25.526663 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:25.526618    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:26.604111 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:26.604076    2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3b33c02-c573-45bc-861f-a81b3d46bcf6" path="/var/lib/kubelet/pods/c3b33c02-c573-45bc-861f-a81b3d46bcf6/volumes"
Jul 23 16:38:31.695065 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:31.694989    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:31.795685 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:31.795647    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:31.998979 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:31.998941    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:32.235501 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:32.235452    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:34.132893 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:34.132845    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:34.188954 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:34.188915    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:38.395795 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:38.395757    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-h6src_acd18520-f84a-4688-ae38-84f41f6dc943/manager/0.log"
Jul 23 16:38:38.528736 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:38.528700    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5pb78_2d8c0155-0220-40da-a24b-ce28c368c185/manager/0.log"
Jul 23 16:38:38.663409 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:38.663315    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-688fcc8886-mbbwq_2794f966-bd7d-4187-bdd9-06ce5ab40f8a/manager/0.log"
Jul 23 16:38:38.930029 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:38.929917    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2dj4p_e6c02851-a121-4661-898e-cc71ec4dc208/manager/0.log"
Jul 23 16:38:39.047507 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:39.047478    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-575b84b7c9-l4qgs_8abf694b-0dbb-472f-98ca-83e8a903abd7/copy-manifests/0.log"
Jul 23 16:38:39.066067 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:39.066001    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-575b84b7c9-l4qgs_8abf694b-0dbb-472f-98ca-83e8a903abd7/manager/0.log"
Jul 23 16:38:39.689669 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:39.689616    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5bfcc994b9-sqhlc_1aa72918-35bb-428d-b750-fb57550cf685/maas-api/0.log"
Jul 23 16:38:39.805245 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:39.805216    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747055-d7gw4_62bef16f-e0ba-4d2c-8468-dae0b8af9561/cleanup/0.log"
Jul 23 16:38:39.919295 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:39.919254    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29747070-qr6db_b8e393eb-88c9-4cda-b9f5-fe646ba533b1/cleanup/0.log"
Jul 23 16:38:40.042655 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:40.042622    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-h6mnl_e3fbe4cb-0bb4-4276-ad86-e1dbf325043f/postgres/0.log"
Jul 23 16:38:40.866524 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:40.866489    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv_e4d742ef-2cdb-4eca-81a1-5655fb86b884/extract/0.log"
Jul 23 16:38:40.873228 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:40.873201    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv_e4d742ef-2cdb-4eca-81a1-5655fb86b884/util/0.log"
Jul 23 16:38:40.880269 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:40.880237    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv_e4d742ef-2cdb-4eca-81a1-5655fb86b884/pull/0.log"
Jul 23 16:38:41.004360 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.004333    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll_87d529f4-7acb-4f12-8720-045526ac68af/util/0.log"
Jul 23 16:38:41.012524 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.012498    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll_87d529f4-7acb-4f12-8720-045526ac68af/pull/0.log"
Jul 23 16:38:41.019675 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.019648    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll_87d529f4-7acb-4f12-8720-045526ac68af/extract/0.log"
Jul 23 16:38:41.137385 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.137298    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b_bb9d77a7-363b-48f6-826e-b2348d4630f7/util/0.log"
Jul 23 16:38:41.144165 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.144139    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b_bb9d77a7-363b-48f6-826e-b2348d4630f7/pull/0.log"
Jul 23 16:38:41.150317 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.150297    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b_bb9d77a7-363b-48f6-826e-b2348d4630f7/extract/0.log"
Jul 23 16:38:41.269412 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.269379    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9_819fb198-6452-4eb2-aa02-ac5b9912e165/util/0.log"
Jul 23 16:38:41.276180 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.276154    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9_819fb198-6452-4eb2-aa02-ac5b9912e165/pull/0.log"
Jul 23 16:38:41.282841 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.282817    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9_819fb198-6452-4eb2-aa02-ac5b9912e165/extract/0.log"
Jul 23 16:38:41.537328 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.537281    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7866q_2fd00603-22cc-4c32-b471-1af7a8fd5864/manager/0.log"
Jul 23 16:38:41.657878 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.657846    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jf87g_e2f0d511-f920-44d6-9bd0-b2ae3701fbbb/manager/0.log"
Jul 23 16:38:41.782310 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.782281    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ffzkp_91906f93-a708-4b4f-8134-c5fe83a5beb7/kuadrant-console-plugin/0.log"
Jul 23 16:38:41.910319 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:41.910234    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lkkgl_ba85d7cc-d09f-4070-88c9-9b022b66a3b1/registry-server/0.log"
Jul 23 16:38:42.045379 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:42.045343    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-glbnr_f7bac498-f029-4343-b65f-b8c6e675ae7b/manager/0.log"
Jul 23 16:38:42.289398 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:42.289349    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-j7jbz_b311cc2e-2285-4625-8df7-13b6160e5a3d/manager/0.log"
Jul 23 16:38:43.031967 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:43.031936    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c56c994b9-rrkgh_f07ea543-3a22-49ee-bbb7-28d45896c8bf/kube-auth-proxy/0.log"
Jul 23 16:38:43.284665 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:43.284570    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-mklln_d3e29cb9-b084-4916-b58a-f61d391dc80f/payload-pre-processing/0.log"
Jul 23 16:38:44.039065 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:44.039036    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-wg52p_b05ac0a8-902c-4a40-be68-cef97080e0a5/main/0.log"
Jul 23 16:38:44.162916 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:44.162879    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-tblfw_41caa2e0-9ea1-4ef5-b9b5-f74da5bc8d78/main/0.log"
Jul 23 16:38:50.360850 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.360812    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9l5zs/must-gather-v5gqq"]
Jul 23 16:38:50.361312 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.361296    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36683594-e009-4b9d-92d6-e20927cad4c7" containerName="maas-api"
Jul 23 16:38:50.361312 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.361313    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="36683594-e009-4b9d-92d6-e20927cad4c7" containerName="maas-api"
Jul 23 16:38:50.361389 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.361332    2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3b33c02-c573-45bc-861f-a81b3d46bcf6" containerName="revoke-keys"
Jul 23 16:38:50.361389 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.361338    2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3b33c02-c573-45bc-861f-a81b3d46bcf6" containerName="revoke-keys"
Jul 23 16:38:50.361455 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.361409    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="36683594-e009-4b9d-92d6-e20927cad4c7" containerName="maas-api"
Jul 23 16:38:50.361455 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.361417    2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3b33c02-c573-45bc-861f-a81b3d46bcf6" containerName="revoke-keys"
Jul 23 16:38:50.365985 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.365967    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l5zs/must-gather-v5gqq"
Jul 23 16:38:50.368995 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.368971    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9l5zs\"/\"openshift-service-ca.crt\""
Jul 23 16:38:50.369143 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.369040    2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9l5zs\"/\"kube-root-ca.crt\""
Jul 23 16:38:50.370396 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.370379    2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9l5zs\"/\"default-dockercfg-ncpq6\""
Jul 23 16:38:50.376184 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.376150    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:50.376675 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.376654    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l5zs/must-gather-v5gqq"]
Jul 23 16:38:50.445673 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.445630    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgphv\" (UniqueName: \"kubernetes.io/projected/33be66ba-5cf2-483d-9b87-3465053ea568-kube-api-access-zgphv\") pod \"must-gather-v5gqq\" (UID: \"33be66ba-5cf2-483d-9b87-3465053ea568\") " pod="openshift-must-gather-9l5zs/must-gather-v5gqq"
Jul 23 16:38:50.445866 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.445691    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/33be66ba-5cf2-483d-9b87-3465053ea568-must-gather-output\") pod \"must-gather-v5gqq\" (UID: \"33be66ba-5cf2-483d-9b87-3465053ea568\") " pod="openshift-must-gather-9l5zs/must-gather-v5gqq"
Jul 23 16:38:50.472488 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.472459    2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log" limit=1024
Jul 23 16:38:50.546734 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.546701    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/33be66ba-5cf2-483d-9b87-3465053ea568-must-gather-output\") pod \"must-gather-v5gqq\" (UID: \"33be66ba-5cf2-483d-9b87-3465053ea568\") " pod="openshift-must-gather-9l5zs/must-gather-v5gqq"
Jul 23 16:38:50.546910 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.546803    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgphv\" (UniqueName: \"kubernetes.io/projected/33be66ba-5cf2-483d-9b87-3465053ea568-kube-api-access-zgphv\") pod \"must-gather-v5gqq\" (UID: \"33be66ba-5cf2-483d-9b87-3465053ea568\") " pod="openshift-must-gather-9l5zs/must-gather-v5gqq"
Jul 23 16:38:50.547090 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.547072    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/33be66ba-5cf2-483d-9b87-3465053ea568-must-gather-output\") pod \"must-gather-v5gqq\" (UID: \"33be66ba-5cf2-483d-9b87-3465053ea568\") " pod="openshift-must-gather-9l5zs/must-gather-v5gqq"
Jul 23 16:38:50.555632 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.555600    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgphv\" (UniqueName: \"kubernetes.io/projected/33be66ba-5cf2-483d-9b87-3465053ea568-kube-api-access-zgphv\") pod \"must-gather-v5gqq\" (UID: \"33be66ba-5cf2-483d-9b87-3465053ea568\") " pod="openshift-must-gather-9l5zs/must-gather-v5gqq"
Jul 23 16:38:50.677326 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.677217    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l5zs/must-gather-v5gqq"
Jul 23 16:38:50.829986 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:50.829952    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l5zs/must-gather-v5gqq"]
Jul 23 16:38:50.831170 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:38:50.831135    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33be66ba_5cf2_483d_9b87_3465053ea568.slice/crio-513e1e28b29b9790baa9229a6d38c22a7332e17ebf5fa7a97b99cd45e4179925 WatchSource:0}: Error finding container 513e1e28b29b9790baa9229a6d38c22a7332e17ebf5fa7a97b99cd45e4179925: Status 404 returned error can't find the container with id 513e1e28b29b9790baa9229a6d38c22a7332e17ebf5fa7a97b99cd45e4179925
Jul 23 16:38:51.831605 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:51.831557    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l5zs/must-gather-v5gqq" event={"ID":"33be66ba-5cf2-483d-9b87-3465053ea568","Type":"ContainerStarted","Data":"25bcceeb663c72e58b76fffeaaa5da81061e420838e863528898bdf8e97b2540"}
Jul 23 16:38:51.832054 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:51.831618    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l5zs/must-gather-v5gqq" event={"ID":"33be66ba-5cf2-483d-9b87-3465053ea568","Type":"ContainerStarted","Data":"513e1e28b29b9790baa9229a6d38c22a7332e17ebf5fa7a97b99cd45e4179925"}
Jul 23 16:38:52.841739 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:52.841700    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l5zs/must-gather-v5gqq" event={"ID":"33be66ba-5cf2-483d-9b87-3465053ea568","Type":"ContainerStarted","Data":"421f9715b64dd6c38267aa2428cad09e0651af420a67236081c938a1fddc2af5"}
Jul 23 16:38:52.857174 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:52.857114    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9l5zs/must-gather-v5gqq" podStartSLOduration=2.014852703 podStartE2EDuration="2.857094087s" totalImagesPullingTime="842.241384ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 16:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:38:52.85660443 +0000 UTC m=+2918.780459067" watchObservedRunningTime="2026-07-23 16:38:52.857094087 +0000 UTC m=+2918.780948788"
Jul 23 16:38:53.356607 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:53.356571    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v7clr_631c3f7e-3c49-43fe-b4ca-610a73cd960e/global-pull-secret-syncer/0.log"
Jul 23 16:38:53.418339 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:53.418303    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6khxq_a54fffa1-1035-4460-929e-bc6c8289348b/konnectivity-agent/0.log"
Jul 23 16:38:53.543209 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:53.543177    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-218.ec2.internal_b336876c7020fb78e54d8649d256ea31/haproxy/0.log"
Jul 23 16:38:58.416406 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:58.416359    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv_e4d742ef-2cdb-4eca-81a1-5655fb86b884/extract/0.log"
Jul 23 16:38:58.438166 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:58.438134    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv_e4d742ef-2cdb-4eca-81a1-5655fb86b884/util/0.log"
Jul 23 16:38:58.468594 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:58.468569    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759r7hdv_e4d742ef-2cdb-4eca-81a1-5655fb86b884/pull/0.log"
Jul 23 16:38:58.509131 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:58.509034    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll_87d529f4-7acb-4f12-8720-045526ac68af/extract/0.log"
Jul 23 16:38:58.538136 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:58.538109    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll_87d529f4-7acb-4f12-8720-045526ac68af/util/0.log"
Jul 23 16:38:58.560697 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:58.560664    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0944ll_87d529f4-7acb-4f12-8720-045526ac68af/pull/0.log"
Jul 23 16:38:58.591792 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:58.591768    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b_bb9d77a7-363b-48f6-826e-b2348d4630f7/extract/0.log"
Jul 23 16:38:58.615703 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:58.615671    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b_bb9d77a7-363b-48f6-826e-b2348d4630f7/util/0.log"
Jul 23 16:38:58.645585 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:58.645546    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73smm4b_bb9d77a7-363b-48f6-826e-b2348d4630f7/pull/0.log"
Jul 23 16:38:58.686720 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:58.686624    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9_819fb198-6452-4eb2-aa02-ac5b9912e165/extract/0.log"
Jul 23 16:38:58.709393 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:58.709361    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9_819fb198-6452-4eb2-aa02-ac5b9912e165/util/0.log"
Jul 23 16:38:58.734654 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:58.734589    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1k8hx9_819fb198-6452-4eb2-aa02-ac5b9912e165/pull/0.log"
Jul 23 16:38:59.407651 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:59.407614    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-7866q_2fd00603-22cc-4c32-b471-1af7a8fd5864/manager/0.log"
Jul 23 16:38:59.437381 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:59.437352    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jf87g_e2f0d511-f920-44d6-9bd0-b2ae3701fbbb/manager/0.log"
Jul 23 16:38:59.464592 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:59.464556    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-ffzkp_91906f93-a708-4b4f-8134-c5fe83a5beb7/kuadrant-console-plugin/0.log"
Jul 23 16:38:59.519819 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:59.519778    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lkkgl_ba85d7cc-d09f-4070-88c9-9b022b66a3b1/registry-server/0.log"
Jul 23 16:38:59.745055 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:59.744951    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-glbnr_f7bac498-f029-4343-b65f-b8c6e675ae7b/manager/0.log"
Jul 23 16:38:59.862725 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:38:59.862687    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-j7jbz_b311cc2e-2285-4625-8df7-13b6160e5a3d/manager/0.log"
Jul 23 16:39:01.571919 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:01.571884    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a79e3db-15d0-4493-bc6a-4e1c82525773/alertmanager/0.log"
Jul 23 16:39:01.590783 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:01.590755    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a79e3db-15d0-4493-bc6a-4e1c82525773/config-reloader/0.log"
Jul 23 16:39:01.613894 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:01.613850    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a79e3db-15d0-4493-bc6a-4e1c82525773/kube-rbac-proxy-web/0.log"
Jul 23 16:39:01.635457 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:01.635426    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a79e3db-15d0-4493-bc6a-4e1c82525773/kube-rbac-proxy/0.log"
Jul 23 16:39:01.657692 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:01.657659    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a79e3db-15d0-4493-bc6a-4e1c82525773/kube-rbac-proxy-metric/0.log"
Jul 23 16:39:01.679560 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:01.679531    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a79e3db-15d0-4493-bc6a-4e1c82525773/prom-label-proxy/0.log"
Jul 23 16:39:01.701366 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:01.701335    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9a79e3db-15d0-4493-bc6a-4e1c82525773/init-config-reloader/0.log"
Jul 23 16:39:01.869841 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:01.869688    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65c8dd4f76-6bqcw_ffd39c19-482d-438c-867f-c12dfe437e6d/metrics-server/0.log"
Jul 23 16:39:01.894505 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:01.894474    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-sk7wq_6afb74f3-2562-44b5-b5f5-1acb5cfe0cf9/monitoring-plugin/0.log"
Jul 23 16:39:02.089300 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:02.089260    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tlhdq_8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f/node-exporter/0.log"
Jul 23 16:39:02.112287 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:02.112260    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tlhdq_8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f/kube-rbac-proxy/0.log"
Jul 23 16:39:02.133544 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:02.133444    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tlhdq_8e90c3ee-dbcd-4e1c-99c0-fabaee0b9d2f/init-textfile/0.log"
Jul 23 16:39:02.173206 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:02.173175    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-ln7nn_8ce7bcfe-f1cf-4178-8c06-0381dbc97b17/kube-rbac-proxy-main/0.log"
Jul 23 16:39:02.195377 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:02.195338    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-ln7nn_8ce7bcfe-f1cf-4178-8c06-0381dbc97b17/kube-rbac-proxy-self/0.log"
Jul 23 16:39:02.220634 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:02.220602    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-ln7nn_8ce7bcfe-f1cf-4178-8c06-0381dbc97b17/openshift-state-metrics/0.log"
Jul 23 16:39:02.424263 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:02.424170    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-7ztlg_f0ab6951-8de3-4815-9176-31991b75be4d/prometheus-operator/0.log"
Jul 23 16:39:02.445374 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:02.445337    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-7ztlg_f0ab6951-8de3-4815-9176-31991b75be4d/kube-rbac-proxy/0.log"
Jul 23 16:39:02.479303 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:02.479269    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-sq5kb_58215c1a-8b23-45de-b3fc-747c993f264a/prometheus-operator-admission-webhook/0.log"
Jul 23 16:39:02.511115 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:02.511085    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cf8d76d75-8g7g9_8e2c9552-fb54-4c92-9d4a-335c5e579349/telemeter-client/0.log"
Jul 23 16:39:02.534155 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:02.534126    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cf8d76d75-8g7g9_8e2c9552-fb54-4c92-9d4a-335c5e579349/reload/0.log"
Jul 23 16:39:02.555775 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:02.555738    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7cf8d76d75-8g7g9_8e2c9552-fb54-4c92-9d4a-335c5e579349/kube-rbac-proxy/0.log"
Jul 23 16:39:04.907453 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:04.907415    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-86b6896cf5-zfhqj_fdbb629e-77b6-48d2-8ebe-e9bec3f3ec5b/console/0.log"
Jul 23 16:39:04.947989 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:04.947953    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-d49k9_69d39bb9-aa10-4399-bd69-8e60aed59cd7/download-server/0.log"
Jul 23 16:39:06.684630 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:06.684597    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-crv9s_3b042f20-34c4-4c4d-afd9-b3616288a7c0/dns/0.log"
Jul 23 16:39:06.729647 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:06.729609    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-crv9s_3b042f20-34c4-4c4d-afd9-b3616288a7c0/kube-rbac-proxy/0.log"
Jul 23 16:39:06.878613 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:06.878580    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9k4dp_eabd10ab-eefb-4fb3-a01f-deb9751c945e/dns-node-resolver/0.log"
Jul 23 16:39:06.948592 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:06.948495    2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"]
Jul 23 16:39:06.955973 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:06.955940    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:06.964197 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:06.964162    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"]
Jul 23 16:39:07.050387 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.050347    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c50df04d-8345-416b-81a4-1dd83e56d005-podres\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.050697 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.050670    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dnxw\" (UniqueName: \"kubernetes.io/projected/c50df04d-8345-416b-81a4-1dd83e56d005-kube-api-access-8dnxw\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.050796 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.050743    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c50df04d-8345-416b-81a4-1dd83e56d005-proc\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.050858 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.050825    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c50df04d-8345-416b-81a4-1dd83e56d005-sys\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.050914 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.050899    2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c50df04d-8345-416b-81a4-1dd83e56d005-lib-modules\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.151536 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.151495    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c50df04d-8345-416b-81a4-1dd83e56d005-proc\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.151792 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.151760    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c50df04d-8345-416b-81a4-1dd83e56d005-proc\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.152746 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.151965    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c50df04d-8345-416b-81a4-1dd83e56d005-sys\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.152746 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.152062    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c50df04d-8345-416b-81a4-1dd83e56d005-lib-modules\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.152746 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.152107    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c50df04d-8345-416b-81a4-1dd83e56d005-podres\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.152746 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.152170    2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dnxw\" (UniqueName: \"kubernetes.io/projected/c50df04d-8345-416b-81a4-1dd83e56d005-kube-api-access-8dnxw\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.152746 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.152612    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c50df04d-8345-416b-81a4-1dd83e56d005-sys\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.152746 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.152745    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c50df04d-8345-416b-81a4-1dd83e56d005-lib-modules\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.153053 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.152776    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c50df04d-8345-416b-81a4-1dd83e56d005-podres\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.162322 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.162298    2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dnxw\" (UniqueName: \"kubernetes.io/projected/c50df04d-8345-416b-81a4-1dd83e56d005-kube-api-access-8dnxw\") pod \"perf-node-gather-daemonset-wv6wj\" (UID: \"c50df04d-8345-416b-81a4-1dd83e56d005\") " pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.274270 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.274235    2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:07.464303 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.464201    2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"]
Jul 23 16:39:07.471080 ip-10-0-135-218 kubenswrapper[2570]: W0723 16:39:07.471042    2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc50df04d_8345_416b_81a4_1dd83e56d005.slice/crio-b2b33d9faacefad96d976225c880b03be853e6a80621bf94f80f49d8b2469fa9 WatchSource:0}: Error finding container b2b33d9faacefad96d976225c880b03be853e6a80621bf94f80f49d8b2469fa9: Status 404 returned error can't find the container with id b2b33d9faacefad96d976225c880b03be853e6a80621bf94f80f49d8b2469fa9
Jul 23 16:39:07.576616 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.576584    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64c5f57566-fvgx8_ed7cd7af-261f-4dbd-9e17-2d9c02ae6958/registry/0.log"
Jul 23 16:39:07.652504 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:07.652478    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vcvbr_2f807ec5-5297-4b0d-b04e-9250b909df3a/node-ca/0.log"
Jul 23 16:39:08.000174 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:08.000139    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj" event={"ID":"c50df04d-8345-416b-81a4-1dd83e56d005","Type":"ContainerStarted","Data":"ab212a6b95272227dbafc798ac4abfbfa39148226dae140210305017a6d72b8d"}
Jul 23 16:39:08.000751 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:08.000725    2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj" event={"ID":"c50df04d-8345-416b-81a4-1dd83e56d005","Type":"ContainerStarted","Data":"b2b33d9faacefad96d976225c880b03be853e6a80621bf94f80f49d8b2469fa9"}
Jul 23 16:39:08.000898 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:08.000884    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:08.018677 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:08.018629    2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj" podStartSLOduration=2.018611228 podStartE2EDuration="2.018611228s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 16:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 16:39:08.017728837 +0000 UTC m=+2933.941583471" watchObservedRunningTime="2026-07-23 16:39:08.018611228 +0000 UTC m=+2933.942465852"
Jul 23 16:39:08.789914 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:08.789878    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c56c994b9-rrkgh_f07ea543-3a22-49ee-bbb7-28d45896c8bf/kube-auth-proxy/0.log"
Jul 23 16:39:08.892987 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:08.892947    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-mklln_d3e29cb9-b084-4916-b58a-f61d391dc80f/payload-pre-processing/0.log"
Jul 23 16:39:09.752142 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:09.752107    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wkrfk_b2e75568-9d55-4a31-8cfc-adf3c6879a2e/serve-healthcheck-canary/0.log"
Jul 23 16:39:10.323996 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:10.323964    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t7dx2_cc5039e4-b159-4539-a98a-6e823a828796/kube-rbac-proxy/0.log"
Jul 23 16:39:10.352183 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:10.352151    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t7dx2_cc5039e4-b159-4539-a98a-6e823a828796/exporter/0.log"
Jul 23 16:39:10.374509 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:10.374482    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t7dx2_cc5039e4-b159-4539-a98a-6e823a828796/extractor/0.log"
Jul 23 16:39:12.565561 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:12.565511    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-h6src_acd18520-f84a-4688-ae38-84f41f6dc943/manager/0.log"
Jul 23 16:39:12.923778 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:12.923659    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-5pb78_2d8c0155-0220-40da-a24b-ce28c368c185/manager/0.log"
Jul 23 16:39:13.132911 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:13.132868    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-688fcc8886-mbbwq_2794f966-bd7d-4187-bdd9-06ce5ab40f8a/manager/0.log"
Jul 23 16:39:13.326514 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:13.326479    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2dj4p_e6c02851-a121-4661-898e-cc71ec4dc208/manager/0.log"
Jul 23 16:39:13.456551 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:13.456423    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-575b84b7c9-l4qgs_8abf694b-0dbb-472f-98ca-83e8a903abd7/manager/0.log"
Jul 23 16:39:13.474426 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:13.474392    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-575b84b7c9-l4qgs_8abf694b-0dbb-472f-98ca-83e8a903abd7/copy-manifests/0.log"
Jul 23 16:39:14.273604 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:14.273569    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c56c994b9-rrkgh_f07ea543-3a22-49ee-bbb7-28d45896c8bf/kube-auth-proxy/0.log"
Jul 23 16:39:14.348329 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:14.348291    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-mklln_d3e29cb9-b084-4916-b58a-f61d391dc80f/payload-pre-processing/0.log"
Jul 23 16:39:15.029628 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:15.029589    2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9l5zs/perf-node-gather-daemonset-wv6wj"
Jul 23 16:39:15.763596 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:15.763554    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c56c994b9-rrkgh_f07ea543-3a22-49ee-bbb7-28d45896c8bf/kube-auth-proxy/0.log"
Jul 23 16:39:15.844310 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:15.844272    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-mklln_d3e29cb9-b084-4916-b58a-f61d391dc80f/payload-pre-processing/0.log"
Jul 23 16:39:21.631194 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:21.631116    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-59bvr_ecb48312-fb80-4132-9010-86f28d0f9891/kube-multus/0.log"
Jul 23 16:39:21.985379 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:21.985341    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlhlb_afbd575c-46b7-4aae-bc60-6c04faa47aef/kube-multus-additional-cni-plugins/0.log"
Jul 23 16:39:22.006449 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:22.006418    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlhlb_afbd575c-46b7-4aae-bc60-6c04faa47aef/egress-router-binary-copy/0.log"
Jul 23 16:39:22.026905 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:22.026879    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlhlb_afbd575c-46b7-4aae-bc60-6c04faa47aef/cni-plugins/0.log"
Jul 23 16:39:22.048416 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:22.048373    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlhlb_afbd575c-46b7-4aae-bc60-6c04faa47aef/bond-cni-plugin/0.log"
Jul 23 16:39:22.068615 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:22.068587    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlhlb_afbd575c-46b7-4aae-bc60-6c04faa47aef/routeoverride-cni/0.log"
Jul 23 16:39:22.092973 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:22.092939    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlhlb_afbd575c-46b7-4aae-bc60-6c04faa47aef/whereabouts-cni-bincopy/0.log"
Jul 23 16:39:22.115061 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:22.115034    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vlhlb_afbd575c-46b7-4aae-bc60-6c04faa47aef/whereabouts-cni/0.log"
Jul 23 16:39:22.250385 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:22.250297    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4wml4_eca674e0-139e-42c0-b87a-03d0e60e43ce/network-metrics-daemon/0.log"
Jul 23 16:39:22.266339 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:22.266311    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4wml4_eca674e0-139e-42c0-b87a-03d0e60e43ce/kube-rbac-proxy/0.log"
Jul 23 16:39:23.198269 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:23.198236    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56lz5_b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7/ovn-controller/0.log"
Jul 23 16:39:23.220266 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:23.220231    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56lz5_b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7/ovn-acl-logging/0.log"
Jul 23 16:39:23.245386 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:23.245358    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56lz5_b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7/kube-rbac-proxy-node/0.log"
Jul 23 16:39:23.267560 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:23.267530    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56lz5_b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7/kube-rbac-proxy-ovn-metrics/0.log"
Jul 23 16:39:23.285155 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:23.285130    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56lz5_b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7/northd/0.log"
Jul 23 16:39:23.307952 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:23.307911    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56lz5_b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7/nbdb/0.log"
Jul 23 16:39:23.328661 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:23.328627    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56lz5_b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7/sbdb/0.log"
Jul 23 16:39:23.431180 ip-10-0-135-218 kubenswrapper[2570]: I0723 16:39:23.431124    2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-56lz5_b60e3acf-c04e-4c3e-9e2a-ae41a9f7efd7/ovnkube-controller/0.log"